[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:03:06 dist-test-slave-69rg krb5kdc[11624](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:03:06 dist-test-slave-69rg krb5kdc[11624](info): set up 2 sockets
Aug 06 01:03:06 dist-test-slave-69rg krb5kdc[11624](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260806 01:03:07.476818 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.222s user 0.007s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:03:07 dist-test-slave-69rg krb5kdc[11624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978187, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:03:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:03:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:03:07.629145 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:39907
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:38239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:39907
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:07.729799 11637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:07.730175 11637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:07.730222 11637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:07.731570 11637 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:03:07.731655 11637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:07.731679 11637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:07.731701 11637 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:03:07.731731 11637 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:03:07.733608 11637 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:38239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:39907
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:39907
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11637
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:07.733997 11637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:07.734297 11637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:07.742127 11643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:07.742127 11645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:07.742127 11637 server_base.cc:1034] running on GCE node
W20260806 01:03:07.743945 11642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:07.744448 11637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:07.745298 11637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:07.746508 11637 hybrid_clock.cc:648] HybridClock initialized: now 1785978187746462 us; error 82 us; skew 500 ppm
Aug 06 01:03:07 dist-test-slave-69rg krb5kdc[11624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978187, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:07.749570 11637 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:03:07.750402 11637 webserver.cc:460] Webserver started at http://127.11.88.126:43411/ using document root <none> and password file <none>
I20260806 01:03:07.750941 11637 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:07.751017 11637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:07.751138 11637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:07.752609 11637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "7af9bb4e9912407e98a31d96481eb3c4"
format_stamp: "Formatted at 2026-08-06 01:03:07 on dist-test-slave-69rg"
server_key: "d101290302d0455bfdfae80451fac5ee"
server_key_iv: "1ac4626ba7baeaeae8df7b9967c1f628"
server_key_version: "encryptionkey@0"
I20260806 01:03:07.753080 11637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "7af9bb4e9912407e98a31d96481eb3c4"
format_stamp: "Formatted at 2026-08-06 01:03:07 on dist-test-slave-69rg"
server_key: "d101290302d0455bfdfae80451fac5ee"
server_key_iv: "1ac4626ba7baeaeae8df7b9967c1f628"
server_key_version: "encryptionkey@0"
I20260806 01:03:07.755471 11637 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 01:03:07.756800 11652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:07.757125 11637 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:07.757259 11637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "7af9bb4e9912407e98a31d96481eb3c4"
format_stamp: "Formatted at 2026-08-06 01:03:07 on dist-test-slave-69rg"
server_key: "d101290302d0455bfdfae80451fac5ee"
server_key_iv: "1ac4626ba7baeaeae8df7b9967c1f628"
server_key_version: "encryptionkey@0"
I20260806 01:03:07.757366 11637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:07.784577 11637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:07.788030 11637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:07.788233 11637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:07.794056 11637 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:39907
I20260806 01:03:07.794097 11705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:39907 every 8 connection(s)
I20260806 01:03:07.794602 11637 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:03:07.795675 11706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:07.796772 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 11637
I20260806 01:03:07.796934 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:03:07.797617 11617 external_mini_cluster.cc:1428] Setting key fb2b032928fa6f71d7d0c22e7bd0efc4
I20260806 01:03:07.799867 11706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7af9bb4e9912407e98a31d96481eb3c4: Bootstrap starting.
I20260806 01:03:07.800812 11706 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7af9bb4e9912407e98a31d96481eb3c4: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:07.801143 11706 log.cc:824] T 00000000000000000000000000000000 P 7af9bb4e9912407e98a31d96481eb3c4: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:07.802000 11706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7af9bb4e9912407e98a31d96481eb3c4: No bootstrap required, opened a new log
I20260806 01:03:07.804581 11706 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7af9bb4e9912407e98a31d96481eb3c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7af9bb4e9912407e98a31d96481eb3c4" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39907 } }
I20260806 01:03:07.804785 11706 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7af9bb4e9912407e98a31d96481eb3c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:07.804862 11706 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7af9bb4e9912407e98a31d96481eb3c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7af9bb4e9912407e98a31d96481eb3c4, State: Initialized, Role: FOLLOWER
I20260806 01:03:07.805023 11706 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7af9bb4e9912407e98a31d96481eb3c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7af9bb4e9912407e98a31d96481eb3c4" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39907 } }
I20260806 01:03:07.805120 11706 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7af9bb4e9912407e98a31d96481eb3c4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:03:07.805168 11706 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7af9bb4e9912407e98a31d96481eb3c4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:03:07.805220 11706 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7af9bb4e9912407e98a31d96481eb3c4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:07.805938 11706 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7af9bb4e9912407e98a31d96481eb3c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7af9bb4e9912407e98a31d96481eb3c4" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39907 } }
I20260806 01:03:07.806070 11706 leader_election.cc:302] T 00000000000000000000000000000000 P 7af9bb4e9912407e98a31d96481eb3c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7af9bb4e9912407e98a31d96481eb3c4; no voters:
I20260806 01:03:07.806288 11706 leader_election.cc:288] T 00000000000000000000000000000000 P 7af9bb4e9912407e98a31d96481eb3c4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:03:07.806350 11711 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7af9bb4e9912407e98a31d96481eb3c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:07.806586 11711 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7af9bb4e9912407e98a31d96481eb3c4 [term 1 LEADER]: Becoming Leader. State: Replica: 7af9bb4e9912407e98a31d96481eb3c4, State: Running, Role: LEADER
I20260806 01:03:07.806635 11706 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7af9bb4e9912407e98a31d96481eb3c4 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:03:07.806907 11711 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7af9bb4e9912407e98a31d96481eb3c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7af9bb4e9912407e98a31d96481eb3c4" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39907 } }
I20260806 01:03:07.808509 11713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7af9bb4e9912407e98a31d96481eb3c4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7af9bb4e9912407e98a31d96481eb3c4. Latest consensus state: current_term: 1 leader_uuid: "7af9bb4e9912407e98a31d96481eb3c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7af9bb4e9912407e98a31d96481eb3c4" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39907 } } }
I20260806 01:03:07.808790 11712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7af9bb4e9912407e98a31d96481eb3c4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7af9bb4e9912407e98a31d96481eb3c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7af9bb4e9912407e98a31d96481eb3c4" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39907 } } }
W20260806 01:03:07.808944 11725 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7af9bb4e9912407e98a31d96481eb3c4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260806 01:03:07.809877 11712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7af9bb4e9912407e98a31d96481eb3c4 [sys.catalog]: This master's current role is: LEADER
W20260806 01:03:07.809926 11725 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 01:03:07.810046 11713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7af9bb4e9912407e98a31d96481eb3c4 [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:07.810276 11729 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:03:07.810520 11729 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:03:07.812976 11729 catalog_manager.cc:1347] Generated new cluster ID: 930e5f1cd1994d4b8b0f58423692491c
I20260806 01:03:07.813176 11729 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 01:03:07 dist-test-slave-69rg krb5kdc[11624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978187, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:07.826319 11709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:07.799096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54770 (local address 127.11.88.126:39907)
0806 01:03:07.799339 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:07.799350 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:07.799654 (+ 304us) server_negotiation.cc:407] Connection header received
0806 01:03:07.802464 (+ 2810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:07.802472 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:07.802592 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:07.803014 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:07.807171 (+ 4157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:07.809037 (+ 1866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:07.811229 (+ 2192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:07.812522 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:07.812715 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:07.819501 (+ 6786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:07.819506 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:07.819506 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:07.819523 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:07.822940 (+ 3417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:07.823764 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:07.823768 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:07.823768 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:07.823911 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:07.824299 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:07.824300 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:07.824300 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:07.824638 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:07.824788 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:07.825318 (+ 530us) server_negotiation.cc:299] Negotiation successful
0806 01:03:07.825483 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":106,"threads_started":1}
I20260806 01:03:07.848881 11729 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:03:07.851781 11729 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:03:07.856490 11729 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7af9bb4e9912407e98a31d96481eb3c4: Generated new TSK 0
I20260806 01:03:07.856895 11729 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.88.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
I20260806 01:03:07.903880 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:0
--local_ip_for_outbound_sockets=127.11.88.65
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:39907
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:38239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:08.046589 11733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:08.046847 11733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:08.046878 11733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:08.048295 11733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:08.048362 11733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:08.048396 11733 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:03:08.050648 11733 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:38239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:39907
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11733
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:08.051358 11733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:08.051663 11733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:08.060796 11739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:08.061304 11738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:08.060796 11741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:08.062515 11733 server_base.cc:1034] running on GCE node
I20260806 01:03:08.062851 11733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:08.063212 11733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:08.065989 11733 hybrid_clock.cc:648] HybridClock initialized: now 1785978188065969 us; error 33 us; skew 500 ppm
Aug 06 01:03:08 dist-test-slave-69rg krb5kdc[11624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978188, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:08.070643 11733 init.cc:377] Logged in from keytab as kudu/127.11.88.65@KRBTEST.COM (short username kudu)
I20260806 01:03:08.071354 11733 webserver.cc:460] Webserver started at http://127.11.88.65:46375/ using document root <none> and password file <none>
I20260806 01:03:08.071689 11733 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:08.071769 11733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:08.071930 11733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:08.073864 11733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-0/data/instance:
uuid: "4a9f31c17fb94b8fa320f2ccef89e995"
format_stamp: "Formatted at 2026-08-06 01:03:08 on dist-test-slave-69rg"
server_key: "ab0a917176a24ece7f4eccbdb298e36f"
server_key_iv: "e628e8ab55fc964e933e635292d9bd46"
server_key_version: "encryptionkey@0"
I20260806 01:03:08.074687 11733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance:
uuid: "4a9f31c17fb94b8fa320f2ccef89e995"
format_stamp: "Formatted at 2026-08-06 01:03:08 on dist-test-slave-69rg"
server_key: "ab0a917176a24ece7f4eccbdb298e36f"
server_key_iv: "e628e8ab55fc964e933e635292d9bd46"
server_key_version: "encryptionkey@0"
I20260806 01:03:08.077210 11733 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 01:03:08.078477 11748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:08.078845 11733 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:08.078972 11733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "4a9f31c17fb94b8fa320f2ccef89e995"
format_stamp: "Formatted at 2026-08-06 01:03:08 on dist-test-slave-69rg"
server_key: "ab0a917176a24ece7f4eccbdb298e36f"
server_key_iv: "e628e8ab55fc964e933e635292d9bd46"
server_key_version: "encryptionkey@0"
I20260806 01:03:08.079119 11733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:08.091563 11733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:08.095223 11733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:08.095431 11733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:08.095717 11733 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:08.096262 11733 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:08.096355 11733 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:08.096396 11733 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:08.096424 11733 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:08.111531 11733 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:41849
I20260806 01:03:08.111696 11863 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:41849 every 8 connection(s)
I20260806 01:03:08.112049 11733 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
I20260806 01:03:08.112838 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 11733
I20260806 01:03:08.112967 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance
I20260806 01:03:08.113353 11617 external_mini_cluster.cc:1428] Setting key 8120bb5b5c8864e45564e69798b2c945
Aug 06 01:03:08 dist-test-slave-69rg krb5kdc[11624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978188, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.88.66@KRBTEST.COM; defaulting to no policy
I20260806 01:03:08.128458 11709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:08.113322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:50117 (local address 127.11.88.126:39907)
0806 01:03:08.113392 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:08.113395 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:08.114011 (+ 616us) server_negotiation.cc:407] Connection header received
0806 01:03:08.115198 (+ 1187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:08.115199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:08.115210 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:08.115270 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:08.117289 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:08.118190 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:08.119982 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:08.120445 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:08.120549 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:08.124184 (+ 3635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:08.124186 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:08.124187 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:08.124198 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:08.126535 (+ 2337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:08.127163 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:08.127165 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:08.127165 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:08.127236 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:08.127611 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:08.127612 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:08.127613 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:08.127770 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:08.127863 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:08.128195 (+ 332us) server_negotiation.cc:299] Negotiation successful
0806 01:03:08.128341 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 01:03:08.128727 11866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:08.113314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:39907 (local address 127.11.88.65:50117)
0806 01:03:08.113825 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:08.113920 (+ 95us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:08.115029 (+ 1109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:08.115354 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:08.115358 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:08.116681 (+ 1323us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:08.117144 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:08.117158 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:08.118404 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:08.118406 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:08.119846 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:08.119853 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:08.120603 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:08.120605 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:08.120824 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:08.121645 (+ 821us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:08.121656 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:08.124050 (+ 2394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:08.126710 (+ 2660us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:08.126723 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:08.126726 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:08.127024 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:08.127359 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:08.127360 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:08.127360 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:08.127495 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:08.127851 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:08.127860 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:08.128033 (+ 173us) client_negotiation.cc:769] Sending connection context
0806 01:03:08.128156 (+ 123us) client_negotiation.cc:240] Negotiation successful
0806 01:03:08.128377 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":217,"threads_started":1}
I20260806 01:03:08.129909 11864 heartbeater.cc:347] Connected to a master server at 127.11.88.126:39907
I20260806 01:03:08.130018 11864 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:08.130247 11864 heartbeater.cc:511] Master 127.11.88.126:39907 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.66@KRBTEST.COM" created.
I20260806 01:03:08.131212 11669 ts_manager.cc:194] Registered new tserver with Master: 4a9f31c17fb94b8fa320f2ccef89e995 (127.11.88.65:41849)
I20260806 01:03:08.132164 11669 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.65@KRBTEST.COM'} at 127.11.88.65:50117
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
I20260806 01:03:08.159109 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:0
--local_ip_for_outbound_sockets=127.11.88.66
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:39907
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:38239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:08.319618 11870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:08.319909 11870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:08.319942 11870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:08.321668 11870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:08.321782 11870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:08.321889 11870 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:03:08.324430 11870 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:38239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:39907
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:08.324792 11870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:08.325079 11870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:08.333622 11875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:08.333716 11870 server_base.cc:1034] running on GCE node
W20260806 01:03:08.334065 11878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:08.334537 11876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:08.335103 11870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:08.335417 11870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:08.336668 11870 hybrid_clock.cc:648] HybridClock initialized: now 1785978188336648 us; error 38 us; skew 500 ppm
Aug 06 01:03:08 dist-test-slave-69rg krb5kdc[11624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978188, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:08.340689 11870 init.cc:377] Logged in from keytab as kudu/127.11.88.66@KRBTEST.COM (short username kudu)
I20260806 01:03:08.341253 11870 webserver.cc:460] Webserver started at http://127.11.88.66:38493/ using document root <none> and password file <none>
I20260806 01:03:08.341537 11870 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:08.341615 11870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:08.341993 11870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:08.343462 11870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-1/data/instance:
uuid: "d3bfb6b9d86b42b894078a022bbf6507"
format_stamp: "Formatted at 2026-08-06 01:03:08 on dist-test-slave-69rg"
server_key: "9cc46b62c8a20c56ddc51760bf96204f"
server_key_iv: "a58aa6d00e3d1b9ce456ea6be31c77cd"
server_key_version: "encryptionkey@0"
I20260806 01:03:08.343915 11870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance:
uuid: "d3bfb6b9d86b42b894078a022bbf6507"
format_stamp: "Formatted at 2026-08-06 01:03:08 on dist-test-slave-69rg"
server_key: "9cc46b62c8a20c56ddc51760bf96204f"
server_key_iv: "a58aa6d00e3d1b9ce456ea6be31c77cd"
server_key_version: "encryptionkey@0"
I20260806 01:03:08.345984 11870 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.002s
I20260806 01:03:08.347162 11885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:08.347590 11870 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:03:08.347950 11870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "d3bfb6b9d86b42b894078a022bbf6507"
format_stamp: "Formatted at 2026-08-06 01:03:08 on dist-test-slave-69rg"
server_key: "9cc46b62c8a20c56ddc51760bf96204f"
server_key_iv: "a58aa6d00e3d1b9ce456ea6be31c77cd"
server_key_version: "encryptionkey@0"
I20260806 01:03:08.348060 11870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:08.366115 11870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:08.369112 11870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:08.369321 11870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:08.369916 11870 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:08.370280 11870 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:08.370317 11870 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:08.370358 11870 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:08.370384 11870 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:08.386848 11870 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:34889
I20260806 01:03:08.386950 11999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:34889 every 8 connection(s)
I20260806 01:03:08.387357 11870 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
I20260806 01:03:08.390161 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 11870
I20260806 01:03:08.390302 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance
I20260806 01:03:08.390632 11617 external_mini_cluster.cc:1428] Setting key b6ee4148e288267cf7ef3d4a95bc0a65
Aug 06 01:03:08 dist-test-slave-69rg krb5kdc[11624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978188, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:08.404325 11709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:08.388627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:54699 (local address 127.11.88.126:39907)
0806 01:03:08.388740 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:08.388743 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:08.388993 (+ 250us) server_negotiation.cc:407] Connection header received
0806 01:03:08.389491 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:08.389493 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:08.389504 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:08.389571 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:08.391323 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:08.392010 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:08.395705 (+ 3695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:08.396084 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:08.396180 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:08.400206 (+ 4026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:08.400208 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:08.400208 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:08.400218 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:08.402082 (+ 1864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:08.403005 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:08.403006 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:08.403007 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:08.403074 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:08.403479 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:08.403480 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:08.403480 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:08.403632 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:08.403693 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:08.404146 (+ 453us) server_negotiation.cc:299] Negotiation successful
0806 01:03:08.404244 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 01:03:08.404639 12002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:08.388534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:39907 (local address 127.11.88.66:54699)
0806 01:03:08.388826 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:08.388869 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:08.389374 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:08.389714 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:08.389718 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:08.390914 (+ 1196us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:08.391172 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:08.391181 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:08.392113 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:08.392115 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:08.395546 (+ 3431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:08.395553 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:08.396219 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:08.396220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:08.396352 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:08.397095 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:08.397113 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:08.400033 (+ 2920us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:08.402355 (+ 2322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:08.402368 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:08.402371 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:08.402819 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:08.403151 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:08.403153 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:08.403153 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:08.403349 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:08.403711 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:08.403720 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:08.403943 (+ 223us) client_negotiation.cc:769] Sending connection context
0806 01:03:08.404086 (+ 143us) client_negotiation.cc:240] Negotiation successful
0806 01:03:08.404335 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":84,"threads_started":1}
WARNING: no policy specified for kudu/127.11.88.67@KRBTEST.COM; defaulting to no policy
I20260806 01:03:08.405418 12000 heartbeater.cc:347] Connected to a master server at 127.11.88.126:39907
I20260806 01:03:08.405529 12000 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:08.405750 12000 heartbeater.cc:511] Master 127.11.88.126:39907 requested a full tablet report, sending...
I20260806 01:03:08.406248 11669 ts_manager.cc:194] Registered new tserver with Master: d3bfb6b9d86b42b894078a022bbf6507 (127.11.88.66:34889)
I20260806 01:03:08.406710 11669 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.66@KRBTEST.COM'} at 127.11.88.66:54699
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
I20260806 01:03:08.445996 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:0
--local_ip_for_outbound_sockets=127.11.88.67
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:39907
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:38239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:08.569695 12005 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:08.572873 12005 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:08.572994 12005 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:08.577548 12005 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:08.577654 12005 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:08.577700 12005 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:03:08.581175 12005 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:38239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:39907
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12005
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:08.581549 12005 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:08.582384 12005 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:08.589747 12013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:08.589910 12011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:08.590000 12005 server_base.cc:1034] running on GCE node
W20260806 01:03:08.589918 12010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:08.590390 12005 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:08.590674 12005 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:08.592101 12005 hybrid_clock.cc:648] HybridClock initialized: now 1785978188592066 us; error 53 us; skew 500 ppm
Aug 06 01:03:08 dist-test-slave-69rg krb5kdc[11624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978188, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:08.596921 12005 init.cc:377] Logged in from keytab as kudu/127.11.88.67@KRBTEST.COM (short username kudu)
I20260806 01:03:08.597725 12005 webserver.cc:460] Webserver started at http://127.11.88.67:46755/ using document root <none> and password file <none>
I20260806 01:03:08.598068 12005 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:08.598127 12005 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:08.598270 12005 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:08.600025 12005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-2/data/instance:
uuid: "b3ec50ad12c14abd806eeb541d7a585e"
format_stamp: "Formatted at 2026-08-06 01:03:08 on dist-test-slave-69rg"
server_key: "125f777a98d4db485040b7a4e09b12f0"
server_key_iv: "5832ea0f78a9348583ad158f4ec501f7"
server_key_version: "encryptionkey@0"
I20260806 01:03:08.600485 12005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance:
uuid: "b3ec50ad12c14abd806eeb541d7a585e"
format_stamp: "Formatted at 2026-08-06 01:03:08 on dist-test-slave-69rg"
server_key: "125f777a98d4db485040b7a4e09b12f0"
server_key_iv: "5832ea0f78a9348583ad158f4ec501f7"
server_key_version: "encryptionkey@0"
I20260806 01:03:08.602192 12005 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260806 01:03:08.603518 12020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:08.604123 12005 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260806 01:03:08.604401 12005 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "b3ec50ad12c14abd806eeb541d7a585e"
format_stamp: "Formatted at 2026-08-06 01:03:08 on dist-test-slave-69rg"
server_key: "125f777a98d4db485040b7a4e09b12f0"
server_key_iv: "5832ea0f78a9348583ad158f4ec501f7"
server_key_version: "encryptionkey@0"
I20260806 01:03:08.604473 12005 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:08.618378 12005 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:08.621716 12005 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:08.622005 12005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:08.622359 12005 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:08.622836 12005 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:08.622877 12005 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:08.622902 12005 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:08.622915 12005 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:08.636921 12005 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:37327
I20260806 01:03:08.636996 12137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:37327 every 8 connection(s)
I20260806 01:03:08.637382 12005 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
I20260806 01:03:08.644253 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 12005
I20260806 01:03:08.644356 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance
I20260806 01:03:08.644636 11617 external_mini_cluster.cc:1428] Setting key 38755d50b2fef1627a6a9d8ecab138da
Aug 06 01:03:08 dist-test-slave-69rg krb5kdc[11624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978188, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:08.649876 11709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:08.638746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:48651 (local address 127.11.88.126:39907)
0806 01:03:08.638839 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:08.638843 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:08.639033 (+ 190us) server_negotiation.cc:407] Connection header received
0806 01:03:08.639776 (+ 743us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:08.639778 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:08.639793 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:08.639844 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:08.640967 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:08.641492 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:08.642713 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:08.642923 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:08.643004 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:08.646799 (+ 3795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:08.646801 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:08.646802 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:08.646810 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:08.648323 (+ 1513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:08.648791 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:08.648793 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:08.648793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:08.648854 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:08.649115 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:08.649116 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:08.649117 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:08.649266 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:08.649344 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:08.649646 (+ 302us) server_negotiation.cc:299] Negotiation successful
0806 01:03:08.649742 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 01:03:08.650117 12140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:08.638593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:39907 (local address 127.11.88.67:48651)
0806 01:03:08.638877 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:08.638935 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:08.639645 (+ 710us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:08.639919 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:08.639924 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:08.640575 (+ 651us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:08.640859 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:08.640865 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:08.641597 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:08.641598 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:08.642615 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:08.642619 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:08.643017 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:08.643018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:08.643167 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:08.643768 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:08.644067 (+ 299us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:08.646653 (+ 2586us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:08.648422 (+ 1769us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:08.648432 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:08.648434 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:08.648694 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:08.648930 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:08.648931 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:08.648931 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:08.649052 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:08.649349 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:08.649356 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:08.649505 (+ 149us) client_negotiation.cc:769] Sending connection context
0806 01:03:08.649613 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 01:03:08.649810 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":121,"threads_started":1}
I20260806 01:03:08.650916 12138 heartbeater.cc:347] Connected to a master server at 127.11.88.126:39907
I20260806 01:03:08.651060 12138 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:08.651290 12138 heartbeater.cc:511] Master 127.11.88.126:39907 requested a full tablet report, sending...
I20260806 01:03:08.651996 11669 ts_manager.cc:194] Registered new tserver with Master: b3ec50ad12c14abd806eeb541d7a585e (127.11.88.67:37327)
I20260806 01:03:08.652585 11669 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.67@KRBTEST.COM'} at 127.11.88.67:48651
I20260806 01:03:08.658968 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 01:03:08 dist-test-slave-69rg krb5kdc[11624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978188, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 01:03:08 dist-test-slave-69rg krb5kdc[11624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978188, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.88.65@KRBTEST.COM
I20260806 01:03:08.690570 12145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:08.679907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40244 (local address 127.11.88.65:41849)
0806 01:03:08.680068 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:08.680074 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:08.680086 (+ 12us) server_negotiation.cc:407] Connection header received
0806 01:03:08.680118 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:08.680121 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:08.680145 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:08.680252 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:08.680940 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:08.681941 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:08.682845 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:08.683208 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:08.683296 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:08.686250 (+ 2954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:08.686280 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:08.686281 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:08.686302 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:08.688689 (+ 2387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:08.689154 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:08.689159 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:08.689159 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:08.689239 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:08.689459 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:08.689460 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:08.689460 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:08.689801 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:08.690252 (+ 451us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:08.690307 (+ 55us) server_negotiation.cc:299] Negotiation successful
0806 01:03:08.690409 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":72,"threads_started":1}
W20260806 01:03:08.691423 11778 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40244
Aug 06 01:03:08 dist-test-slave-69rg krb5kdc[11624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978188, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 01:03:08 dist-test-slave-69rg krb5kdc[11624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978188, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.65@KRBTEST.COM
I20260806 01:03:08.720696 12145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:08.711335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40260 (local address 127.11.88.65:41849)
0806 01:03:08.711440 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:08.711442 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:08.711453 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:03:08.711480 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:08.711481 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:08.711495 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:08.711561 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:08.713063 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:08.713596 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:08.714818 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:08.715027 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:08.715102 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:08.717992 (+ 2890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:08.717994 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:08.717994 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:08.718004 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:08.719502 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:08.719890 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:08.719892 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:08.719892 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:08.719956 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:08.720166 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:08.720167 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:08.720167 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:08.720278 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:08.720389 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:08.720490 (+ 101us) server_negotiation.cc:299] Negotiation successful
0806 01:03:08.720583 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 01:03:08.721429 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 11733
I20260806 01:03:08.728101 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 11870
I20260806 01:03:08.734284 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 12005
I20260806 01:03:08.742115 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 11637
2026-08-06T01:03:08Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2518 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:03:08 dist-test-slave-69rg krb5kdc[12152](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:03:08 dist-test-slave-69rg krb5kdc[12152](info): set up 2 sockets
Aug 06 01:03:08 dist-test-slave-69rg krb5kdc[12152](info): commencing operation
krb5kdc: starting...
W20260806 01:03:09.923141 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.157s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:03:10 dist-test-slave-69rg krb5kdc[12152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:03:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:03:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:03:10.098289 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:36567
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:42333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:36567
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:10.195809 12165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:10.196076 12165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:10.196102 12165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:10.197499 12165 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:03:10.197559 12165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:10.197574 12165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:10.197587 12165 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:03:10.197600 12165 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:03:10.199611 12165 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:42333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:36567
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:36567
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12165
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:10.199990 12165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:10.200266 12165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:10.206662 12170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:10.206789 12173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:10.206796 12171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:10.207392 12165 server_base.cc:1034] running on GCE node
I20260806 01:03:10.207721 12165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:10.208088 12165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:10.209263 12165 hybrid_clock.cc:648] HybridClock initialized: now 1785978190209266 us; error 78 us; skew 500 ppm
Aug 06 01:03:10 dist-test-slave-69rg krb5kdc[12152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978190, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:10.211936 12165 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:03:10.212437 12165 webserver.cc:460] Webserver started at http://127.11.88.126:32947/ using document root <none> and password file <none>
I20260806 01:03:10.212709 12165 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:10.212785 12165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:10.212940 12165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:10.214154 12165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "460550446edc434ab6be280d9dd029fa"
format_stamp: "Formatted at 2026-08-06 01:03:10 on dist-test-slave-69rg"
server_key: "8f09bd12374b6e47da0476fecf73eec7"
server_key_iv: "b1422795e9f9032847aa3f6ac7fca953"
server_key_version: "encryptionkey@0"
I20260806 01:03:10.214659 12165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "460550446edc434ab6be280d9dd029fa"
format_stamp: "Formatted at 2026-08-06 01:03:10 on dist-test-slave-69rg"
server_key: "8f09bd12374b6e47da0476fecf73eec7"
server_key_iv: "b1422795e9f9032847aa3f6ac7fca953"
server_key_version: "encryptionkey@0"
I20260806 01:03:10.216269 12165 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 01:03:10.217659 12181 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:10.218264 12165 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:10.218425 12165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "460550446edc434ab6be280d9dd029fa"
format_stamp: "Formatted at 2026-08-06 01:03:10 on dist-test-slave-69rg"
server_key: "8f09bd12374b6e47da0476fecf73eec7"
server_key_iv: "b1422795e9f9032847aa3f6ac7fca953"
server_key_version: "encryptionkey@0"
I20260806 01:03:10.218531 12165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:10.234668 12165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:10.237675 12165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:10.237972 12165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:10.244311 12165 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:36567
I20260806 01:03:10.244415 12234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:36567 every 8 connection(s)
I20260806 01:03:10.244863 12165 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:03:10.245992 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 12165
I20260806 01:03:10.246006 12235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:10.246244 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:03:10.247045 11617 external_mini_cluster.cc:1428] Setting key a52397381d61446df02e5cd4e559c4ed
I20260806 01:03:10.249692 12235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 460550446edc434ab6be280d9dd029fa: Bootstrap starting.
I20260806 01:03:10.250514 12235 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 460550446edc434ab6be280d9dd029fa: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:10.250864 12235 log.cc:824] T 00000000000000000000000000000000 P 460550446edc434ab6be280d9dd029fa: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:10.251735 12235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 460550446edc434ab6be280d9dd029fa: No bootstrap required, opened a new log
I20260806 01:03:10.254549 12235 raft_consensus.cc:348] T 00000000000000000000000000000000 P 460550446edc434ab6be280d9dd029fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "460550446edc434ab6be280d9dd029fa" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 36567 } }
I20260806 01:03:10.254796 12235 raft_consensus.cc:374] T 00000000000000000000000000000000 P 460550446edc434ab6be280d9dd029fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:10.254848 12235 raft_consensus.cc:729] T 00000000000000000000000000000000 P 460550446edc434ab6be280d9dd029fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 460550446edc434ab6be280d9dd029fa, State: Initialized, Role: FOLLOWER
I20260806 01:03:10.255019 12235 consensus_queue.cc:260] T 00000000000000000000000000000000 P 460550446edc434ab6be280d9dd029fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "460550446edc434ab6be280d9dd029fa" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 36567 } }
I20260806 01:03:10.255105 12235 raft_consensus.cc:388] T 00000000000000000000000000000000 P 460550446edc434ab6be280d9dd029fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:03:10.255131 12235 raft_consensus.cc:482] T 00000000000000000000000000000000 P 460550446edc434ab6be280d9dd029fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:03:10.255159 12235 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 460550446edc434ab6be280d9dd029fa [term 0 FOLLOWER]: Advancing to term 1
Aug 06 01:03:10 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:10.255894 12235 raft_consensus.cc:504] T 00000000000000000000000000000000 P 460550446edc434ab6be280d9dd029fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "460550446edc434ab6be280d9dd029fa" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 36567 } }
I20260806 01:03:10.255995 12235 leader_election.cc:302] T 00000000000000000000000000000000 P 460550446edc434ab6be280d9dd029fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 460550446edc434ab6be280d9dd029fa; no voters:
I20260806 01:03:10.256235 12235 leader_election.cc:288] T 00000000000000000000000000000000 P 460550446edc434ab6be280d9dd029fa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:03:10.256361 12241 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 460550446edc434ab6be280d9dd029fa [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:10.256549 12241 raft_consensus.cc:686] T 00000000000000000000000000000000 P 460550446edc434ab6be280d9dd029fa [term 1 LEADER]: Becoming Leader. State: Replica: 460550446edc434ab6be280d9dd029fa, State: Running, Role: LEADER
I20260806 01:03:10.256595 12235 sys_catalog.cc:564] T 00000000000000000000000000000000 P 460550446edc434ab6be280d9dd029fa [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:03:10.256690 12241 consensus_queue.cc:237] T 00000000000000000000000000000000 P 460550446edc434ab6be280d9dd029fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "460550446edc434ab6be280d9dd029fa" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 36567 } }
I20260806 01:03:10.257942 12243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 460550446edc434ab6be280d9dd029fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "460550446edc434ab6be280d9dd029fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "460550446edc434ab6be280d9dd029fa" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 36567 } } }
I20260806 01:03:10.258061 12243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 460550446edc434ab6be280d9dd029fa [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:10.258314 12250 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:03:10.258514 12242 sys_catalog.cc:455] T 00000000000000000000000000000000 P 460550446edc434ab6be280d9dd029fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 460550446edc434ab6be280d9dd029fa. Latest consensus state: current_term: 1 leader_uuid: "460550446edc434ab6be280d9dd029fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "460550446edc434ab6be280d9dd029fa" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 36567 } } }
I20260806 01:03:10.258617 12242 sys_catalog.cc:458] T 00000000000000000000000000000000 P 460550446edc434ab6be280d9dd029fa [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:10.258878 12250 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:03:10.261462 12250 catalog_manager.cc:1347] Generated new cluster ID: 57dbd3db09f3483c85643024c4a98f2e
I20260806 01:03:10.261520 12250 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:03:10.262039 12238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:10.247874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54718 (local address 127.11.88.126:36567)
0806 01:03:10.248102 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:10.248113 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:10.248151 (+ 38us) server_negotiation.cc:407] Connection header received
0806 01:03:10.248717 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:10.248726 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:10.248805 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:10.248968 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:10.249626 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:10.251097 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:10.252191 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:10.252633 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:10.252753 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:10.256082 (+ 3329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:10.256087 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:10.256087 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:10.256102 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:10.259011 (+ 2909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:10.259526 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:10.259530 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:10.259531 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:10.259662 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:10.259973 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:10.259974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:10.259975 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:10.260771 (+ 796us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:10.260964 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:10.261434 (+ 470us) server_negotiation.cc:299] Negotiation successful
0806 01:03:10.261803 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":105,"threads_started":1}
I20260806 01:03:10.270924 12250 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:03:10.271732 12250 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:03:10.278793 12250 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 460550446edc434ab6be280d9dd029fa: Generated new TSK 0
I20260806 01:03:10.279527 12250 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.88.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
I20260806 01:03:10.339892 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:0
--local_ip_for_outbound_sockets=127.11.88.65
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:36567
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:42333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:10.447538 12262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:10.448400 12262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:10.448449 12262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:10.450464 12262 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:10.450534 12262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:10.450572 12262 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:03:10.452572 12262 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:42333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:36567
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12262
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:10.452891 12262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:10.453194 12262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:10.460599 12268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:10.460588 12267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:10.460615 12262 server_base.cc:1034] running on GCE node
W20260806 01:03:10.460587 12270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:10.461663 12262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:10.462055 12262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:10.463778 12262 hybrid_clock.cc:648] HybridClock initialized: now 1785978190463741 us; error 47 us; skew 500 ppm
Aug 06 01:03:10 dist-test-slave-69rg krb5kdc[12152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978190, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:10.469223 12262 init.cc:377] Logged in from keytab as kudu/127.11.88.65@KRBTEST.COM (short username kudu)
I20260806 01:03:10.469995 12262 webserver.cc:460] Webserver started at http://127.11.88.65:39481/ using document root <none> and password file <none>
I20260806 01:03:10.470386 12262 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:10.470465 12262 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:10.470634 12262 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:10.471819 12262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-0/data/instance:
uuid: "45f4ea064b3d4fa8a07756ab20cab049"
format_stamp: "Formatted at 2026-08-06 01:03:10 on dist-test-slave-69rg"
server_key: "9d010041ac9ac30416f7233545f8e56d"
server_key_iv: "3d6e003c498c014cf158ea2f91eef36c"
server_key_version: "encryptionkey@0"
I20260806 01:03:10.472309 12262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance:
uuid: "45f4ea064b3d4fa8a07756ab20cab049"
format_stamp: "Formatted at 2026-08-06 01:03:10 on dist-test-slave-69rg"
server_key: "9d010041ac9ac30416f7233545f8e56d"
server_key_iv: "3d6e003c498c014cf158ea2f91eef36c"
server_key_version: "encryptionkey@0"
I20260806 01:03:10.474115 12262 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260806 01:03:10.475339 12277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:10.475746 12262 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:10.475972 12262 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "45f4ea064b3d4fa8a07756ab20cab049"
format_stamp: "Formatted at 2026-08-06 01:03:10 on dist-test-slave-69rg"
server_key: "9d010041ac9ac30416f7233545f8e56d"
server_key_iv: "3d6e003c498c014cf158ea2f91eef36c"
server_key_version: "encryptionkey@0"
I20260806 01:03:10.476071 12262 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:10.495519 12262 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:10.498377 12262 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:10.498569 12262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:10.498857 12262 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:10.499214 12262 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:10.499271 12262 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:10.499310 12262 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:10.499342 12262 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:10.509254 12262 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:39161
I20260806 01:03:10.509373 12392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:39161 every 8 connection(s)
I20260806 01:03:10.510236 12262 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
Aug 06 01:03:10 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978190, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:10.518855 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 12262
I20260806 01:03:10.518987 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance
I20260806 01:03:10.519171 11617 external_mini_cluster.cc:1428] Setting key b72b2a6b86b0e92e3cdd091f6fd2cf47
I20260806 01:03:10.524718 12238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:10.511323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:50181 (local address 127.11.88.126:36567)
0806 01:03:10.511387 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:10.511390 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:10.511677 (+ 287us) server_negotiation.cc:407] Connection header received
0806 01:03:10.512872 (+ 1195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:10.512874 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:10.512888 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:10.512954 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:10.514006 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:10.514548 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:10.515706 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:10.515946 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:10.516015 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:10.519377 (+ 3362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:10.519380 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:10.519380 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:10.519397 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:10.522832 (+ 3435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:10.523559 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:10.523561 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:10.523561 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:10.523635 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:10.523944 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:10.523945 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:10.523945 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:10.524081 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:10.524159 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:10.524491 (+ 332us) server_negotiation.cc:299] Negotiation successful
0806 01:03:10.524608 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 01:03:10.524933 12395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:10.511133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:36567 (local address 127.11.88.65:50181)
0806 01:03:10.511362 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:10.511523 (+ 161us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:10.512703 (+ 1180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:10.513015 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:10.513019 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:10.513326 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:10.513710 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:10.513716 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:10.514688 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:10.514689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:10.515558 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:10.515560 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:10.516214 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:10.516217 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:10.516353 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:10.516965 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:10.516975 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:10.519266 (+ 2291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:10.522943 (+ 3677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:10.522961 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:10.522964 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:10.523439 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:10.523710 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:10.523711 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:10.523712 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:10.523860 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:10.524159 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:10.524169 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:10.524341 (+ 172us) client_negotiation.cc:769] Sending connection context
0806 01:03:10.524456 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 01:03:10.524652 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":85,"threads_started":1}
I20260806 01:03:10.525924 12393 heartbeater.cc:347] Connected to a master server at 127.11.88.126:36567
I20260806 01:03:10.526054 12393 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:10.526264 12393 heartbeater.cc:511] Master 127.11.88.126:36567 requested a full tablet report, sending...
I20260806 01:03:10.527524 12198 ts_manager.cc:194] Registered new tserver with Master: 45f4ea064b3d4fa8a07756ab20cab049 (127.11.88.65:39161)
I20260806 01:03:10.528964 12198 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.65@KRBTEST.COM'} at 127.11.88.65:50181
WARNING: no policy specified for kudu/127.11.88.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
I20260806 01:03:10.578672 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:0
--local_ip_for_outbound_sockets=127.11.88.66
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:36567
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:42333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:10.690740 12398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:10.691016 12398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:10.691046 12398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:10.693704 12398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:10.693847 12398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:10.693890 12398 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:03:10.696055 12398 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:42333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:36567
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:10.696521 12398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:10.696800 12398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:10.703438 12404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:10.703712 12406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:10.703608 12398 server_base.cc:1034] running on GCE node
W20260806 01:03:10.704504 12403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:10.705201 12398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:10.705519 12398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:10.706709 12398 hybrid_clock.cc:648] HybridClock initialized: now 1785978190706682 us; error 39 us; skew 500 ppm
Aug 06 01:03:10 dist-test-slave-69rg krb5kdc[12152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978190, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:10.709683 12398 init.cc:377] Logged in from keytab as kudu/127.11.88.66@KRBTEST.COM (short username kudu)
I20260806 01:03:10.710248 12398 webserver.cc:460] Webserver started at http://127.11.88.66:37881/ using document root <none> and password file <none>
I20260806 01:03:10.710498 12398 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:10.710551 12398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:10.710685 12398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:10.711839 12398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-1/data/instance:
uuid: "c5ccb88943d743dabebdccb85cdd7b2d"
format_stamp: "Formatted at 2026-08-06 01:03:10 on dist-test-slave-69rg"
server_key: "b12db53c6873fa0c4a5798abf098a799"
server_key_iv: "8bec1e7aab90cbe1b7ccdfdf726aa3b0"
server_key_version: "encryptionkey@0"
I20260806 01:03:10.712414 12398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance:
uuid: "c5ccb88943d743dabebdccb85cdd7b2d"
format_stamp: "Formatted at 2026-08-06 01:03:10 on dist-test-slave-69rg"
server_key: "b12db53c6873fa0c4a5798abf098a799"
server_key_iv: "8bec1e7aab90cbe1b7ccdfdf726aa3b0"
server_key_version: "encryptionkey@0"
I20260806 01:03:10.714294 12398 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260806 01:03:10.715531 12413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:10.716035 12398 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:10.716149 12398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "c5ccb88943d743dabebdccb85cdd7b2d"
format_stamp: "Formatted at 2026-08-06 01:03:10 on dist-test-slave-69rg"
server_key: "b12db53c6873fa0c4a5798abf098a799"
server_key_iv: "8bec1e7aab90cbe1b7ccdfdf726aa3b0"
server_key_version: "encryptionkey@0"
I20260806 01:03:10.716287 12398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:10.730969 12398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:10.734416 12398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:10.734561 12398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:10.734905 12398 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:10.735265 12398 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:10.735302 12398 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:10.735348 12398 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:10.735383 12398 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:10.744436 12398 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:33903
I20260806 01:03:10.744475 12531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:33903 every 8 connection(s)
I20260806 01:03:10.744905 12398 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
I20260806 01:03:10.748201 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 12398
I20260806 01:03:10.748320 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance
I20260806 01:03:10.748536 11617 external_mini_cluster.cc:1428] Setting key 9b079f164259d026607db281dab28db3
Aug 06 01:03:10 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978190, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.88.67@KRBTEST.COM; defaulting to no policy
I20260806 01:03:10.759827 12238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:10.746013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:34715 (local address 127.11.88.126:36567)
0806 01:03:10.746099 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:10.746101 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:10.746363 (+ 262us) server_negotiation.cc:407] Connection header received
0806 01:03:10.747300 (+ 937us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:10.747301 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:10.747314 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:10.747398 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:10.748494 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:10.749427 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:10.751354 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:10.751712 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:10.751810 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:10.754942 (+ 3132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:10.754945 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:10.754945 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:10.754956 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:10.757139 (+ 2183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:10.757961 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:10.757963 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:10.757963 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:10.758061 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:10.758896 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:10.758898 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:10.758898 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:10.759058 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:10.759153 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:10.759536 (+ 383us) server_negotiation.cc:299] Negotiation successful
0806 01:03:10.759697 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 01:03:10.760018 12534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:10.745970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:36567 (local address 127.11.88.66:34715)
0806 01:03:10.746144 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:10.746198 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:10.747154 (+ 956us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:10.747524 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:10.747528 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:10.747920 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:10.748283 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:10.748291 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:10.749542 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:10.749543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:10.751209 (+ 1666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:10.751213 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:10.751846 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:10.751847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:10.751979 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:10.752730 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:10.752739 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:10.754810 (+ 2071us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:10.757287 (+ 2477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:10.757300 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:10.757302 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:10.757864 (+ 562us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:10.758466 (+ 602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:10.758467 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:10.758467 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:10.758773 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:10.759142 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:10.759152 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:10.759372 (+ 220us) client_negotiation.cc:769] Sending connection context
0806 01:03:10.759497 (+ 125us) client_negotiation.cc:240] Negotiation successful
0806 01:03:10.759722 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":94,"threads_started":1}
I20260806 01:03:10.760836 12532 heartbeater.cc:347] Connected to a master server at 127.11.88.126:36567
I20260806 01:03:10.760964 12532 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:10.761137 12532 heartbeater.cc:511] Master 127.11.88.126:36567 requested a full tablet report, sending...
I20260806 01:03:10.761683 12198 ts_manager.cc:194] Registered new tserver with Master: c5ccb88943d743dabebdccb85cdd7b2d (127.11.88.66:33903)
I20260806 01:03:10.762188 12198 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.66@KRBTEST.COM'} at 127.11.88.66:34715
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
I20260806 01:03:10.797791 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:0
--local_ip_for_outbound_sockets=127.11.88.67
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:36567
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:42333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:10.907311 12537 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:10.907552 12537 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:10.907581 12537 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:10.908809 12537 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:10.908857 12537 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:10.908886 12537 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:03:10.910511 12537 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:42333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:36567
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12537
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:10.910882 12537 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:10.911128 12537 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 01:03:10.917491 12537 server_base.cc:1034] running on GCE node
W20260806 01:03:10.917547 12542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:10.917307 12543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:10.917307 12545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:10.918006 12537 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:10.918277 12537 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:10.919450 12537 hybrid_clock.cc:648] HybridClock initialized: now 1785978190919433 us; error 29 us; skew 500 ppm
Aug 06 01:03:10 dist-test-slave-69rg krb5kdc[12152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978190, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:10.924096 12537 init.cc:377] Logged in from keytab as kudu/127.11.88.67@KRBTEST.COM (short username kudu)
I20260806 01:03:10.924899 12537 webserver.cc:460] Webserver started at http://127.11.88.67:45573/ using document root <none> and password file <none>
I20260806 01:03:10.925158 12537 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:10.925230 12537 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:10.925393 12537 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:10.926615 12537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-2/data/instance:
uuid: "f7d54a2b540e43058875fe3d49d8ac0b"
format_stamp: "Formatted at 2026-08-06 01:03:10 on dist-test-slave-69rg"
server_key: "d6ea00326331b4b4f999e943c8feda46"
server_key_iv: "3b0d6ea4a82705e6ad43d62e45940a30"
server_key_version: "encryptionkey@0"
I20260806 01:03:10.926997 12537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance:
uuid: "f7d54a2b540e43058875fe3d49d8ac0b"
format_stamp: "Formatted at 2026-08-06 01:03:10 on dist-test-slave-69rg"
server_key: "d6ea00326331b4b4f999e943c8feda46"
server_key_iv: "3b0d6ea4a82705e6ad43d62e45940a30"
server_key_version: "encryptionkey@0"
I20260806 01:03:10.928503 12537 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 01:03:10.929515 12552 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:10.929889 12537 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:10.930015 12537 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "f7d54a2b540e43058875fe3d49d8ac0b"
format_stamp: "Formatted at 2026-08-06 01:03:10 on dist-test-slave-69rg"
server_key: "d6ea00326331b4b4f999e943c8feda46"
server_key_iv: "3b0d6ea4a82705e6ad43d62e45940a30"
server_key_version: "encryptionkey@0"
I20260806 01:03:10.930095 12537 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:10.953176 12537 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:10.955735 12537 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:10.955935 12537 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:10.956218 12537 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:10.956645 12537 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:10.956701 12537 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:10.956739 12537 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:10.956766 12537 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:10.964242 12537 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:42203
I20260806 01:03:10.964293 12666 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:42203 every 8 connection(s)
I20260806 01:03:10.964658 12537 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
I20260806 01:03:10.966388 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 12537
I20260806 01:03:10.966531 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance
I20260806 01:03:10.966737 11617 external_mini_cluster.cc:1428] Setting key fcc02a18491b9e9ed3b3c369e2d4f06c
Aug 06 01:03:10 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978190, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:10.975351 12238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:10.965552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:44335 (local address 127.11.88.126:36567)
0806 01:03:10.965633 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:10.965636 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:10.965859 (+ 223us) server_negotiation.cc:407] Connection header received
0806 01:03:10.966974 (+ 1115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:10.966976 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:10.966990 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:10.967061 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:10.967860 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:10.968356 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:10.969368 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:10.969550 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:10.969606 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:10.971946 (+ 2340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:10.971947 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:10.971948 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:10.971955 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:10.973631 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:10.974132 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:10.974133 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:10.974133 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:10.974229 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:10.974530 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:10.974531 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:10.974531 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:10.974664 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:10.974731 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:10.975111 (+ 380us) server_negotiation.cc:299] Negotiation successful
0806 01:03:10.975246 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 01:03:10.975387 12669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:10.965486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:36567 (local address 127.11.88.67:44335)
0806 01:03:10.965688 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:10.965729 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:10.966850 (+ 1121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:10.967128 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:10.967131 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:10.967521 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:10.967792 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:10.967803 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:10.968439 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:10.968440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:10.969289 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:10.969291 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:10.969652 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:10.969652 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:10.969759 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:10.970318 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:10.970327 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:10.971825 (+ 1498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:10.973732 (+ 1907us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:10.973739 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:10.973741 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:10.974054 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:10.974309 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:10.974310 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:10.974310 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:10.974420 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:10.974759 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:10.974767 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:10.974903 (+ 136us) client_negotiation.cc:769] Sending connection context
0806 01:03:10.974997 (+ 94us) client_negotiation.cc:240] Negotiation successful
0806 01:03:10.975175 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":97,"threads_started":1}
I20260806 01:03:10.976099 12667 heartbeater.cc:347] Connected to a master server at 127.11.88.126:36567
I20260806 01:03:10.976222 12667 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:10.976452 12667 heartbeater.cc:511] Master 127.11.88.126:36567 requested a full tablet report, sending...
I20260806 01:03:10.976868 12198 ts_manager.cc:194] Registered new tserver with Master: f7d54a2b540e43058875fe3d49d8ac0b (127.11.88.67:42203)
I20260806 01:03:10.977260 12198 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.67@KRBTEST.COM'} at 127.11.88.67:44335
I20260806 01:03:10.978822 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 01:03:10.988119 12238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:10.980660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54724 (local address 127.11.88.126:36567)
0806 01:03:10.980742 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:10.980745 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:10.980848 (+ 103us) server_negotiation.cc:407] Connection header received
0806 01:03:10.980929 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:10.980930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:10.980940 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:10.981011 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:10.981596 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:10.982236 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:10.982992 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:10.983195 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:10.983273 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:10.984884 (+ 1611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:10.984886 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:10.984887 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:10.984895 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:10.986580 (+ 1685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:10.987164 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:10.987165 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:10.987166 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:10.987244 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:10.987462 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:10.987463 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:10.987464 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:10.987654 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:10.987776 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:10.987909 (+ 133us) server_negotiation.cc:299] Negotiation successful
0806 01:03:10.987998 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 01:03:10.991679 12198 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54724:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 01:03:10.993484 12198 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:03:11.001271 12678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:10.996567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:39161 (local address 127.0.0.1:47878)
0806 01:03:10.996953 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:10.997000 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:10.997084 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:10.997453 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:10.997456 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:10.997459 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:10.997555 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:10.997576 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:10.998744 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:10.998745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:11.000179 (+ 1434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:11.000182 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:11.000954 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:11.000955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:11.001039 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:11.001054 (+ 15us) client_negotiation.cc:769] Sending connection context
0806 01:03:11.001119 (+ 65us) client_negotiation.cc:240] Negotiation successful
0806 01:03:11.001181 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":96,"threads_started":1}
I20260806 01:03:11.001286 12679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:10.996772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47878 (local address 127.11.88.65:39161)
0806 01:03:10.996909 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:10.996915 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:10.997184 (+ 269us) server_negotiation.cc:407] Connection header received
0806 01:03:10.997242 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:10.997245 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:10.997264 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:10.997340 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:10.997770 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:10.998627 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:11.000303 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:11.000857 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:11.000952 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:11.001019 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:11.001145 (+ 126us) server_negotiation.cc:299] Negotiation successful
0806 01:03:11.001186 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":71,"threads_started":1}
I20260806 01:03:11.001628 12683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:10.997130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56410 (local address 127.11.88.66:33903)
0806 01:03:10.997403 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:10.997407 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:10.997762 (+ 355us) server_negotiation.cc:407] Connection header received
0806 01:03:10.997809 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:10.997837 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:10.997853 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:10.997930 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:10.998090 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:10.999112 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:11.000288 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:11.001178 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:11.001259 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:11.001318 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:11.001509 (+ 191us) server_negotiation.cc:299] Negotiation successful
0806 01:03:11.001557 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":168,"threads_started":1}
I20260806 01:03:11.001591 12680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:10.996802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:42203 (local address 127.0.0.1:47588)
0806 01:03:10.997109 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:10.997120 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:10.997174 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:10.997580 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:10.997581 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:10.997583 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:10.997653 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:10.997655 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:10.999089 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:10.999090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:11.000319 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:11.000322 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:11.001290 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:11.001291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:11.001394 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:11.001399 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 01:03:11.001436 (+ 37us) client_negotiation.cc:240] Negotiation successful
0806 01:03:11.001489 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":88,"threads_started":1}
I20260806 01:03:11.001992 12681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:10.996922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47588 (local address 127.11.88.67:42203)
0806 01:03:10.997280 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:10.997284 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:10.997291 (+ 7us) server_negotiation.cc:407] Connection header received
0806 01:03:10.997355 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:10.997357 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:10.997375 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:10.997508 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:10.997738 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:10.998959 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:11.000398 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:11.001180 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:11.001682 (+ 502us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:11.001759 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:11.001787 (+ 28us) server_negotiation.cc:299] Negotiation successful
0806 01:03:11.001866 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":102,"threads_started":1}
I20260806 01:03:11.001595 12682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:10.996982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:33903 (local address 127.0.0.1:56410)
0806 01:03:10.997635 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:10.997646 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:10.997701 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:10.997933 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:10.997934 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:10.997936 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:10.997990 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:10.997991 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:10.999222 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:10.999223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:11.000181 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:11.000184 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:11.001346 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:11.001347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:11.001431 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:11.001435 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:03:11.001482 (+ 47us) client_negotiation.cc:240] Negotiation successful
0806 01:03:11.001514 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":632,"thread_start_us":61,"threads_started":1}
I20260806 01:03:11.003032 12461 tablet_service.cc:1467] Processing CreateTablet for tablet bb82a1f5639d45baa04c916e4490f269 (DEFAULT_TABLE table=test-table [id=b5f61f47d31f484284422b6794d5b368]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:11.003011 12326 tablet_service.cc:1467] Processing CreateTablet for tablet bb82a1f5639d45baa04c916e4490f269 (DEFAULT_TABLE table=test-table [id=b5f61f47d31f484284422b6794d5b368]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:11.003510 12461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb82a1f5639d45baa04c916e4490f269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:11.003539 12326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb82a1f5639d45baa04c916e4490f269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:11.006340 12600 tablet_service.cc:1467] Processing CreateTablet for tablet bb82a1f5639d45baa04c916e4490f269 (DEFAULT_TABLE table=test-table [id=b5f61f47d31f484284422b6794d5b368]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:11.006772 12600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb82a1f5639d45baa04c916e4490f269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:11.009644 12684 tablet_bootstrap.cc:492] T bb82a1f5639d45baa04c916e4490f269 P 45f4ea064b3d4fa8a07756ab20cab049: Bootstrap starting.
I20260806 01:03:11.009944 12685 tablet_bootstrap.cc:492] T bb82a1f5639d45baa04c916e4490f269 P c5ccb88943d743dabebdccb85cdd7b2d: Bootstrap starting.
I20260806 01:03:11.010403 12686 tablet_bootstrap.cc:492] T bb82a1f5639d45baa04c916e4490f269 P f7d54a2b540e43058875fe3d49d8ac0b: Bootstrap starting.
I20260806 01:03:11.010845 12685 tablet_bootstrap.cc:654] T bb82a1f5639d45baa04c916e4490f269 P c5ccb88943d743dabebdccb85cdd7b2d: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:11.011718 12686 tablet_bootstrap.cc:654] T bb82a1f5639d45baa04c916e4490f269 P f7d54a2b540e43058875fe3d49d8ac0b: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:11.012084 12685 log.cc:824] T bb82a1f5639d45baa04c916e4490f269 P c5ccb88943d743dabebdccb85cdd7b2d: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:11.012764 12686 log.cc:824] T bb82a1f5639d45baa04c916e4490f269 P f7d54a2b540e43058875fe3d49d8ac0b: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:11.013273 12685 tablet_bootstrap.cc:492] T bb82a1f5639d45baa04c916e4490f269 P c5ccb88943d743dabebdccb85cdd7b2d: No bootstrap required, opened a new log
I20260806 01:03:11.013355 12685 ts_tablet_manager.cc:1397] T bb82a1f5639d45baa04c916e4490f269 P c5ccb88943d743dabebdccb85cdd7b2d: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260806 01:03:11.013698 12684 tablet_bootstrap.cc:654] T bb82a1f5639d45baa04c916e4490f269 P 45f4ea064b3d4fa8a07756ab20cab049: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:11.013797 12686 tablet_bootstrap.cc:492] T bb82a1f5639d45baa04c916e4490f269 P f7d54a2b540e43058875fe3d49d8ac0b: No bootstrap required, opened a new log
I20260806 01:03:11.013931 12686 ts_tablet_manager.cc:1397] T bb82a1f5639d45baa04c916e4490f269 P f7d54a2b540e43058875fe3d49d8ac0b: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260806 01:03:11.015378 12684 log.cc:824] T bb82a1f5639d45baa04c916e4490f269 P 45f4ea064b3d4fa8a07756ab20cab049: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:11.015869 12685 raft_consensus.cc:348] T bb82a1f5639d45baa04c916e4490f269 P c5ccb88943d743dabebdccb85cdd7b2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f4ea064b3d4fa8a07756ab20cab049" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 39161 } } peers { permanent_uuid: "f7d54a2b540e43058875fe3d49d8ac0b" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42203 } } peers { permanent_uuid: "c5ccb88943d743dabebdccb85cdd7b2d" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 33903 } }
I20260806 01:03:11.016162 12685 raft_consensus.cc:374] T bb82a1f5639d45baa04c916e4490f269 P c5ccb88943d743dabebdccb85cdd7b2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:11.016222 12685 raft_consensus.cc:729] T bb82a1f5639d45baa04c916e4490f269 P c5ccb88943d743dabebdccb85cdd7b2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ccb88943d743dabebdccb85cdd7b2d, State: Initialized, Role: FOLLOWER
I20260806 01:03:11.016433 12685 consensus_queue.cc:260] T bb82a1f5639d45baa04c916e4490f269 P c5ccb88943d743dabebdccb85cdd7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f4ea064b3d4fa8a07756ab20cab049" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 39161 } } peers { permanent_uuid: "f7d54a2b540e43058875fe3d49d8ac0b" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42203 } } peers { permanent_uuid: "c5ccb88943d743dabebdccb85cdd7b2d" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 33903 } }
I20260806 01:03:11.016820 12685 ts_tablet_manager.cc:1428] T bb82a1f5639d45baa04c916e4490f269 P c5ccb88943d743dabebdccb85cdd7b2d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 01:03:11.016970 12532 heartbeater.cc:503] Master 127.11.88.126:36567 was elected leader, sending a full tablet report...
I20260806 01:03:11.016986 12684 tablet_bootstrap.cc:492] T bb82a1f5639d45baa04c916e4490f269 P 45f4ea064b3d4fa8a07756ab20cab049: No bootstrap required, opened a new log
I20260806 01:03:11.017146 12684 ts_tablet_manager.cc:1397] T bb82a1f5639d45baa04c916e4490f269 P 45f4ea064b3d4fa8a07756ab20cab049: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.004s
I20260806 01:03:11.018803 12686 raft_consensus.cc:348] T bb82a1f5639d45baa04c916e4490f269 P f7d54a2b540e43058875fe3d49d8ac0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f4ea064b3d4fa8a07756ab20cab049" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 39161 } } peers { permanent_uuid: "f7d54a2b540e43058875fe3d49d8ac0b" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42203 } } peers { permanent_uuid: "c5ccb88943d743dabebdccb85cdd7b2d" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 33903 } }
I20260806 01:03:11.019101 12686 raft_consensus.cc:374] T bb82a1f5639d45baa04c916e4490f269 P f7d54a2b540e43058875fe3d49d8ac0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:11.019166 12686 raft_consensus.cc:729] T bb82a1f5639d45baa04c916e4490f269 P f7d54a2b540e43058875fe3d49d8ac0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d54a2b540e43058875fe3d49d8ac0b, State: Initialized, Role: FOLLOWER
I20260806 01:03:11.019330 12686 consensus_queue.cc:260] T bb82a1f5639d45baa04c916e4490f269 P f7d54a2b540e43058875fe3d49d8ac0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f4ea064b3d4fa8a07756ab20cab049" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 39161 } } peers { permanent_uuid: "f7d54a2b540e43058875fe3d49d8ac0b" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42203 } } peers { permanent_uuid: "c5ccb88943d743dabebdccb85cdd7b2d" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 33903 } }
I20260806 01:03:11.019764 12667 heartbeater.cc:503] Master 127.11.88.126:36567 was elected leader, sending a full tablet report...
I20260806 01:03:11.019743 12686 ts_tablet_manager.cc:1428] T bb82a1f5639d45baa04c916e4490f269 P f7d54a2b540e43058875fe3d49d8ac0b: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20260806 01:03:11.021196 12684 raft_consensus.cc:348] T bb82a1f5639d45baa04c916e4490f269 P 45f4ea064b3d4fa8a07756ab20cab049 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f4ea064b3d4fa8a07756ab20cab049" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 39161 } } peers { permanent_uuid: "f7d54a2b540e43058875fe3d49d8ac0b" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42203 } } peers { permanent_uuid: "c5ccb88943d743dabebdccb85cdd7b2d" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 33903 } }
I20260806 01:03:11.021373 12684 raft_consensus.cc:374] T bb82a1f5639d45baa04c916e4490f269 P 45f4ea064b3d4fa8a07756ab20cab049 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:11.021418 12684 raft_consensus.cc:729] T bb82a1f5639d45baa04c916e4490f269 P 45f4ea064b3d4fa8a07756ab20cab049 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f4ea064b3d4fa8a07756ab20cab049, State: Initialized, Role: FOLLOWER
I20260806 01:03:11.021562 12684 consensus_queue.cc:260] T bb82a1f5639d45baa04c916e4490f269 P 45f4ea064b3d4fa8a07756ab20cab049 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f4ea064b3d4fa8a07756ab20cab049" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 39161 } } peers { permanent_uuid: "f7d54a2b540e43058875fe3d49d8ac0b" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42203 } } peers { permanent_uuid: "c5ccb88943d743dabebdccb85cdd7b2d" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 33903 } }
I20260806 01:03:11.022064 12393 heartbeater.cc:503] Master 127.11.88.126:36567 was elected leader, sending a full tablet report...
I20260806 01:03:11.022035 12684 ts_tablet_manager.cc:1428] T bb82a1f5639d45baa04c916e4490f269 P 45f4ea064b3d4fa8a07756ab20cab049: Time spent starting tablet: real 0.005s user 0.000s sys 0.005s
I20260806 01:03:11.143522 12691 raft_consensus.cc:482] T bb82a1f5639d45baa04c916e4490f269 P f7d54a2b540e43058875fe3d49d8ac0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:03:11.143703 12691 raft_consensus.cc:504] T bb82a1f5639d45baa04c916e4490f269 P f7d54a2b540e43058875fe3d49d8ac0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f4ea064b3d4fa8a07756ab20cab049" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 39161 } } peers { permanent_uuid: "f7d54a2b540e43058875fe3d49d8ac0b" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42203 } } peers { permanent_uuid: "c5ccb88943d743dabebdccb85cdd7b2d" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 33903 } }
I20260806 01:03:11.144214 12691 leader_election.cc:288] T bb82a1f5639d45baa04c916e4490f269 P f7d54a2b540e43058875fe3d49d8ac0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f4ea064b3d4fa8a07756ab20cab049 (127.11.88.65:39161), c5ccb88943d743dabebdccb85cdd7b2d (127.11.88.66:33903)
I20260806 01:03:11.148171 12669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:11.144501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:39161 (local address 127.11.88.67:60447)
0806 01:03:11.144567 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:11.144581 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:11.144631 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:11.145031 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:11.145032 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:11.145035 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:11.145135 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:11.145136 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:11.146217 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:11.146219 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:11.147196 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:11.147199 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:11.147832 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:11.147833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:11.147951 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:11.147954 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:03:11.148026 (+ 72us) client_negotiation.cc:240] Negotiation successful
0806 01:03:11.148077 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260806 01:03:11.148171 12679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:11.144679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:60447 (local address 127.11.88.65:39161)
0806 01:03:11.144739 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:11.144742 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:11.144754 (+ 12us) server_negotiation.cc:407] Connection header received
0806 01:03:11.144791 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:11.144792 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:11.144802 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:11.145013 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:11.145481 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:11.146105 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:11.147305 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:11.147732 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:11.147834 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:11.147845 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:11.148051 (+ 206us) server_negotiation.cc:299] Negotiation successful
0806 01:03:11.148099 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260806 01:03:11.148816 12693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:11.144640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:33903 (local address 127.11.88.67:60373)
0806 01:03:11.145027 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:11.145039 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:11.145107 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:11.145242 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:11.145242 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:11.145244 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:11.145337 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:11.145339 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:11.146258 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:11.146260 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:11.147502 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:11.147506 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:11.148396 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:11.148399 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:11.148588 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:11.148599 (+ 11us) client_negotiation.cc:769] Sending connection context
0806 01:03:11.148673 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 01:03:11.148718 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":211,"threads_started":1}
I20260806 01:03:11.148772 12347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb82a1f5639d45baa04c916e4490f269" candidate_uuid: "f7d54a2b540e43058875fe3d49d8ac0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f4ea064b3d4fa8a07756ab20cab049" is_pre_election: true
I20260806 01:03:11.148876 12683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:11.144765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:60373 (local address 127.11.88.66:33903)
0806 01:03:11.144845 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:11.144848 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:11.145116 (+ 268us) server_negotiation.cc:407] Connection header received
0806 01:03:11.145171 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:11.145173 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:11.145183 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:11.145233 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:11.145413 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:11.146106 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:11.147615 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:11.148078 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:11.148171 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:11.148182 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:11.148743 (+ 561us) server_negotiation.cc:299] Negotiation successful
0806 01:03:11.148795 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 01:03:11.148998 12347 raft_consensus.cc:2454] T bb82a1f5639d45baa04c916e4490f269 P 45f4ea064b3d4fa8a07756ab20cab049 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d54a2b540e43058875fe3d49d8ac0b in term 0.
I20260806 01:03:11.149199 12484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb82a1f5639d45baa04c916e4490f269" candidate_uuid: "f7d54a2b540e43058875fe3d49d8ac0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ccb88943d743dabebdccb85cdd7b2d" is_pre_election: true
I20260806 01:03:11.149386 12484 raft_consensus.cc:2454] T bb82a1f5639d45baa04c916e4490f269 P c5ccb88943d743dabebdccb85cdd7b2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d54a2b540e43058875fe3d49d8ac0b in term 0.
I20260806 01:03:11.149473 12554 leader_election.cc:302] T bb82a1f5639d45baa04c916e4490f269 P f7d54a2b540e43058875fe3d49d8ac0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f4ea064b3d4fa8a07756ab20cab049, f7d54a2b540e43058875fe3d49d8ac0b; no voters:
I20260806 01:03:11.149610 12691 raft_consensus.cc:2781] T bb82a1f5639d45baa04c916e4490f269 P f7d54a2b540e43058875fe3d49d8ac0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:03:11.149678 12691 raft_consensus.cc:482] T bb82a1f5639d45baa04c916e4490f269 P f7d54a2b540e43058875fe3d49d8ac0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:03:11.149881 12691 raft_consensus.cc:3037] T bb82a1f5639d45baa04c916e4490f269 P f7d54a2b540e43058875fe3d49d8ac0b [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:11.151170 12691 raft_consensus.cc:504] T bb82a1f5639d45baa04c916e4490f269 P f7d54a2b540e43058875fe3d49d8ac0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f4ea064b3d4fa8a07756ab20cab049" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 39161 } } peers { permanent_uuid: "f7d54a2b540e43058875fe3d49d8ac0b" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42203 } } peers { permanent_uuid: "c5ccb88943d743dabebdccb85cdd7b2d" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 33903 } }
I20260806 01:03:11.151350 12691 leader_election.cc:288] T bb82a1f5639d45baa04c916e4490f269 P f7d54a2b540e43058875fe3d49d8ac0b [CANDIDATE]: Term 1 election: Requested vote from peers 45f4ea064b3d4fa8a07756ab20cab049 (127.11.88.65:39161), c5ccb88943d743dabebdccb85cdd7b2d (127.11.88.66:33903)
I20260806 01:03:11.151626 12347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb82a1f5639d45baa04c916e4490f269" candidate_uuid: "f7d54a2b540e43058875fe3d49d8ac0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f4ea064b3d4fa8a07756ab20cab049"
I20260806 01:03:11.151683 12484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb82a1f5639d45baa04c916e4490f269" candidate_uuid: "f7d54a2b540e43058875fe3d49d8ac0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ccb88943d743dabebdccb85cdd7b2d"
I20260806 01:03:11.151746 12347 raft_consensus.cc:3037] T bb82a1f5639d45baa04c916e4490f269 P 45f4ea064b3d4fa8a07756ab20cab049 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:11.151765 12484 raft_consensus.cc:3037] T bb82a1f5639d45baa04c916e4490f269 P c5ccb88943d743dabebdccb85cdd7b2d [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:11.153098 12347 raft_consensus.cc:2454] T bb82a1f5639d45baa04c916e4490f269 P 45f4ea064b3d4fa8a07756ab20cab049 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d54a2b540e43058875fe3d49d8ac0b in term 1.
I20260806 01:03:11.153097 12484 raft_consensus.cc:2454] T bb82a1f5639d45baa04c916e4490f269 P c5ccb88943d743dabebdccb85cdd7b2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d54a2b540e43058875fe3d49d8ac0b in term 1.
I20260806 01:03:11.153353 12554 leader_election.cc:302] T bb82a1f5639d45baa04c916e4490f269 P f7d54a2b540e43058875fe3d49d8ac0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f4ea064b3d4fa8a07756ab20cab049, f7d54a2b540e43058875fe3d49d8ac0b; no voters:
I20260806 01:03:11.153515 12691 raft_consensus.cc:2781] T bb82a1f5639d45baa04c916e4490f269 P f7d54a2b540e43058875fe3d49d8ac0b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:11.153839 12691 raft_consensus.cc:686] T bb82a1f5639d45baa04c916e4490f269 P f7d54a2b540e43058875fe3d49d8ac0b [term 1 LEADER]: Becoming Leader. State: Replica: f7d54a2b540e43058875fe3d49d8ac0b, State: Running, Role: LEADER
I20260806 01:03:11.153981 12691 consensus_queue.cc:237] T bb82a1f5639d45baa04c916e4490f269 P f7d54a2b540e43058875fe3d49d8ac0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f4ea064b3d4fa8a07756ab20cab049" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 39161 } } peers { permanent_uuid: "f7d54a2b540e43058875fe3d49d8ac0b" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42203 } } peers { permanent_uuid: "c5ccb88943d743dabebdccb85cdd7b2d" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 33903 } }
I20260806 01:03:11.155126 12197 catalog_manager.cc:5495] T bb82a1f5639d45baa04c916e4490f269 P f7d54a2b540e43058875fe3d49d8ac0b reported cstate change: term changed from 0 to 1, leader changed from <none> to f7d54a2b540e43058875fe3d49d8ac0b (127.11.88.67). New cstate: current_term: 1 leader_uuid: "f7d54a2b540e43058875fe3d49d8ac0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f4ea064b3d4fa8a07756ab20cab049" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 39161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7d54a2b540e43058875fe3d49d8ac0b" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ccb88943d743dabebdccb85cdd7b2d" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 33903 } health_report { overall_health: UNKNOWN } } }
Aug 06 01:03:11 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.65@KRBTEST.COM
I20260806 01:03:11.196393 12679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:11.184542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47884 (local address 127.11.88.65:39161)
0806 01:03:11.184626 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:11.184628 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:11.184735 (+ 107us) server_negotiation.cc:407] Connection header received
0806 01:03:11.184771 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:11.184772 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:11.184784 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:11.185059 (+ 275us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:11.186283 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:11.186934 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:11.187793 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:11.187985 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:11.188052 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:11.191876 (+ 3824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:11.191893 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:11.191894 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:11.191903 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:11.194580 (+ 2677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:11.195097 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:11.195103 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:11.195104 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:11.195250 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:11.195576 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:11.195578 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:11.195579 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:11.195798 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:11.195933 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:11.196112 (+ 179us) server_negotiation.cc:299] Negotiation successful
0806 01:03:11.196234 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
Aug 06 01:03:11 dist-test-slave-69rg krb5kdc[12152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978191, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
W20260806 01:03:11.215649 12668 tablet.cc:2369] T bb82a1f5639d45baa04c916e4490f269 P f7d54a2b540e43058875fe3d49d8ac0b: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 06 01:03:11 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978191, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.88.65@KRBTEST.COM
I20260806 01:03:11.227793 12679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:11.217998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47886 (local address 127.11.88.65:39161)
0806 01:03:11.218092 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:11.218094 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:11.218138 (+ 44us) server_negotiation.cc:407] Connection header received
0806 01:03:11.218226 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:11.218227 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:11.218237 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:11.218292 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:11.218944 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:11.219681 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:11.221115 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:11.221373 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:11.221519 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:11.224498 (+ 2979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:11.224500 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:11.224500 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:11.224512 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:11.226496 (+ 1984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:11.226891 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:11.226892 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:11.226893 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:11.226956 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:11.227130 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:11.227131 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:11.227131 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:11.227253 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:11.227341 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:11.227563 (+ 222us) server_negotiation.cc:299] Negotiation successful
0806 01:03:11.227647 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
Aug 06 01:03:11 dist-test-slave-69rg krb5kdc[12152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978191, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
W20260806 01:03:11.246013 12533 tablet.cc:2369] T bb82a1f5639d45baa04c916e4490f269 P c5ccb88943d743dabebdccb85cdd7b2d: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 06 01:03:11 dist-test-slave-69rg krb5kdc[12152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978191, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.65@KRBTEST.COM
I20260806 01:03:11.255121 12679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:11.246144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47900 (local address 127.11.88.65:39161)
0806 01:03:11.246197 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:11.246199 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:11.246578 (+ 379us) server_negotiation.cc:407] Connection header received
0806 01:03:11.246761 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:11.246763 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:11.246776 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:11.246854 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:11.247497 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:11.248004 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:11.248791 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:11.248992 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:11.249071 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:11.251928 (+ 2857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:11.251931 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:11.251931 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:11.251943 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:11.253766 (+ 1823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:11.254259 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:11.254261 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:11.254261 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:11.254327 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:11.254541 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:11.254542 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:11.254542 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:11.254667 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:11.254780 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:11.254920 (+ 140us) server_negotiation.cc:299] Negotiation successful
0806 01:03:11.255010 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
W20260806 01:03:11.255816 12305 tablet_service.cc:2908] Rejecting scan request for tablet bb82a1f5639d45baa04c916e4490f269: Uninitialized: clean time has not yet been initialized
I20260806 01:03:11.257282 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 12262
I20260806 01:03:11.264151 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 12398
I20260806 01:03:11.269987 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 12537
I20260806 01:03:11.275508 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 12165
2026-08-06T01:03:11Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2534 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:03:11 dist-test-slave-69rg krb5kdc[12708](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:03:11 dist-test-slave-69rg krb5kdc[12708](info): set up 2 sockets
Aug 06 01:03:11 dist-test-slave-69rg krb5kdc[12708](info): commencing operation
krb5kdc: starting...
W20260806 01:03:12.423666 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:03:12 dist-test-slave-69rg krb5kdc[12708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978192, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:03:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:03:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:03:12.579668 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:40069
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:38875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:40069
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:12.672983 12721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:12.673224 12721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:12.673249 12721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:12.674597 12721 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:03:12.674654 12721 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 01:03:12.674669 12721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:12.674682 12721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:12.674695 12721 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:03:12.674707 12721 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:03:12.676347 12721 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:38875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:40069
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:40069
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12721
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:12.676636 12721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:12.676895 12721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:12.682732 12727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:12.682723 12729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:12.682723 12726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:12.683326 12721 server_base.cc:1034] running on GCE node
I20260806 01:03:12.683600 12721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:12.683893 12721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:12.685060 12721 hybrid_clock.cc:648] HybridClock initialized: now 1785978192685022 us; error 51 us; skew 500 ppm
Aug 06 01:03:12 dist-test-slave-69rg krb5kdc[12708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978192, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:12.688071 12721 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:03:12.688608 12721 webserver.cc:460] Webserver started at http://127.11.88.126:45403/ using document root <none> and password file <none>
I20260806 01:03:12.688810 12721 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:12.688853 12721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:12.688946 12721 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:12.690099 12721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "029067fea74646a79885cc633f8d982b"
format_stamp: "Formatted at 2026-08-06 01:03:12 on dist-test-slave-69rg"
server_key: "77f5a71fcb2282dcc44e043f701a219c"
server_key_iv: "04bc37d75757aa782132c738c792e7bc"
server_key_version: "encryptionkey@0"
I20260806 01:03:12.690415 12721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "029067fea74646a79885cc633f8d982b"
format_stamp: "Formatted at 2026-08-06 01:03:12 on dist-test-slave-69rg"
server_key: "77f5a71fcb2282dcc44e043f701a219c"
server_key_iv: "04bc37d75757aa782132c738c792e7bc"
server_key_version: "encryptionkey@0"
I20260806 01:03:12.691850 12721 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 01:03:12.692665 12736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:12.692871 12721 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:12.692963 12721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "029067fea74646a79885cc633f8d982b"
format_stamp: "Formatted at 2026-08-06 01:03:12 on dist-test-slave-69rg"
server_key: "77f5a71fcb2282dcc44e043f701a219c"
server_key_iv: "04bc37d75757aa782132c738c792e7bc"
server_key_version: "encryptionkey@0"
I20260806 01:03:12.693027 12721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:12.716174 12721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:12.718690 12721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:12.718847 12721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:12.725140 12721 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:40069
I20260806 01:03:12.725278 12799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:40069 every 8 connection(s)
I20260806 01:03:12.725708 12721 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:03:12.726758 12800 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:12.726737 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 12721
I20260806 01:03:12.726855 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:03:12.727066 11617 external_mini_cluster.cc:1428] Setting key 5ddf8d35e108a8f6ee642e155a300bb6
I20260806 01:03:12.730206 12800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 029067fea74646a79885cc633f8d982b: Bootstrap starting.
I20260806 01:03:12.730999 12800 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 029067fea74646a79885cc633f8d982b: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:12.731346 12800 log.cc:824] T 00000000000000000000000000000000 P 029067fea74646a79885cc633f8d982b: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:12.732264 12800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 029067fea74646a79885cc633f8d982b: No bootstrap required, opened a new log
I20260806 01:03:12.734390 12800 raft_consensus.cc:348] T 00000000000000000000000000000000 P 029067fea74646a79885cc633f8d982b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "029067fea74646a79885cc633f8d982b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40069 } }
I20260806 01:03:12.734577 12800 raft_consensus.cc:374] T 00000000000000000000000000000000 P 029067fea74646a79885cc633f8d982b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:12.734637 12800 raft_consensus.cc:729] T 00000000000000000000000000000000 P 029067fea74646a79885cc633f8d982b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 029067fea74646a79885cc633f8d982b, State: Initialized, Role: FOLLOWER
I20260806 01:03:12.734786 12800 consensus_queue.cc:260] T 00000000000000000000000000000000 P 029067fea74646a79885cc633f8d982b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "029067fea74646a79885cc633f8d982b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40069 } }
I20260806 01:03:12.734858 12800 raft_consensus.cc:388] T 00000000000000000000000000000000 P 029067fea74646a79885cc633f8d982b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:03:12.734881 12800 raft_consensus.cc:482] T 00000000000000000000000000000000 P 029067fea74646a79885cc633f8d982b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:03:12.734951 12800 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 029067fea74646a79885cc633f8d982b [term 0 FOLLOWER]: Advancing to term 1
Aug 06 01:03:12 dist-test-slave-69rg krb5kdc[12708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978192, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:12.735680 12800 raft_consensus.cc:504] T 00000000000000000000000000000000 P 029067fea74646a79885cc633f8d982b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "029067fea74646a79885cc633f8d982b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40069 } }
I20260806 01:03:12.735906 12800 leader_election.cc:302] T 00000000000000000000000000000000 P 029067fea74646a79885cc633f8d982b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 029067fea74646a79885cc633f8d982b; no voters:
I20260806 01:03:12.736186 12800 leader_election.cc:288] T 00000000000000000000000000000000 P 029067fea74646a79885cc633f8d982b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:03:12.736452 12805 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 029067fea74646a79885cc633f8d982b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:12.736778 12805 raft_consensus.cc:686] T 00000000000000000000000000000000 P 029067fea74646a79885cc633f8d982b [term 1 LEADER]: Becoming Leader. State: Replica: 029067fea74646a79885cc633f8d982b, State: Running, Role: LEADER
I20260806 01:03:12.736883 12800 sys_catalog.cc:564] T 00000000000000000000000000000000 P 029067fea74646a79885cc633f8d982b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:03:12.736891 12805 consensus_queue.cc:237] T 00000000000000000000000000000000 P 029067fea74646a79885cc633f8d982b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "029067fea74646a79885cc633f8d982b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40069 } }
I20260806 01:03:12.737310 12806 sys_catalog.cc:455] T 00000000000000000000000000000000 P 029067fea74646a79885cc633f8d982b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 029067fea74646a79885cc633f8d982b. Latest consensus state: current_term: 1 leader_uuid: "029067fea74646a79885cc633f8d982b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "029067fea74646a79885cc633f8d982b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40069 } } }
I20260806 01:03:12.737402 12806 sys_catalog.cc:458] T 00000000000000000000000000000000 P 029067fea74646a79885cc633f8d982b [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:12.737355 12807 sys_catalog.cc:455] T 00000000000000000000000000000000 P 029067fea74646a79885cc633f8d982b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "029067fea74646a79885cc633f8d982b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "029067fea74646a79885cc633f8d982b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40069 } } }
I20260806 01:03:12.738010 12807 sys_catalog.cc:458] T 00000000000000000000000000000000 P 029067fea74646a79885cc633f8d982b [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:12.738541 12811 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:03:12.740141 12811 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:03:12.741989 12803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:12.728371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53180 (local address 127.11.88.126:40069)
0806 01:03:12.728586 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:12.728597 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:12.728636 (+ 39us) server_negotiation.cc:407] Connection header received
0806 01:03:12.729214 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:12.729223 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:12.729288 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:12.729454 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:12.730232 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:12.731700 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:12.732547 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:12.732981 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:12.733122 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:12.735758 (+ 2636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:12.735764 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:12.735764 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:12.735779 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:12.739001 (+ 3222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:12.739734 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:12.739738 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:12.739738 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:12.739862 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:12.740236 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:12.740237 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:12.740238 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:12.740587 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:12.741099 (+ 512us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:12.741227 (+ 128us) server_negotiation.cc:299] Negotiation successful
0806 01:03:12.741590 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":102,"threads_started":1}
I20260806 01:03:12.742586 12811 catalog_manager.cc:1347] Generated new cluster ID: 339e3668d96c4570b7fd48439ee70d5f
I20260806 01:03:12.742640 12811 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:03:12.751318 12811 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:03:12.751893 12811 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:03:12.763599 12811 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 029067fea74646a79885cc633f8d982b: Generated new TSK 0
I20260806 01:03:12.763839 12811 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.88.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
I20260806 01:03:12.807466 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:0
--local_ip_for_outbound_sockets=127.11.88.65
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:40069
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:38875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:12.907838 12826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:12.908111 12826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:12.908152 12826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:12.909461 12826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:12.909519 12826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:12.909543 12826 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 01:03:12.909560 12826 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:03:12.911664 12826 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:38875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.88.126:40069
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12826
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:12.912005 12826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:12.912252 12826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:12.918286 12835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:12.918286 12832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:12.918288 12833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:12.918612 12826 server_base.cc:1034] running on GCE node
I20260806 01:03:12.918875 12826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:12.919140 12826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:12.920310 12826 hybrid_clock.cc:648] HybridClock initialized: now 1785978192920294 us; error 27 us; skew 500 ppm
Aug 06 01:03:12 dist-test-slave-69rg krb5kdc[12708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978192, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:12.923489 12826 init.cc:377] Logged in from keytab as kudu/127.11.88.65@KRBTEST.COM (short username kudu)
I20260806 01:03:12.924017 12826 webserver.cc:460] Webserver started at http://127.11.88.65:33917/ using document root <none> and password file <none>
I20260806 01:03:12.924440 12826 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:12.924530 12826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:12.924691 12826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:12.925875 12826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-0/data/instance:
uuid: "19f052b776cf4eab905fe3864bd9b39b"
format_stamp: "Formatted at 2026-08-06 01:03:12 on dist-test-slave-69rg"
server_key: "89597d87800663fd0b9c2e8db144b8f2"
server_key_iv: "5672f2d11db6c325650bc2987fc91262"
server_key_version: "encryptionkey@0"
I20260806 01:03:12.926270 12826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance:
uuid: "19f052b776cf4eab905fe3864bd9b39b"
format_stamp: "Formatted at 2026-08-06 01:03:12 on dist-test-slave-69rg"
server_key: "89597d87800663fd0b9c2e8db144b8f2"
server_key_iv: "5672f2d11db6c325650bc2987fc91262"
server_key_version: "encryptionkey@0"
I20260806 01:03:12.927697 12826 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 01:03:12.928580 12842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:12.928781 12826 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:12.928892 12826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "19f052b776cf4eab905fe3864bd9b39b"
format_stamp: "Formatted at 2026-08-06 01:03:12 on dist-test-slave-69rg"
server_key: "89597d87800663fd0b9c2e8db144b8f2"
server_key_iv: "5672f2d11db6c325650bc2987fc91262"
server_key_version: "encryptionkey@0"
I20260806 01:03:12.928975 12826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:12.954572 12826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:12.957377 12826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:12.957598 12826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:12.958228 12826 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:12.958297 12826 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:12.958331 12826 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:12.958364 12826 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:12.965783 12826 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:41483
I20260806 01:03:12.965889 12959 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:41483 every 8 connection(s)
Aug 06 01:03:12 dist-test-slave-69rg krb5kdc[12708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978192, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:12.966245 12826 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
I20260806 01:03:12.969708 12803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:12.959082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:37615 (local address 127.11.88.126:40069)
0806 01:03:12.959167 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:12.959169 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:12.959388 (+ 219us) server_negotiation.cc:407] Connection header received
0806 01:03:12.960114 (+ 726us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:12.960116 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:12.960130 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:12.960209 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:12.961137 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:12.962041 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:12.963167 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:12.963542 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:12.963628 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:12.966733 (+ 3105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:12.966734 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:12.966735 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:12.966745 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:12.968201 (+ 1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:12.968656 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:12.968657 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:12.968657 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:12.968726 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:12.969008 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:12.969011 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:12.969011 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:12.969182 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:12.969246 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:12.969545 (+ 299us) server_negotiation.cc:299] Negotiation successful
0806 01:03:12.969637 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 01:03:12.969830 12851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:12.959071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:40069 (local address 127.11.88.65:37615)
0806 01:03:12.959256 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:12.959304 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:12.959952 (+ 648us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:12.960297 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:12.960302 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:12.960701 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:12.961002 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:12.961008 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:12.962163 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:12.962164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:12.963079 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:12.963081 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:12.963649 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:12.963650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:12.963810 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:12.964526 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:12.964539 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:12.966592 (+ 2053us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:12.968313 (+ 1721us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:12.968320 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:12.968322 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:12.968554 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:12.968813 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:12.968813 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:12.968814 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:12.968921 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:12.969257 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:12.969262 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:12.969393 (+ 131us) client_negotiation.cc:769] Sending connection context
0806 01:03:12.969486 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 01:03:12.969621 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":86,"threads_started":1}
I20260806 01:03:12.970388 12960 heartbeater.cc:347] Connected to a master server at 127.11.88.126:40069
I20260806 01:03:12.970481 12960 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:12.970686 12960 heartbeater.cc:511] Master 127.11.88.126:40069 requested a full tablet report, sending...
I20260806 01:03:12.971323 12753 ts_manager.cc:194] Registered new tserver with Master: 19f052b776cf4eab905fe3864bd9b39b (127.11.88.65:41483)
I20260806 01:03:12.972324 12753 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.65@KRBTEST.COM'} at 127.11.88.65:37615
I20260806 01:03:12.974669 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 12826
I20260806 01:03:12.974788 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance
I20260806 01:03:12.974977 11617 external_mini_cluster.cc:1428] Setting key a37357adaa2c49d721b604a79b6e92d8
I20260806 01:03:12.978133 12803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:12.971723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:39027 (local address 127.11.88.126:40069)
0806 01:03:12.971764 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:12.971766 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:12.971842 (+ 76us) server_negotiation.cc:407] Connection header received
0806 01:03:12.971900 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:12.971901 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:12.971909 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:12.971950 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:12.972328 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:12.973058 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:12.973754 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:12.974013 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:12.974071 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:12.975112 (+ 1041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:12.975113 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:12.975114 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:12.975122 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:12.976636 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:12.977073 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:12.977073 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:12.977074 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:12.977133 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:12.977488 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:12.977489 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:12.977489 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:12.977609 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:12.977716 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:12.977930 (+ 214us) server_negotiation.cc:299] Negotiation successful
0806 01:03:12.978018 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 01:03:12.978142 12966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:12.971615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:40069 (local address 127.11.88.65:39027)
0806 01:03:12.971779 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:12.971790 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:12.971853 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:12.971963 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:12.971963 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:12.972172 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:12.972239 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:12.972241 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:12.973156 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:12.973157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:12.973671 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:12.973672 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:12.974082 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:12.974083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:12.974152 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:12.974582 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:12.974588 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:12.975004 (+ 416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:12.976723 (+ 1719us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:12.976724 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:12.976725 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:12.976976 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:12.977233 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:12.977234 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:12.977235 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:12.977316 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:12.977722 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:12.977723 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:12.977794 (+ 71us) client_negotiation.cc:769] Sending connection context
0806 01:03:12.977902 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 01:03:12.978019 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":103,"threads_started":1}
WARNING: no policy specified for kudu/127.11.88.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
I20260806 01:03:13.010416 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:0
--local_ip_for_outbound_sockets=127.11.88.66
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:40069
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:38875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:13.109493 12969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:13.109748 12969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:13.109779 12969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:13.111202 12969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:13.111263 12969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:13.111285 12969 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 01:03:13.111305 12969 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:03:13.114311 12969 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:38875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.88.126:40069
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12969
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:13.114778 12969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:13.115209 12969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:13.123674 12977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:13.123667 12975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:13.123713 12969 server_base.cc:1034] running on GCE node
W20260806 01:03:13.123674 12974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:13.124200 12969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:13.124531 12969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:13.125748 12969 hybrid_clock.cc:648] HybridClock initialized: now 1785978193125736 us; error 33 us; skew 500 ppm
Aug 06 01:03:13 dist-test-slave-69rg krb5kdc[12708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978193, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:13.129571 12969 init.cc:377] Logged in from keytab as kudu/127.11.88.66@KRBTEST.COM (short username kudu)
I20260806 01:03:13.130184 12969 webserver.cc:460] Webserver started at http://127.11.88.66:45919/ using document root <none> and password file <none>
I20260806 01:03:13.130440 12969 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:13.130513 12969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:13.130681 12969 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:13.131825 12969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-1/data/instance:
uuid: "60227589063346bd853c2444af4f933e"
format_stamp: "Formatted at 2026-08-06 01:03:13 on dist-test-slave-69rg"
server_key: "6e8632aedab34bb89a56dcf1ab203bb9"
server_key_iv: "0521e1b58ce9915280fd2a50c3436eff"
server_key_version: "encryptionkey@0"
I20260806 01:03:13.132220 12969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance:
uuid: "60227589063346bd853c2444af4f933e"
format_stamp: "Formatted at 2026-08-06 01:03:13 on dist-test-slave-69rg"
server_key: "6e8632aedab34bb89a56dcf1ab203bb9"
server_key_iv: "0521e1b58ce9915280fd2a50c3436eff"
server_key_version: "encryptionkey@0"
I20260806 01:03:13.134167 12969 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 01:03:13.135072 12984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:13.135250 12969 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:13.135365 12969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "60227589063346bd853c2444af4f933e"
format_stamp: "Formatted at 2026-08-06 01:03:13 on dist-test-slave-69rg"
server_key: "6e8632aedab34bb89a56dcf1ab203bb9"
server_key_iv: "0521e1b58ce9915280fd2a50c3436eff"
server_key_version: "encryptionkey@0"
I20260806 01:03:13.135445 12969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:13.152275 12969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:13.154951 12969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:13.155138 12969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:13.155740 12969 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:13.155807 12969 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:13.155881 12969 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:13.155916 12969 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:13.165089 12969 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:42641
I20260806 01:03:13.165184 13102 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:42641 every 8 connection(s)
Aug 06 01:03:13 dist-test-slave-69rg krb5kdc[12708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978193, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:13.165557 12969 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
I20260806 01:03:13.167614 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 12969
I20260806 01:03:13.167740 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance
I20260806 01:03:13.167984 11617 external_mini_cluster.cc:1428] Setting key 44ac1884f0996192b07cf6db810a1193
I20260806 01:03:13.169296 12803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.156632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:57873 (local address 127.11.88.126:40069)
0806 01:03:13.156708 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:13.156711 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:13.156964 (+ 253us) server_negotiation.cc:407] Connection header received
0806 01:03:13.157652 (+ 688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:13.157654 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:13.157671 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:13.157983 (+ 312us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:13.159285 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.160337 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.162276 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.162746 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.162939 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.166185 (+ 3246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:13.166187 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:13.166187 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:13.166197 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:13.167781 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:13.168267 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:13.168268 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:13.168268 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:13.168335 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:13.168607 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:13.168608 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:13.168608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:13.168740 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:13.168814 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:13.169107 (+ 293us) server_negotiation.cc:299] Negotiation successful
0806 01:03:13.169196 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 01:03:13.169525 12993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.156614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:40069 (local address 127.11.88.66:57873)
0806 01:03:13.156819 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:13.156862 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:13.157523 (+ 661us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:13.158209 (+ 686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:13.158213 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:13.158811 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:13.159143 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.159152 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.160454 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.160456 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.162153 (+ 1697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.162157 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.162954 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.162955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.163085 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.163845 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:13.163858 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:13.166064 (+ 2206us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:13.167865 (+ 1801us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:13.167874 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:13.167876 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:13.168187 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:13.168406 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:13.168408 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:13.168408 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:13.168530 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:13.168807 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:13.168815 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:13.168967 (+ 152us) client_negotiation.cc:769] Sending connection context
0806 01:03:13.169082 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 01:03:13.169266 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":127,"threads_started":1}
I20260806 01:03:13.170128 13103 heartbeater.cc:347] Connected to a master server at 127.11.88.126:40069
I20260806 01:03:13.170246 13103 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:13.170468 13103 heartbeater.cc:511] Master 127.11.88.126:40069 requested a full tablet report, sending...
I20260806 01:03:13.171236 12752 ts_manager.cc:194] Registered new tserver with Master: 60227589063346bd853c2444af4f933e (127.11.88.66:42641)
I20260806 01:03:13.171797 12752 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.66@KRBTEST.COM'} at 127.11.88.66:57873
WARNING: no policy specified for kudu/127.11.88.67@KRBTEST.COM; defaulting to no policy
I20260806 01:03:13.177327 12803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.171325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:43299 (local address 127.11.88.126:40069)
0806 01:03:13.171367 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:13.171369 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:13.171490 (+ 121us) server_negotiation.cc:407] Connection header received
0806 01:03:13.171541 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:13.171542 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:13.171550 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:13.171598 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:13.172035 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.172596 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.173305 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.173505 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.173580 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.174578 (+ 998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:13.174580 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:13.174580 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:13.174588 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:13.176014 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:13.176454 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:13.176455 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:13.176455 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:13.176517 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:13.176727 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:13.176728 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:13.176729 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:13.176893 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:13.176971 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:13.177150 (+ 179us) server_negotiation.cc:299] Negotiation successful
0806 01:03:13.177229 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 01:03:13.177331 13110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.171255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:40069 (local address 127.11.88.66:43299)
0806 01:03:13.171411 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:13.171422 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:13.171485 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:13.171603 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:13.171603 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:13.171827 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:13.171900 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.171903 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.172704 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.172706 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.173220 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.173221 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.173579 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.173580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.173664 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.174164 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:13.174169 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:13.174482 (+ 313us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:13.176180 (+ 1698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:13.176181 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:13.176182 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:13.176365 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:13.176585 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:13.176586 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:13.176586 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:13.176662 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:13.176971 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:13.176973 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:13.177024 (+ 51us) client_negotiation.cc:769] Sending connection context
0806 01:03:13.177104 (+ 80us) client_negotiation.cc:240] Negotiation successful
0806 01:03:13.177224 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":87,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
I20260806 01:03:13.206483 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:0
--local_ip_for_outbound_sockets=127.11.88.67
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:40069
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:38875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:13.310678 13112 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:13.310921 13112 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:13.310951 13112 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:13.312333 13112 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:13.312395 13112 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:13.312418 13112 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 01:03:13.312438 13112 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:03:13.314194 13112 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:38875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.88.126:40069
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13112
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:13.314498 13112 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:13.314721 13112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:13.320303 13121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:13.320293 13119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:13.320331 13118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:13.321202 13112 server_base.cc:1034] running on GCE node
I20260806 01:03:13.321460 13112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:13.321780 13112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:13.323127 13112 hybrid_clock.cc:648] HybridClock initialized: now 1785978193323077 us; error 47 us; skew 500 ppm
Aug 06 01:03:13 dist-test-slave-69rg krb5kdc[12708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978193, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:13.328620 13112 init.cc:377] Logged in from keytab as kudu/127.11.88.67@KRBTEST.COM (short username kudu)
I20260806 01:03:13.329317 13112 webserver.cc:460] Webserver started at http://127.11.88.67:43783/ using document root <none> and password file <none>
I20260806 01:03:13.329623 13112 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:13.331133 13112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:13.331477 13112 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:13.332898 13112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-2/data/instance:
uuid: "4cb1ac25f47844e1a6ffc92b935fcf05"
format_stamp: "Formatted at 2026-08-06 01:03:13 on dist-test-slave-69rg"
server_key: "fcbb390f1b5b32deb02c06830cf08c54"
server_key_iv: "45eb5aec0e5045005584f1ad9350f7ce"
server_key_version: "encryptionkey@0"
I20260806 01:03:13.333735 13112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance:
uuid: "4cb1ac25f47844e1a6ffc92b935fcf05"
format_stamp: "Formatted at 2026-08-06 01:03:13 on dist-test-slave-69rg"
server_key: "fcbb390f1b5b32deb02c06830cf08c54"
server_key_iv: "45eb5aec0e5045005584f1ad9350f7ce"
server_key_version: "encryptionkey@0"
I20260806 01:03:13.336246 13112 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260806 01:03:13.337641 13128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:13.338279 13112 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:03:13.338373 13112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "4cb1ac25f47844e1a6ffc92b935fcf05"
format_stamp: "Formatted at 2026-08-06 01:03:13 on dist-test-slave-69rg"
server_key: "fcbb390f1b5b32deb02c06830cf08c54"
server_key_iv: "45eb5aec0e5045005584f1ad9350f7ce"
server_key_version: "encryptionkey@0"
I20260806 01:03:13.338496 13112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:13.354848 13112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:13.358582 13112 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:13.359050 13112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:13.359876 13112 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:13.359939 13112 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:13.359975 13112 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:13.359999 13112 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 01:03:13 dist-test-slave-69rg krb5kdc[12708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978193, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:13.368842 13112 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:34675
I20260806 01:03:13.369060 13245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:34675 every 8 connection(s)
I20260806 01:03:13.369328 13112 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
I20260806 01:03:13.371817 12803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.360645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:54817 (local address 127.11.88.126:40069)
0806 01:03:13.360738 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:13.360741 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:13.361025 (+ 284us) server_negotiation.cc:407] Connection header received
0806 01:03:13.361942 (+ 917us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:13.361944 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:13.361961 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:13.362042 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:13.362839 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.363381 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.364652 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.364860 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.364940 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.368137 (+ 3197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:13.368140 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:13.368140 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:13.368152 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:13.370151 (+ 1999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:13.370650 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:13.370651 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:13.370651 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:13.370724 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:13.371022 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:13.371023 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:13.371023 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:13.371231 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:13.371325 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:13.371612 (+ 287us) server_negotiation.cc:299] Negotiation successful
0806 01:03:13.371712 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 01:03:13.372040 13137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.360579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:40069 (local address 127.11.88.67:54817)
0806 01:03:13.360836 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:13.360893 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:13.361730 (+ 837us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:13.362212 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:13.362216 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:13.362499 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:13.362735 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.362739 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.363595 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.363597 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.364547 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.364551 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.364963 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.364964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.365095 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.365695 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:13.365704 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:13.367896 (+ 2192us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:13.370266 (+ 2370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:13.370272 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:13.370274 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:13.370575 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:13.370794 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:13.370794 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:13.370794 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:13.370902 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:13.371302 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:13.371311 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:13.371466 (+ 155us) client_negotiation.cc:769] Sending connection context
0806 01:03:13.371585 (+ 119us) client_negotiation.cc:240] Negotiation successful
0806 01:03:13.371793 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":94,"threads_started":1}
I20260806 01:03:13.372607 13246 heartbeater.cc:347] Connected to a master server at 127.11.88.126:40069
I20260806 01:03:13.372718 13246 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:13.372953 13246 heartbeater.cc:511] Master 127.11.88.126:40069 requested a full tablet report, sending...
I20260806 01:03:13.373471 12752 ts_manager.cc:194] Registered new tserver with Master: 4cb1ac25f47844e1a6ffc92b935fcf05 (127.11.88.67:34675)
I20260806 01:03:13.373929 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 13112
I20260806 01:03:13.374020 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance
I20260806 01:03:13.374063 12752 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.67@KRBTEST.COM'} at 127.11.88.67:54817
I20260806 01:03:13.374197 11617 external_mini_cluster.cc:1428] Setting key d6911325317118f49a062ca926daa67e
I20260806 01:03:13.374931 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 01:03:13.381160 12803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.373964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:48735 (local address 127.11.88.126:40069)
0806 01:03:13.374010 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:13.374012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:13.374174 (+ 162us) server_negotiation.cc:407] Connection header received
0806 01:03:13.374232 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:13.374233 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:13.374245 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:13.374310 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:13.374845 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.375407 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.376606 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.376793 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.376855 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.378126 (+ 1271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:13.378128 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:13.378128 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:13.378137 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:13.379825 (+ 1688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:13.380284 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:13.380285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:13.380286 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:13.380347 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:13.380596 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:13.380597 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:13.380598 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:13.380740 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:13.380814 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:13.381030 (+ 216us) server_negotiation.cc:299] Negotiation successful
0806 01:03:13.381094 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 01:03:13.381354 13252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.373906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:40069 (local address 127.11.88.67:48735)
0806 01:03:13.374073 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:13.374084 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:13.374173 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:13.374315 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:13.374316 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:13.374564 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:13.374651 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.374653 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.375521 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.375522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.376467 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.376471 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.376879 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.376880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.376974 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.377629 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:13.377634 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:13.378026 (+ 392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:13.379934 (+ 1908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:13.379935 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:13.379936 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:13.380199 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:13.380440 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:13.380441 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:13.380441 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:13.380522 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:13.380837 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:13.380839 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:13.380905 (+ 66us) client_negotiation.cc:769] Sending connection context
0806 01:03:13.381001 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 01:03:13.381185 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":98,"threads_started":1}
Aug 06 01:03:13 dist-test-slave-69rg krb5kdc[12708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978193, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 01:03:13 dist-test-slave-69rg krb5kdc[12708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978193, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:13.402530 12803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.394213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53194 (local address 127.11.88.126:40069)
0806 01:03:13.394285 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:13.394287 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:13.394294 (+ 7us) server_negotiation.cc:407] Connection header received
0806 01:03:13.394317 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:13.394318 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:13.394327 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:13.394394 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:13.394960 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.395531 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.396489 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.396698 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.396784 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.399674 (+ 2890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:13.399675 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:13.399675 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:13.399683 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:13.401282 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:13.401669 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:13.401670 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:13.401670 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:13.401740 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:13.402057 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:13.402058 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:13.402058 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:13.402176 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:13.402263 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:13.402365 (+ 102us) server_negotiation.cc:299] Negotiation successful
0806 01:03:13.402429 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 01:03:13.404457 12752 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53194:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 01:03:13.406172 12752 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:03:13.414023 13265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.409305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48392 (local address 127.11.88.67:34675)
0806 01:03:13.409679 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:13.409685 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:13.409696 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:03:13.409743 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:13.409745 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:13.409764 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:13.410341 (+ 577us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:13.410402 (+ 61us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.411484 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.412659 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.413459 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.413546 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.413612 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:13.413859 (+ 247us) server_negotiation.cc:299] Negotiation successful
0806 01:03:13.413909 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":94,"threads_started":1}
I20260806 01:03:13.414036 13263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.409162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:34675 (local address 127.0.0.1:48392)
0806 01:03:13.409375 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:13.409420 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:13.409499 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:13.409960 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:13.409963 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:13.409966 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:13.410057 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.410060 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.411595 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.411596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.412572 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.412574 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.413612 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.413613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.413699 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.413715 (+ 16us) client_negotiation.cc:769] Sending connection context
0806 01:03:13.413809 (+ 94us) client_negotiation.cc:240] Negotiation successful
0806 01:03:13.413915 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"mutex_wait_us":22,"thread_start_us":87,"threads_started":1}
I20260806 01:03:13.414392 13267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.409601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34068 (local address 127.11.88.65:41483)
0806 01:03:13.409792 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:13.409803 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:13.409845 (+ 42us) server_negotiation.cc:407] Connection header received
0806 01:03:13.409888 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:13.409890 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:13.409929 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:13.410012 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:13.410242 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.411456 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.412748 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.413459 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.413546 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.413612 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:13.414215 (+ 603us) server_negotiation.cc:299] Negotiation successful
0806 01:03:13.414289 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":92,"threads_started":1}
I20260806 01:03:13.414163 13266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.409177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:41483 (local address 127.0.0.1:34068)
0806 01:03:13.409553 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:13.409565 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:13.409615 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:13.410044 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:13.410045 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:13.410048 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:13.410130 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.410132 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.411547 (+ 1415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.411548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.412673 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.412674 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.413591 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.413592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.413706 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.413715 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 01:03:13.413809 (+ 94us) client_negotiation.cc:240] Negotiation successful
0806 01:03:13.413921 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"mutex_wait_us":46,"thread_start_us":107,"threads_started":1}
I20260806 01:03:13.414988 13179 tablet_service.cc:1467] Processing CreateTablet for tablet 5f07758c62db415fbbf5f89c1f506f2c (DEFAULT_TABLE table=test-table [id=1b63bcd2af374b2186362f961cc3fe49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:13.415243 13264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.409202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:42641 (local address 127.0.0.1:57714)
0806 01:03:13.409788 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:13.409806 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:13.409912 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:13.410352 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:13.410354 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:13.410356 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:13.410417 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.410418 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.411320 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.411322 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.412671 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.412674 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.414947 (+ 2273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.414948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.415035 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.415042 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 01:03:13.415115 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 01:03:13.415166 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"mutex_wait_us":1,"thread_start_us":308,"threads_started":1}
I20260806 01:03:13.415297 13268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.409659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57714 (local address 127.11.88.66:42641)
0806 01:03:13.410144 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:13.410149 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:13.410158 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:03:13.410197 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:13.410200 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:13.410217 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:13.410289 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:13.410494 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.411225 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.413654 (+ 2429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.414856 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.414930 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.414971 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:13.415136 (+ 165us) server_negotiation.cc:299] Negotiation successful
0806 01:03:13.415172 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":71,"threads_started":1}
I20260806 01:03:13.415426 13179 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f07758c62db415fbbf5f89c1f506f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:13.415899 13035 tablet_service.cc:1467] Processing CreateTablet for tablet 5f07758c62db415fbbf5f89c1f506f2c (DEFAULT_TABLE table=test-table [id=1b63bcd2af374b2186362f961cc3fe49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:13.416245 13035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f07758c62db415fbbf5f89c1f506f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:13.418537 12893 tablet_service.cc:1467] Processing CreateTablet for tablet 5f07758c62db415fbbf5f89c1f506f2c (DEFAULT_TABLE table=test-table [id=1b63bcd2af374b2186362f961cc3fe49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:13.418939 12893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f07758c62db415fbbf5f89c1f506f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:13.418936 13269 tablet_bootstrap.cc:492] T 5f07758c62db415fbbf5f89c1f506f2c P 4cb1ac25f47844e1a6ffc92b935fcf05: Bootstrap starting.
I20260806 01:03:13.420797 13269 tablet_bootstrap.cc:654] T 5f07758c62db415fbbf5f89c1f506f2c P 4cb1ac25f47844e1a6ffc92b935fcf05: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:13.421427 13269 log.cc:824] T 5f07758c62db415fbbf5f89c1f506f2c P 4cb1ac25f47844e1a6ffc92b935fcf05: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:13.421742 13270 tablet_bootstrap.cc:492] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e: Bootstrap starting.
I20260806 01:03:13.422528 13269 tablet_bootstrap.cc:492] T 5f07758c62db415fbbf5f89c1f506f2c P 4cb1ac25f47844e1a6ffc92b935fcf05: No bootstrap required, opened a new log
I20260806 01:03:13.422541 13270 tablet_bootstrap.cc:654] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:13.422617 13269 ts_tablet_manager.cc:1397] T 5f07758c62db415fbbf5f89c1f506f2c P 4cb1ac25f47844e1a6ffc92b935fcf05: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260806 01:03:13.423025 13270 log.cc:824] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:13.423925 13270 tablet_bootstrap.cc:492] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e: No bootstrap required, opened a new log
I20260806 01:03:13.424000 13270 ts_tablet_manager.cc:1397] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 01:03:13.425518 13269 raft_consensus.cc:348] T 5f07758c62db415fbbf5f89c1f506f2c P 4cb1ac25f47844e1a6ffc92b935fcf05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } } peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } }
I20260806 01:03:13.425704 13269 raft_consensus.cc:374] T 5f07758c62db415fbbf5f89c1f506f2c P 4cb1ac25f47844e1a6ffc92b935fcf05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:13.425618 13272 tablet_bootstrap.cc:492] T 5f07758c62db415fbbf5f89c1f506f2c P 19f052b776cf4eab905fe3864bd9b39b: Bootstrap starting.
I20260806 01:03:13.425746 13269 raft_consensus.cc:729] T 5f07758c62db415fbbf5f89c1f506f2c P 4cb1ac25f47844e1a6ffc92b935fcf05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cb1ac25f47844e1a6ffc92b935fcf05, State: Initialized, Role: FOLLOWER
I20260806 01:03:13.425923 13269 consensus_queue.cc:260] T 5f07758c62db415fbbf5f89c1f506f2c P 4cb1ac25f47844e1a6ffc92b935fcf05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } } peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } }
I20260806 01:03:13.426350 13269 ts_tablet_manager.cc:1428] T 5f07758c62db415fbbf5f89c1f506f2c P 4cb1ac25f47844e1a6ffc92b935fcf05: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260806 01:03:13.426481 13246 heartbeater.cc:503] Master 127.11.88.126:40069 was elected leader, sending a full tablet report...
I20260806 01:03:13.426565 13270 raft_consensus.cc:348] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } } peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } }
I20260806 01:03:13.426736 13270 raft_consensus.cc:374] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:13.426776 13270 raft_consensus.cc:729] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60227589063346bd853c2444af4f933e, State: Initialized, Role: FOLLOWER
I20260806 01:03:13.426851 13272 tablet_bootstrap.cc:654] T 5f07758c62db415fbbf5f89c1f506f2c P 19f052b776cf4eab905fe3864bd9b39b: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:13.426901 13270 consensus_queue.cc:260] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } } peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } }
I20260806 01:03:13.427176 13270 ts_tablet_manager.cc:1428] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260806 01:03:13.427266 13272 log.cc:824] T 5f07758c62db415fbbf5f89c1f506f2c P 19f052b776cf4eab905fe3864bd9b39b: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:13.427315 13103 heartbeater.cc:503] Master 127.11.88.126:40069 was elected leader, sending a full tablet report...
I20260806 01:03:13.428078 13272 tablet_bootstrap.cc:492] T 5f07758c62db415fbbf5f89c1f506f2c P 19f052b776cf4eab905fe3864bd9b39b: No bootstrap required, opened a new log
I20260806 01:03:13.428182 13272 ts_tablet_manager.cc:1397] T 5f07758c62db415fbbf5f89c1f506f2c P 19f052b776cf4eab905fe3864bd9b39b: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260806 01:03:13.429768 13272 raft_consensus.cc:348] T 5f07758c62db415fbbf5f89c1f506f2c P 19f052b776cf4eab905fe3864bd9b39b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } } peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } }
I20260806 01:03:13.430012 13272 raft_consensus.cc:374] T 5f07758c62db415fbbf5f89c1f506f2c P 19f052b776cf4eab905fe3864bd9b39b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:13.430086 13272 raft_consensus.cc:729] T 5f07758c62db415fbbf5f89c1f506f2c P 19f052b776cf4eab905fe3864bd9b39b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f052b776cf4eab905fe3864bd9b39b, State: Initialized, Role: FOLLOWER
I20260806 01:03:13.430248 13272 consensus_queue.cc:260] T 5f07758c62db415fbbf5f89c1f506f2c P 19f052b776cf4eab905fe3864bd9b39b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } } peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } }
I20260806 01:03:13.430536 13272 ts_tablet_manager.cc:1428] T 5f07758c62db415fbbf5f89c1f506f2c P 19f052b776cf4eab905fe3864bd9b39b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 01:03:13.430609 12960 heartbeater.cc:503] Master 127.11.88.126:40069 was elected leader, sending a full tablet report...
I20260806 01:03:13.431234 13275 raft_consensus.cc:482] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:03:13.431356 13275 raft_consensus.cc:504] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } } peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } }
I20260806 01:03:13.431902 13275 leader_election.cc:288] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cb1ac25f47844e1a6ffc92b935fcf05 (127.11.88.67:34675), 19f052b776cf4eab905fe3864bd9b39b (127.11.88.65:41483)
I20260806 01:03:13.434803 13267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.431886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:39791 (local address 127.11.88.65:41483)
0806 01:03:13.431940 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:13.431943 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:13.431954 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:03:13.432015 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:13.432016 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:13.432026 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:13.432090 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:13.432294 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.432934 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.433955 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.434380 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.434493 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.434503 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:13.434687 (+ 184us) server_negotiation.cc:299] Negotiation successful
0806 01:03:13.434727 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260806 01:03:13.434803 12993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.431841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:41483 (local address 127.11.88.66:39791)
0806 01:03:13.431892 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:13.431907 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:13.431953 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:13.432114 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:13.432115 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:13.432117 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:13.432206 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.432208 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.433041 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.433042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.433871 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.433874 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.434493 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.434494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.434590 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.434594 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:03:13.434677 (+ 83us) client_negotiation.cc:240] Negotiation successful
0806 01:03:13.434721 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260806 01:03:13.435150 12913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f07758c62db415fbbf5f89c1f506f2c" candidate_uuid: "60227589063346bd853c2444af4f933e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f052b776cf4eab905fe3864bd9b39b" is_pre_election: true
I20260806 01:03:13.435299 12913 raft_consensus.cc:2454] T 5f07758c62db415fbbf5f89c1f506f2c P 19f052b776cf4eab905fe3864bd9b39b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60227589063346bd853c2444af4f933e in term 0.
I20260806 01:03:13.435539 12987 leader_election.cc:302] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f052b776cf4eab905fe3864bd9b39b, 60227589063346bd853c2444af4f933e; no voters:
I20260806 01:03:13.435763 13275 raft_consensus.cc:2781] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:03:13.435809 13265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.432175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:55711 (local address 127.11.88.67:34675)
0806 01:03:13.432216 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:13.432217 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:13.432225 (+ 8us) server_negotiation.cc:407] Connection header received
0806 01:03:13.432249 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:13.432250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:13.432259 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:13.432314 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:13.432466 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.432946 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.434746 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.435305 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.435376 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.435386 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:13.435686 (+ 300us) server_negotiation.cc:299] Negotiation successful
0806 01:03:13.435736 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 01:03:13.435834 13275 raft_consensus.cc:482] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:03:13.435877 13275 raft_consensus.cc:3037] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:13.436074 13278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.431904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:34675 (local address 127.11.88.66:55711)
0806 01:03:13.432083 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:13.432093 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:13.432133 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:13.432319 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:13.432320 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:13.432322 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:13.432386 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.432388 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.433968 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.433969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.434652 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.434653 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.435459 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.435461 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.435596 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.435601 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 01:03:13.435675 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 01:03:13.435721 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":125,"threads_started":1}
I20260806 01:03:13.436609 13196 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f07758c62db415fbbf5f89c1f506f2c" candidate_uuid: "60227589063346bd853c2444af4f933e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" is_pre_election: true
I20260806 01:03:13.436797 13196 raft_consensus.cc:2454] T 5f07758c62db415fbbf5f89c1f506f2c P 4cb1ac25f47844e1a6ffc92b935fcf05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60227589063346bd853c2444af4f933e in term 0.
I20260806 01:03:13.437510 13275 raft_consensus.cc:504] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } } peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } }
I20260806 01:03:13.437659 13275 leader_election.cc:288] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e [CANDIDATE]: Term 1 election: Requested vote from peers 4cb1ac25f47844e1a6ffc92b935fcf05 (127.11.88.67:34675), 19f052b776cf4eab905fe3864bd9b39b (127.11.88.65:41483)
I20260806 01:03:13.437799 13196 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f07758c62db415fbbf5f89c1f506f2c" candidate_uuid: "60227589063346bd853c2444af4f933e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05"
I20260806 01:03:13.437903 13196 raft_consensus.cc:3037] T 5f07758c62db415fbbf5f89c1f506f2c P 4cb1ac25f47844e1a6ffc92b935fcf05 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:13.437908 12913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f07758c62db415fbbf5f89c1f506f2c" candidate_uuid: "60227589063346bd853c2444af4f933e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f052b776cf4eab905fe3864bd9b39b"
I20260806 01:03:13.437976 12913 raft_consensus.cc:3037] T 5f07758c62db415fbbf5f89c1f506f2c P 19f052b776cf4eab905fe3864bd9b39b [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:13.439213 13196 raft_consensus.cc:2454] T 5f07758c62db415fbbf5f89c1f506f2c P 4cb1ac25f47844e1a6ffc92b935fcf05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60227589063346bd853c2444af4f933e in term 1.
I20260806 01:03:13.439213 12913 raft_consensus.cc:2454] T 5f07758c62db415fbbf5f89c1f506f2c P 19f052b776cf4eab905fe3864bd9b39b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60227589063346bd853c2444af4f933e in term 1.
I20260806 01:03:13.439445 12986 leader_election.cc:302] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cb1ac25f47844e1a6ffc92b935fcf05, 60227589063346bd853c2444af4f933e; no voters:
I20260806 01:03:13.439592 13275 raft_consensus.cc:2781] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:13.439796 13275 raft_consensus.cc:686] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e [term 1 LEADER]: Becoming Leader. State: Replica: 60227589063346bd853c2444af4f933e, State: Running, Role: LEADER
I20260806 01:03:13.439903 13275 consensus_queue.cc:237] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } } peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } }
I20260806 01:03:13.440907 12752 catalog_manager.cc:5495] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e reported cstate change: term changed from 0 to 1, leader changed from <none> to 60227589063346bd853c2444af4f933e (127.11.88.66). New cstate: current_term: 1 leader_uuid: "60227589063346bd853c2444af4f933e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } health_report { overall_health: HEALTHY } } }
I20260806 01:03:13.451377 13268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.448871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57724 (local address 127.11.88.66:42641)
0806 01:03:13.448933 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:13.448935 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:13.448990 (+ 55us) server_negotiation.cc:407] Connection header received
0806 01:03:13.449071 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:13.449071 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:13.449089 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:13.449159 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:03:13.449293 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.449783 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.450647 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.450832 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.450888 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.451075 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:03:13.451178 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:03:13.451238 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:13.451301 (+ 63us) server_negotiation.cc:299] Negotiation successful
0806 01:03:13.451319 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 01:03:13.453405 13196 raft_consensus.cc:1261] T 5f07758c62db415fbbf5f89c1f506f2c P 4cb1ac25f47844e1a6ffc92b935fcf05 [term 1 FOLLOWER]: Refusing update from remote peer 60227589063346bd853c2444af4f933e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:13.453456 12913 raft_consensus.cc:1261] T 5f07758c62db415fbbf5f89c1f506f2c P 19f052b776cf4eab905fe3864bd9b39b [term 1 FOLLOWER]: Refusing update from remote peer 60227589063346bd853c2444af4f933e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:13.453859 13279 consensus_queue.cc:1035] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:13.454005 13275 consensus_queue.cc:1035] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:13.456905 13282 mvcc.cc:205] Tried to move back new op lower bound from 7315366680382169088 to 7315366680330747904. Current Snapshot: MvccSnapshot[applied={T|T < 7315366680382169088}]
I20260806 01:03:13.457751 13284 mvcc.cc:205] Tried to move back new op lower bound from 7315366680382169088 to 7315366680330747904. Current Snapshot: MvccSnapshot[applied={T|T < 7315366680382169088 or (T in {7315366680382169088})}]
I20260806 01:03:13.462693 12752 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53194:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:13.462855 12752 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53194:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:13.463910 12752 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 029067fea74646a79885cc633f8d982b: Sending DeleteTablet for 3 replicas of tablet 5f07758c62db415fbbf5f89c1f506f2c
I20260806 01:03:13.464393 13179 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f07758c62db415fbbf5f89c1f506f2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:13 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:48392
I20260806 01:03:13.464494 12893 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f07758c62db415fbbf5f89c1f506f2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:13 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:34068
I20260806 01:03:13.464690 12752 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53194:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 01:03:13.464862 12752 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:03:13.464983 13293 tablet_replica.cc:330] T 5f07758c62db415fbbf5f89c1f506f2c P 19f052b776cf4eab905fe3864bd9b39b: stopping tablet replica
I20260806 01:03:13.465226 13035 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f07758c62db415fbbf5f89c1f506f2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:13 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:57714
I20260806 01:03:13.465381 13293 raft_consensus.cc:2229] T 5f07758c62db415fbbf5f89c1f506f2c P 19f052b776cf4eab905fe3864bd9b39b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:03:13.465554 13293 raft_consensus.cc:2258] T 5f07758c62db415fbbf5f89c1f506f2c P 19f052b776cf4eab905fe3864bd9b39b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:13.465615 13294 tablet_replica.cc:330] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e: stopping tablet replica
I20260806 01:03:13.465705 13294 raft_consensus.cc:2229] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e [term 1 LEADER]: Raft consensus shutting down.
I20260806 01:03:13.465852 13294 raft_consensus.cc:2258] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:13.466274 13293 ts_tablet_manager.cc:1905] T 5f07758c62db415fbbf5f89c1f506f2c P 19f052b776cf4eab905fe3864bd9b39b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:13.466842 13294 ts_tablet_manager.cc:1905] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:13.467084 13179 tablet_service.cc:1467] Processing CreateTablet for tablet 01e52e277e374b25805e266a13ac962f (DEFAULT_TABLE table=test-table [id=f639932f256d4d0abc332f7c318ecd70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:13.467218 13179 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01e52e277e374b25805e266a13ac962f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:13.467190 12893 tablet_service.cc:1467] Processing CreateTablet for tablet 01e52e277e374b25805e266a13ac962f (DEFAULT_TABLE table=test-table [id=f639932f256d4d0abc332f7c318ecd70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:13.467363 12893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01e52e277e374b25805e266a13ac962f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:13.469348 13269 tablet_bootstrap.cc:492] T 01e52e277e374b25805e266a13ac962f P 4cb1ac25f47844e1a6ffc92b935fcf05: Bootstrap starting.
I20260806 01:03:13.469745 13035 tablet_service.cc:1467] Processing CreateTablet for tablet 01e52e277e374b25805e266a13ac962f (DEFAULT_TABLE table=test-table [id=f639932f256d4d0abc332f7c318ecd70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:13.469992 13272 tablet_bootstrap.cc:492] T 01e52e277e374b25805e266a13ac962f P 19f052b776cf4eab905fe3864bd9b39b: Bootstrap starting.
I20260806 01:03:13.470360 13294 ts_tablet_manager.cc:1918] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:03:13.470597 13294 log.cc:1196] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-1/wal/wals/5f07758c62db415fbbf5f89c1f506f2c
I20260806 01:03:13.470769 13272 tablet_bootstrap.cc:654] T 01e52e277e374b25805e266a13ac962f P 19f052b776cf4eab905fe3864bd9b39b: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:13.470829 13269 tablet_bootstrap.cc:654] T 01e52e277e374b25805e266a13ac962f P 4cb1ac25f47844e1a6ffc92b935fcf05: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:13.470896 13294 ts_tablet_manager.cc:1939] T 5f07758c62db415fbbf5f89c1f506f2c P 60227589063346bd853c2444af4f933e: Deleting consensus metadata
I20260806 01:03:13.471449 13293 ts_tablet_manager.cc:1918] T 5f07758c62db415fbbf5f89c1f506f2c P 19f052b776cf4eab905fe3864bd9b39b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:03:13.471505 13293 log.cc:1196] T 5f07758c62db415fbbf5f89c1f506f2c P 19f052b776cf4eab905fe3864bd9b39b: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-0/wal/wals/5f07758c62db415fbbf5f89c1f506f2c
I20260806 01:03:13.471787 13293 ts_tablet_manager.cc:1939] T 5f07758c62db415fbbf5f89c1f506f2c P 19f052b776cf4eab905fe3864bd9b39b: Deleting consensus metadata
I20260806 01:03:13.472148 13035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01e52e277e374b25805e266a13ac962f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:13.472481 12739 catalog_manager.cc:4841] TS 19f052b776cf4eab905fe3864bd9b39b (127.11.88.65:41483): tablet 5f07758c62db415fbbf5f89c1f506f2c (table test-table [id=1b63bcd2af374b2186362f961cc3fe49]) successfully deleted
I20260806 01:03:13.473923 13270 tablet_bootstrap.cc:492] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e: Bootstrap starting.
I20260806 01:03:13.474272 13272 tablet_bootstrap.cc:492] T 01e52e277e374b25805e266a13ac962f P 19f052b776cf4eab905fe3864bd9b39b: No bootstrap required, opened a new log
I20260806 01:03:13.474334 13272 ts_tablet_manager.cc:1397] T 01e52e277e374b25805e266a13ac962f P 19f052b776cf4eab905fe3864bd9b39b: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260806 01:03:13.474548 13270 tablet_bootstrap.cc:654] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:13.474685 13272 raft_consensus.cc:348] T 01e52e277e374b25805e266a13ac962f P 19f052b776cf4eab905fe3864bd9b39b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } }
I20260806 01:03:13.474799 13272 raft_consensus.cc:374] T 01e52e277e374b25805e266a13ac962f P 19f052b776cf4eab905fe3864bd9b39b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:13.474824 13272 raft_consensus.cc:729] T 01e52e277e374b25805e266a13ac962f P 19f052b776cf4eab905fe3864bd9b39b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f052b776cf4eab905fe3864bd9b39b, State: Initialized, Role: FOLLOWER
I20260806 01:03:13.474875 13272 consensus_queue.cc:260] T 01e52e277e374b25805e266a13ac962f P 19f052b776cf4eab905fe3864bd9b39b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } }
I20260806 01:03:13.474980 13272 ts_tablet_manager.cc:1428] T 01e52e277e374b25805e266a13ac962f P 19f052b776cf4eab905fe3864bd9b39b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 01:03:13.475575 12740 catalog_manager.cc:4841] TS 60227589063346bd853c2444af4f933e (127.11.88.66:42641): tablet 5f07758c62db415fbbf5f89c1f506f2c (table test-table [id=1b63bcd2af374b2186362f961cc3fe49]) successfully deleted
I20260806 01:03:13.476011 13270 tablet_bootstrap.cc:492] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e: No bootstrap required, opened a new log
I20260806 01:03:13.476002 13292 tablet_replica.cc:330] T 5f07758c62db415fbbf5f89c1f506f2c P 4cb1ac25f47844e1a6ffc92b935fcf05: stopping tablet replica
I20260806 01:03:13.476068 13270 ts_tablet_manager.cc:1397] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 01:03:13.476166 13292 raft_consensus.cc:2229] T 5f07758c62db415fbbf5f89c1f506f2c P 4cb1ac25f47844e1a6ffc92b935fcf05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:03:13.476402 13292 raft_consensus.cc:2258] T 5f07758c62db415fbbf5f89c1f506f2c P 4cb1ac25f47844e1a6ffc92b935fcf05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:13.476428 13270 raft_consensus.cc:348] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } }
I20260806 01:03:13.476493 13270 raft_consensus.cc:374] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:13.476531 13270 raft_consensus.cc:729] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60227589063346bd853c2444af4f933e, State: Initialized, Role: FOLLOWER
I20260806 01:03:13.476577 13270 consensus_queue.cc:260] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } }
I20260806 01:03:13.476691 13270 ts_tablet_manager.cc:1428] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:13.477038 13292 ts_tablet_manager.cc:1905] T 5f07758c62db415fbbf5f89c1f506f2c P 4cb1ac25f47844e1a6ffc92b935fcf05: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:13.477430 13269 tablet_bootstrap.cc:492] T 01e52e277e374b25805e266a13ac962f P 4cb1ac25f47844e1a6ffc92b935fcf05: No bootstrap required, opened a new log
I20260806 01:03:13.477483 13269 ts_tablet_manager.cc:1397] T 01e52e277e374b25805e266a13ac962f P 4cb1ac25f47844e1a6ffc92b935fcf05: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20260806 01:03:13.477720 13269 raft_consensus.cc:348] T 01e52e277e374b25805e266a13ac962f P 4cb1ac25f47844e1a6ffc92b935fcf05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } }
I20260806 01:03:13.477784 13269 raft_consensus.cc:374] T 01e52e277e374b25805e266a13ac962f P 4cb1ac25f47844e1a6ffc92b935fcf05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:13.477798 13269 raft_consensus.cc:729] T 01e52e277e374b25805e266a13ac962f P 4cb1ac25f47844e1a6ffc92b935fcf05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cb1ac25f47844e1a6ffc92b935fcf05, State: Initialized, Role: FOLLOWER
I20260806 01:03:13.477886 13269 consensus_queue.cc:260] T 01e52e277e374b25805e266a13ac962f P 4cb1ac25f47844e1a6ffc92b935fcf05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } }
I20260806 01:03:13.478109 13269 ts_tablet_manager.cc:1428] T 01e52e277e374b25805e266a13ac962f P 4cb1ac25f47844e1a6ffc92b935fcf05: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260806 01:03:13.479451 13292 ts_tablet_manager.cc:1918] T 5f07758c62db415fbbf5f89c1f506f2c P 4cb1ac25f47844e1a6ffc92b935fcf05: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:03:13.479528 13292 log.cc:1196] T 5f07758c62db415fbbf5f89c1f506f2c P 4cb1ac25f47844e1a6ffc92b935fcf05: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-2/wal/wals/5f07758c62db415fbbf5f89c1f506f2c
I20260806 01:03:13.479773 13292 ts_tablet_manager.cc:1939] T 5f07758c62db415fbbf5f89c1f506f2c P 4cb1ac25f47844e1a6ffc92b935fcf05: Deleting consensus metadata
I20260806 01:03:13.480235 12738 catalog_manager.cc:4841] TS 4cb1ac25f47844e1a6ffc92b935fcf05 (127.11.88.67:34675): tablet 5f07758c62db415fbbf5f89c1f506f2c (table test-table [id=1b63bcd2af374b2186362f961cc3fe49]) successfully deleted
I20260806 01:03:13.597295 13289 raft_consensus.cc:482] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:03:13.597424 13289 raft_consensus.cc:504] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } }
I20260806 01:03:13.598119 13196 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01e52e277e374b25805e266a13ac962f" candidate_uuid: "60227589063346bd853c2444af4f933e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" is_pre_election: true
I20260806 01:03:13.598268 13196 raft_consensus.cc:2454] T 01e52e277e374b25805e266a13ac962f P 4cb1ac25f47844e1a6ffc92b935fcf05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60227589063346bd853c2444af4f933e in term 0.
I20260806 01:03:13.598459 12913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01e52e277e374b25805e266a13ac962f" candidate_uuid: "60227589063346bd853c2444af4f933e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f052b776cf4eab905fe3864bd9b39b" is_pre_election: true
I20260806 01:03:13.598558 12913 raft_consensus.cc:2454] T 01e52e277e374b25805e266a13ac962f P 19f052b776cf4eab905fe3864bd9b39b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60227589063346bd853c2444af4f933e in term 0.
I20260806 01:03:13.597750 13289 leader_election.cc:288] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19f052b776cf4eab905fe3864bd9b39b (127.11.88.65:41483), 4cb1ac25f47844e1a6ffc92b935fcf05 (127.11.88.67:34675)
I20260806 01:03:13.598621 12986 leader_election.cc:302] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cb1ac25f47844e1a6ffc92b935fcf05, 60227589063346bd853c2444af4f933e; no voters:
I20260806 01:03:13.598866 13289 raft_consensus.cc:2781] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:03:13.598905 13289 raft_consensus.cc:482] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:03:13.598927 13289 raft_consensus.cc:3037] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:13.600888 13289 raft_consensus.cc:504] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } }
I20260806 01:03:13.601181 13289 leader_election.cc:288] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e [CANDIDATE]: Term 1 election: Requested vote from peers 19f052b776cf4eab905fe3864bd9b39b (127.11.88.65:41483), 4cb1ac25f47844e1a6ffc92b935fcf05 (127.11.88.67:34675)
I20260806 01:03:13.601368 12913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01e52e277e374b25805e266a13ac962f" candidate_uuid: "60227589063346bd853c2444af4f933e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19f052b776cf4eab905fe3864bd9b39b"
I20260806 01:03:13.601469 12913 raft_consensus.cc:3037] T 01e52e277e374b25805e266a13ac962f P 19f052b776cf4eab905fe3864bd9b39b [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:13.601943 13196 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01e52e277e374b25805e266a13ac962f" candidate_uuid: "60227589063346bd853c2444af4f933e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05"
I20260806 01:03:13.602061 13196 raft_consensus.cc:3037] T 01e52e277e374b25805e266a13ac962f P 4cb1ac25f47844e1a6ffc92b935fcf05 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:13.602598 12913 raft_consensus.cc:2454] T 01e52e277e374b25805e266a13ac962f P 19f052b776cf4eab905fe3864bd9b39b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60227589063346bd853c2444af4f933e in term 1.
I20260806 01:03:13.602891 13196 raft_consensus.cc:2454] T 01e52e277e374b25805e266a13ac962f P 4cb1ac25f47844e1a6ffc92b935fcf05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60227589063346bd853c2444af4f933e in term 1.
I20260806 01:03:13.602963 12987 leader_election.cc:302] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f052b776cf4eab905fe3864bd9b39b, 60227589063346bd853c2444af4f933e; no voters:
I20260806 01:03:13.603087 13289 raft_consensus.cc:2781] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:13.603154 13289 raft_consensus.cc:686] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e [term 1 LEADER]: Becoming Leader. State: Replica: 60227589063346bd853c2444af4f933e, State: Running, Role: LEADER
I20260806 01:03:13.603214 13289 consensus_queue.cc:237] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } }
I20260806 01:03:13.603958 12752 catalog_manager.cc:5495] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e reported cstate change: term changed from 0 to 1, leader changed from <none> to 60227589063346bd853c2444af4f933e (127.11.88.66). New cstate: current_term: 1 leader_uuid: "60227589063346bd853c2444af4f933e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } health_report { overall_health: UNKNOWN } } }
W20260806 01:03:13.620114 13247 tablet.cc:2369] T 01e52e277e374b25805e266a13ac962f P 4cb1ac25f47844e1a6ffc92b935fcf05: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 06 01:03:13 dist-test-slave-69rg krb5kdc[12708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978192, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:13.650429 12803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.642797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53202 (local address 127.11.88.126:40069)
0806 01:03:13.642863 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:13.642865 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:13.643091 (+ 226us) server_negotiation.cc:407] Connection header received
0806 01:03:13.643175 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:13.643176 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:13.643207 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:13.643267 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:13.643824 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.644326 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.645032 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.645217 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.645293 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.647665 (+ 2372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:13.647667 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:13.647667 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:13.647674 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:13.649107 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:13.649526 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:13.649527 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:13.649527 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:13.649586 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:13.649783 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:13.649784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:13.649784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:13.649951 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:13.650027 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:13.650202 (+ 175us) server_negotiation.cc:299] Negotiation successful
0806 01:03:13.650311 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":15,"server-negotiator.queue_time_us":35}
I20260806 01:03:13.650555 13304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.642745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:40069 (local address 127.0.0.1:53202)
0806 01:03:13.643012 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:13.643022 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:13.643111 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:13.643274 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:13.643275 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:13.643662 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:13.643726 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.643729 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.644412 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.644413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.644937 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.644938 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.645293 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.645294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.645346 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.646004 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:13.646009 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:13.647565 (+ 1556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:13.649231 (+ 1666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:13.649240 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:13.649242 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:13.649448 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:13.649652 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:13.649653 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:13.649653 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:13.649718 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:13.650017 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:13.650025 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:13.650075 (+ 50us) client_negotiation.cc:769] Sending connection context
0806 01:03:13.650174 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 01:03:13.650369 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"mutex_wait_us":73,"thread_start_us":126,"threads_started":1}
I20260806 01:03:13.653148 12752 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:53202:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 01:03:13.653432 12752 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:03:13.655105 12893 tablet_service.cc:1467] Processing CreateTablet for tablet b278ee18cb2e43dca1e48b9a1b48a4ac (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5bb87ce0b8d248a5a3caae405196bea3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 01:03:13.655088 13035 tablet_service.cc:1467] Processing CreateTablet for tablet b278ee18cb2e43dca1e48b9a1b48a4ac (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5bb87ce0b8d248a5a3caae405196bea3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 01:03:13.655119 13179 tablet_service.cc:1467] Processing CreateTablet for tablet b278ee18cb2e43dca1e48b9a1b48a4ac (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5bb87ce0b8d248a5a3caae405196bea3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 01:03:13.655268 13179 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b278ee18cb2e43dca1e48b9a1b48a4ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:13.655268 13035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b278ee18cb2e43dca1e48b9a1b48a4ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:13.655292 12893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b278ee18cb2e43dca1e48b9a1b48a4ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:13.658712 13270 tablet_bootstrap.cc:492] T b278ee18cb2e43dca1e48b9a1b48a4ac P 60227589063346bd853c2444af4f933e: Bootstrap starting.
I20260806 01:03:13.659438 13270 tablet_bootstrap.cc:654] T b278ee18cb2e43dca1e48b9a1b48a4ac P 60227589063346bd853c2444af4f933e: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:13.660270 13270 tablet_bootstrap.cc:492] T b278ee18cb2e43dca1e48b9a1b48a4ac P 60227589063346bd853c2444af4f933e: No bootstrap required, opened a new log
I20260806 01:03:13.660344 13270 ts_tablet_manager.cc:1397] T b278ee18cb2e43dca1e48b9a1b48a4ac P 60227589063346bd853c2444af4f933e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 01:03:13.660545 13272 tablet_bootstrap.cc:492] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b: Bootstrap starting.
I20260806 01:03:13.660501 13270 raft_consensus.cc:348] T b278ee18cb2e43dca1e48b9a1b48a4ac P 60227589063346bd853c2444af4f933e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } }
I20260806 01:03:13.660595 13270 raft_consensus.cc:374] T b278ee18cb2e43dca1e48b9a1b48a4ac P 60227589063346bd853c2444af4f933e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:13.660619 13270 raft_consensus.cc:729] T b278ee18cb2e43dca1e48b9a1b48a4ac P 60227589063346bd853c2444af4f933e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60227589063346bd853c2444af4f933e, State: Initialized, Role: FOLLOWER
I20260806 01:03:13.660687 13270 consensus_queue.cc:260] T b278ee18cb2e43dca1e48b9a1b48a4ac P 60227589063346bd853c2444af4f933e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } }
I20260806 01:03:13.660821 13270 ts_tablet_manager.cc:1428] T b278ee18cb2e43dca1e48b9a1b48a4ac P 60227589063346bd853c2444af4f933e: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260806 01:03:13.660854 13289 tablet_replica.cc:439] T b278ee18cb2e43dca1e48b9a1b48a4ac P 60227589063346bd853c2444af4f933e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } } }
I20260806 01:03:13.660964 13289 tablet_replica.cc:442] T b278ee18cb2e43dca1e48b9a1b48a4ac P 60227589063346bd853c2444af4f933e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 01:03:13.661337 13269 tablet_bootstrap.cc:492] T b278ee18cb2e43dca1e48b9a1b48a4ac P 4cb1ac25f47844e1a6ffc92b935fcf05: Bootstrap starting.
I20260806 01:03:13.661686 13272 tablet_bootstrap.cc:654] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:13.662364 13269 tablet_bootstrap.cc:654] T b278ee18cb2e43dca1e48b9a1b48a4ac P 4cb1ac25f47844e1a6ffc92b935fcf05: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:13.663414 13272 tablet_bootstrap.cc:492] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b: No bootstrap required, opened a new log
I20260806 01:03:13.663499 13272 ts_tablet_manager.cc:1397] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260806 01:03:13.663620 13269 tablet_bootstrap.cc:492] T b278ee18cb2e43dca1e48b9a1b48a4ac P 4cb1ac25f47844e1a6ffc92b935fcf05: No bootstrap required, opened a new log
I20260806 01:03:13.663674 13269 ts_tablet_manager.cc:1397] T b278ee18cb2e43dca1e48b9a1b48a4ac P 4cb1ac25f47844e1a6ffc92b935fcf05: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260806 01:03:13.663897 13272 raft_consensus.cc:348] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } }
I20260806 01:03:13.663995 13272 raft_consensus.cc:374] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:13.664019 13272 raft_consensus.cc:729] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f052b776cf4eab905fe3864bd9b39b, State: Initialized, Role: FOLLOWER
I20260806 01:03:13.664075 13272 consensus_queue.cc:260] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } }
I20260806 01:03:13.664040 13269 raft_consensus.cc:348] T b278ee18cb2e43dca1e48b9a1b48a4ac P 4cb1ac25f47844e1a6ffc92b935fcf05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } }
I20260806 01:03:13.664183 13272 ts_tablet_manager.cc:1428] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 01:03:13.664196 13269 raft_consensus.cc:374] T b278ee18cb2e43dca1e48b9a1b48a4ac P 4cb1ac25f47844e1a6ffc92b935fcf05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:13.664225 13269 raft_consensus.cc:729] T b278ee18cb2e43dca1e48b9a1b48a4ac P 4cb1ac25f47844e1a6ffc92b935fcf05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cb1ac25f47844e1a6ffc92b935fcf05, State: Initialized, Role: FOLLOWER
I20260806 01:03:13.664270 13269 consensus_queue.cc:260] T b278ee18cb2e43dca1e48b9a1b48a4ac P 4cb1ac25f47844e1a6ffc92b935fcf05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } }
I20260806 01:03:13.664388 13269 ts_tablet_manager.cc:1428] T b278ee18cb2e43dca1e48b9a1b48a4ac P 4cb1ac25f47844e1a6ffc92b935fcf05: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260806 01:03:13.664330 13277 tablet_replica.cc:439] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } } }
I20260806 01:03:13.664582 13277 tablet_replica.cc:442] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 01:03:13.664840 13274 tablet_replica.cc:439] T b278ee18cb2e43dca1e48b9a1b48a4ac P 4cb1ac25f47844e1a6ffc92b935fcf05: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } } }
I20260806 01:03:13.665015 13274 tablet_replica.cc:442] T b278ee18cb2e43dca1e48b9a1b48a4ac P 4cb1ac25f47844e1a6ffc92b935fcf05: This TxnStatusTablet replica's current role is: FOLLOWER
W20260806 01:03:13.666327 13104 tablet.cc:2369] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 01:03:13.717461 12961 tablet.cc:2369] T 01e52e277e374b25805e266a13ac962f P 19f052b776cf4eab905fe3864bd9b39b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 01:03:13.880324 13277 raft_consensus.cc:482] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:03:13.880440 13277 raft_consensus.cc:504] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } }
I20260806 01:03:13.880889 13277 leader_election.cc:288] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60227589063346bd853c2444af4f933e (127.11.88.66:42641), 4cb1ac25f47844e1a6ffc92b935fcf05 (127.11.88.67:34675)
I20260806 01:03:13.884572 13265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.881194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:56841 (local address 127.11.88.67:34675)
0806 01:03:13.881252 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:13.881254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:13.881377 (+ 123us) server_negotiation.cc:407] Connection header received
0806 01:03:13.881480 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:13.881481 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:13.881493 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:13.881566 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:13.881864 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.882355 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.883583 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.884033 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.884091 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.884099 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:13.884432 (+ 333us) server_negotiation.cc:299] Negotiation successful
0806 01:03:13.884478 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 01:03:13.884582 13308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.881110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:34675 (local address 127.11.88.65:56841)
0806 01:03:13.881283 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:13.881298 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:13.881396 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:13.881586 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:13.881587 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:13.881590 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:13.881747 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.881749 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.882451 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.882452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.883470 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.883474 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.884145 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.884147 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.884344 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.884350 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 01:03:13.884408 (+ 58us) client_negotiation.cc:240] Negotiation successful
0806 01:03:13.884464 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":90,"threads_started":1}
I20260806 01:03:13.884815 13268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.881301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:54497 (local address 127.11.88.66:42641)
0806 01:03:13.881380 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:13.881382 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:13.881409 (+ 27us) server_negotiation.cc:407] Connection header received
0806 01:03:13.881479 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:13.881480 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:13.881492 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:13.881584 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:13.881974 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.882441 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.883824 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.884302 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.884402 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.884413 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:13.884652 (+ 239us) server_negotiation.cc:299] Negotiation successful
0806 01:03:13.884738 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 01:03:13.884838 13196 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b278ee18cb2e43dca1e48b9a1b48a4ac" candidate_uuid: "19f052b776cf4eab905fe3864bd9b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" is_pre_election: true
I20260806 01:03:13.884948 13196 raft_consensus.cc:2454] T b278ee18cb2e43dca1e48b9a1b48a4ac P 4cb1ac25f47844e1a6ffc92b935fcf05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f052b776cf4eab905fe3864bd9b39b in term 0.
I20260806 01:03:13.885185 13309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.881122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:42641 (local address 127.11.88.65:54497)
0806 01:03:13.881338 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:13.881351 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:13.881407 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:13.881765 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:13.881766 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:13.881768 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:13.881892 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.881893 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.882538 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.882539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.883721 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.883724 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.884431 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.884433 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.884559 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.884564 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 01:03:13.884628 (+ 64us) client_negotiation.cc:240] Negotiation successful
0806 01:03:13.884840 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":71,"threads_started":1}
I20260806 01:03:13.885316 12844 leader_election.cc:302] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f052b776cf4eab905fe3864bd9b39b, 4cb1ac25f47844e1a6ffc92b935fcf05; no voters:
I20260806 01:03:13.885455 13277 raft_consensus.cc:2781] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:03:13.885481 13277 raft_consensus.cc:482] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:03:13.885500 13277 raft_consensus.cc:3037] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:13.885457 13055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b278ee18cb2e43dca1e48b9a1b48a4ac" candidate_uuid: "19f052b776cf4eab905fe3864bd9b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60227589063346bd853c2444af4f933e" is_pre_election: true
I20260806 01:03:13.885706 13055 raft_consensus.cc:2454] T b278ee18cb2e43dca1e48b9a1b48a4ac P 60227589063346bd853c2444af4f933e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19f052b776cf4eab905fe3864bd9b39b in term 0.
I20260806 01:03:13.886497 13277 raft_consensus.cc:504] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } }
I20260806 01:03:13.886679 13277 leader_election.cc:288] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b [CANDIDATE]: Term 1 election: Requested vote from peers 60227589063346bd853c2444af4f933e (127.11.88.66:42641), 4cb1ac25f47844e1a6ffc92b935fcf05 (127.11.88.67:34675)
I20260806 01:03:13.886826 13055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b278ee18cb2e43dca1e48b9a1b48a4ac" candidate_uuid: "19f052b776cf4eab905fe3864bd9b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60227589063346bd853c2444af4f933e"
I20260806 01:03:13.886833 13196 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b278ee18cb2e43dca1e48b9a1b48a4ac" candidate_uuid: "19f052b776cf4eab905fe3864bd9b39b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05"
I20260806 01:03:13.886904 13055 raft_consensus.cc:3037] T b278ee18cb2e43dca1e48b9a1b48a4ac P 60227589063346bd853c2444af4f933e [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:13.886904 13196 raft_consensus.cc:3037] T b278ee18cb2e43dca1e48b9a1b48a4ac P 4cb1ac25f47844e1a6ffc92b935fcf05 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:13.887719 13196 raft_consensus.cc:2454] T b278ee18cb2e43dca1e48b9a1b48a4ac P 4cb1ac25f47844e1a6ffc92b935fcf05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f052b776cf4eab905fe3864bd9b39b in term 1.
I20260806 01:03:13.887933 13055 raft_consensus.cc:2454] T b278ee18cb2e43dca1e48b9a1b48a4ac P 60227589063346bd853c2444af4f933e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19f052b776cf4eab905fe3864bd9b39b in term 1.
I20260806 01:03:13.887923 12844 leader_election.cc:302] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19f052b776cf4eab905fe3864bd9b39b, 4cb1ac25f47844e1a6ffc92b935fcf05; no voters:
I20260806 01:03:13.888023 13277 raft_consensus.cc:2781] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:13.888178 13277 raft_consensus.cc:686] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b [term 1 LEADER]: Becoming Leader. State: Replica: 19f052b776cf4eab905fe3864bd9b39b, State: Running, Role: LEADER
I20260806 01:03:13.888337 13277 consensus_queue.cc:237] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } }
I20260806 01:03:13.888818 13310 tablet_replica.cc:439] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b: TxnStatusTablet state changed. Reason: New leader 19f052b776cf4eab905fe3864bd9b39b. Latest consensus state: current_term: 1 leader_uuid: "19f052b776cf4eab905fe3864bd9b39b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } } }
I20260806 01:03:13.888942 13310 tablet_replica.cc:442] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b: This TxnStatusTablet replica's current role is: LEADER
I20260806 01:03:13.889214 13312 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 01:03:13.889354 13312 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 01:03:13.889261 12752 catalog_manager.cc:5495] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b reported cstate change: term changed from 0 to 1, leader changed from <none> to 19f052b776cf4eab905fe3864bd9b39b (127.11.88.65). New cstate: current_term: 1 leader_uuid: "19f052b776cf4eab905fe3864bd9b39b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } health_report { overall_health: UNKNOWN } } }
I20260806 01:03:13.948632 13304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.945460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:41483 (local address 127.0.0.1:34076)
0806 01:03:13.945569 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:13.945592 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:13.945666 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:13.945992 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:13.945993 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:13.945994 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 01:03:13.946054 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.946057 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.947015 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.947016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.947603 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.947605 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.948044 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.948045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.948126 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.948150 (+ 24us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 01:03:13.948434 (+ 284us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 01:03:13.948445 (+ 11us) client_negotiation.cc:769] Sending connection context
0806 01:03:13.948490 (+ 45us) client_negotiation.cc:240] Negotiation successful
0806 01:03:13.948556 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260806 01:03:13.948827 13315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.945624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34076 (local address 127.11.88.65:41483)
0806 01:03:13.945788 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:13.945789 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:13.945797 (+ 8us) server_negotiation.cc:407] Connection header received
0806 01:03:13.945879 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:13.945879 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:13.945900 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:13.945985 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:03:13.946182 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.946921 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.947690 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.947960 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.948042 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.948252 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:03:13.948365 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:03:13.948449 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:13.948504 (+ 55us) server_negotiation.cc:299] Negotiation successful
0806 01:03:13.948527 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":80,"threads_started":1}
I20260806 01:03:13.950080 13196 raft_consensus.cc:1261] T b278ee18cb2e43dca1e48b9a1b48a4ac P 4cb1ac25f47844e1a6ffc92b935fcf05 [term 1 FOLLOWER]: Refusing update from remote peer 19f052b776cf4eab905fe3864bd9b39b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:13.950197 13055 raft_consensus.cc:1261] T b278ee18cb2e43dca1e48b9a1b48a4ac P 60227589063346bd853c2444af4f933e [term 1 FOLLOWER]: Refusing update from remote peer 19f052b776cf4eab905fe3864bd9b39b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:13.950523 13277 consensus_queue.cc:1035] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:13.950697 13310 consensus_queue.cc:1035] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b [LEADER]: Connected to new peer: Peer: permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:13.951179 13274 tablet_replica.cc:439] T b278ee18cb2e43dca1e48b9a1b48a4ac P 4cb1ac25f47844e1a6ffc92b935fcf05: TxnStatusTablet state changed. Reason: New leader 19f052b776cf4eab905fe3864bd9b39b. Latest consensus state: current_term: 1 leader_uuid: "19f052b776cf4eab905fe3864bd9b39b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } } }
I20260806 01:03:13.951313 13274 tablet_replica.cc:442] T b278ee18cb2e43dca1e48b9a1b48a4ac P 4cb1ac25f47844e1a6ffc92b935fcf05: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 01:03:13.951283 13289 tablet_replica.cc:439] T b278ee18cb2e43dca1e48b9a1b48a4ac P 60227589063346bd853c2444af4f933e: TxnStatusTablet state changed. Reason: New leader 19f052b776cf4eab905fe3864bd9b39b. Latest consensus state: current_term: 1 leader_uuid: "19f052b776cf4eab905fe3864bd9b39b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } } }
I20260806 01:03:13.951373 13289 tablet_replica.cc:442] T b278ee18cb2e43dca1e48b9a1b48a4ac P 60227589063346bd853c2444af4f933e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 01:03:13.952337 13277 tablet_replica.cc:439] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "19f052b776cf4eab905fe3864bd9b39b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } } }
I20260806 01:03:13.952430 13277 tablet_replica.cc:442] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b: This TxnStatusTablet replica's current role is: LEADER
I20260806 01:03:13.952533 13289 tablet_replica.cc:439] T b278ee18cb2e43dca1e48b9a1b48a4ac P 60227589063346bd853c2444af4f933e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "19f052b776cf4eab905fe3864bd9b39b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } } }
I20260806 01:03:13.952623 13289 tablet_replica.cc:442] T b278ee18cb2e43dca1e48b9a1b48a4ac P 60227589063346bd853c2444af4f933e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 01:03:13.952924 13310 tablet_replica.cc:439] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "19f052b776cf4eab905fe3864bd9b39b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } } }
I20260806 01:03:13.952998 13310 tablet_replica.cc:442] T b278ee18cb2e43dca1e48b9a1b48a4ac P 19f052b776cf4eab905fe3864bd9b39b: This TxnStatusTablet replica's current role is: LEADER
I20260806 01:03:13.953577 13283 mvcc.cc:205] Tried to move back new op lower bound from 7315366682417094656 to 7315366682167271424. Current Snapshot: MvccSnapshot[applied={T|T < 7315366682417094656}]
I20260806 01:03:13.953696 13274 tablet_replica.cc:439] T b278ee18cb2e43dca1e48b9a1b48a4ac P 4cb1ac25f47844e1a6ffc92b935fcf05: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "19f052b776cf4eab905fe3864bd9b39b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 } } peers { permanent_uuid: "60227589063346bd853c2444af4f933e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42641 } } peers { permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 } } }
I20260806 01:03:13.953769 13274 tablet_replica.cc:442] T b278ee18cb2e43dca1e48b9a1b48a4ac P 4cb1ac25f47844e1a6ffc92b935fcf05: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 01:03:13.959959 13315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.957086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:45193 (local address 127.11.88.65:41483)
0806 01:03:13.957153 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:13.957155 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:13.957255 (+ 100us) server_negotiation.cc:407] Connection header received
0806 01:03:13.957316 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:13.957317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:13.957328 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:13.957375 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:03:13.957501 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.958112 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.959257 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.959470 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.959538 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.959726 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:03:13.959755 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:03:13.959800 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:13.959875 (+ 75us) server_negotiation.cc:299] Negotiation successful
0806 01:03:13.959895 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 01:03:13.960001 13321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.957024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:41483 (local address 127.11.88.66:45193)
0806 01:03:13.957183 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:13.957195 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:13.957258 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:13.957387 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:13.957388 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:13.957390 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 01:03:13.957445 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.957447 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.958183 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.958184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.959147 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.959150 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.959553 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.959554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.959621 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.959641 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 01:03:13.959818 (+ 177us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 01:03:13.959820 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 01:03:13.959872 (+ 52us) client_negotiation.cc:240] Negotiation successful
0806 01:03:13.959922 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":101,"threads_started":1}
I20260806 01:03:13.962520 13196 raft_consensus.cc:1261] T 01e52e277e374b25805e266a13ac962f P 4cb1ac25f47844e1a6ffc92b935fcf05 [term 1 FOLLOWER]: Refusing update from remote peer 60227589063346bd853c2444af4f933e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:13.962678 12913 raft_consensus.cc:1261] T 01e52e277e374b25805e266a13ac962f P 19f052b776cf4eab905fe3864bd9b39b [term 1 FOLLOWER]: Refusing update from remote peer 60227589063346bd853c2444af4f933e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:13.962832 13279 consensus_queue.cc:1035] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cb1ac25f47844e1a6ffc92b935fcf05" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:13.962957 13289 consensus_queue.cc:1035] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e [LEADER]: Connected to new peer: Peer: permanent_uuid: "19f052b776cf4eab905fe3864bd9b39b" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:13.974679 13268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.971530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:43215 (local address 127.11.88.66:42641)
0806 01:03:13.971571 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:13.971573 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:13.972173 (+ 600us) server_negotiation.cc:407] Connection header received
0806 01:03:13.972262 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:13.972263 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:13.972273 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:13.972300 (+ 27us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:03:13.972475 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.972964 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.973796 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.974043 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.974121 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.974298 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:03:13.974335 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:03:13.974387 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:13.974555 (+ 168us) server_negotiation.cc:299] Negotiation successful
0806 01:03:13.974583 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 01:03:13.974745 13326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.971489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:42641 (local address 127.11.88.65:43215)
0806 01:03:13.972086 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:13.972098 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:13.972181 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:13.972364 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:13.972364 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:13.972366 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 01:03:13.972406 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.972408 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.973077 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.973078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.973705 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:13.973707 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.974120 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.974120 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:13.974178 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.974195 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 01:03:13.974460 (+ 265us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 01:03:13.974463 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:03:13.974544 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 01:03:13.974595 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":169,"threads_started":1}
I20260806 01:03:13.985960 12753 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53194:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:13.986078 12753 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53194:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:13.986901 12753 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 029067fea74646a79885cc633f8d982b: Sending DeleteTablet for 3 replicas of tablet 01e52e277e374b25805e266a13ac962f
I20260806 01:03:13.987219 13035 tablet_service.cc:1514] Processing DeleteTablet for tablet 01e52e277e374b25805e266a13ac962f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:13 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:57714
I20260806 01:03:13.987264 13179 tablet_service.cc:1514] Processing DeleteTablet for tablet 01e52e277e374b25805e266a13ac962f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:13 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:48392
I20260806 01:03:13.987268 12893 tablet_service.cc:1514] Processing DeleteTablet for tablet 01e52e277e374b25805e266a13ac962f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:13 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:34068
I20260806 01:03:13.987548 13330 tablet_replica.cc:330] T 01e52e277e374b25805e266a13ac962f P 19f052b776cf4eab905fe3864bd9b39b: stopping tablet replica
I20260806 01:03:13.987622 13330 raft_consensus.cc:2229] T 01e52e277e374b25805e266a13ac962f P 19f052b776cf4eab905fe3864bd9b39b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:03:13.987681 13330 raft_consensus.cc:2258] T 01e52e277e374b25805e266a13ac962f P 19f052b776cf4eab905fe3864bd9b39b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:13.987936 13330 ts_tablet_manager.cc:1905] T 01e52e277e374b25805e266a13ac962f P 19f052b776cf4eab905fe3864bd9b39b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:13.988090 13328 tablet_replica.cc:330] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e: stopping tablet replica
I20260806 01:03:13.988166 13328 raft_consensus.cc:2229] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e [term 1 LEADER]: Raft consensus shutting down.
I20260806 01:03:13.988241 13328 raft_consensus.cc:2258] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:13.988616 13328 ts_tablet_manager.cc:1905] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:13.990535 13330 ts_tablet_manager.cc:1918] T 01e52e277e374b25805e266a13ac962f P 19f052b776cf4eab905fe3864bd9b39b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 01:03:13.990604 13330 log.cc:1196] T 01e52e277e374b25805e266a13ac962f P 19f052b776cf4eab905fe3864bd9b39b: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-0/wal/wals/01e52e277e374b25805e266a13ac962f
I20260806 01:03:13.990847 13330 ts_tablet_manager.cc:1939] T 01e52e277e374b25805e266a13ac962f P 19f052b776cf4eab905fe3864bd9b39b: Deleting consensus metadata
I20260806 01:03:13.991210 12739 catalog_manager.cc:4841] TS 19f052b776cf4eab905fe3864bd9b39b (127.11.88.65:41483): tablet 01e52e277e374b25805e266a13ac962f (table test-table [id=f639932f256d4d0abc332f7c318ecd70]) successfully deleted
I20260806 01:03:13.991361 13328 ts_tablet_manager.cc:1918] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 01:03:13.991425 13328 log.cc:1196] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-1/wal/wals/01e52e277e374b25805e266a13ac962f
I20260806 01:03:13.991660 13328 ts_tablet_manager.cc:1939] T 01e52e277e374b25805e266a13ac962f P 60227589063346bd853c2444af4f933e: Deleting consensus metadata
I20260806 01:03:13.992372 12740 catalog_manager.cc:4841] TS 60227589063346bd853c2444af4f933e (127.11.88.66:42641): tablet 01e52e277e374b25805e266a13ac962f (table test-table [id=f639932f256d4d0abc332f7c318ecd70]) successfully deleted
I20260806 01:03:13.993937 13329 tablet_replica.cc:330] T 01e52e277e374b25805e266a13ac962f P 4cb1ac25f47844e1a6ffc92b935fcf05: stopping tablet replica
I20260806 01:03:13.994022 13329 raft_consensus.cc:2229] T 01e52e277e374b25805e266a13ac962f P 4cb1ac25f47844e1a6ffc92b935fcf05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:03:13.994076 13329 raft_consensus.cc:2258] T 01e52e277e374b25805e266a13ac962f P 4cb1ac25f47844e1a6ffc92b935fcf05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:13.994338 13329 ts_tablet_manager.cc:1905] T 01e52e277e374b25805e266a13ac962f P 4cb1ac25f47844e1a6ffc92b935fcf05: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 06 01:03:13 dist-test-slave-69rg krb5kdc[12708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978193, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.88.65@KRBTEST.COM
I20260806 01:03:13.996088 13329 ts_tablet_manager.cc:1918] T 01e52e277e374b25805e266a13ac962f P 4cb1ac25f47844e1a6ffc92b935fcf05: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 01:03:13.996165 13329 log.cc:1196] T 01e52e277e374b25805e266a13ac962f P 4cb1ac25f47844e1a6ffc92b935fcf05: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785978186227899-11617-0/minicluster-data/ts-2/wal/wals/01e52e277e374b25805e266a13ac962f
I20260806 01:03:13.996443 13329 ts_tablet_manager.cc:1939] T 01e52e277e374b25805e266a13ac962f P 4cb1ac25f47844e1a6ffc92b935fcf05: Deleting consensus metadata
I20260806 01:03:13.997205 12738 catalog_manager.cc:4841] TS 4cb1ac25f47844e1a6ffc92b935fcf05 (127.11.88.67:34675): tablet 01e52e277e374b25805e266a13ac962f (table test-table [id=f639932f256d4d0abc332f7c318ecd70]) successfully deleted
I20260806 01:03:13.999894 13315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:13.988293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34084 (local address 127.11.88.65:41483)
0806 01:03:13.988344 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:13.988346 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:13.989008 (+ 662us) server_negotiation.cc:407] Connection header received
0806 01:03:13.989114 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:13.989115 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:13.989127 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:13.989158 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:13.990143 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.990861 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.992044 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:13.992322 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:13.992392 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:13.995694 (+ 3302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:13.995703 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:13.995703 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:13.995711 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:13.998347 (+ 2636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:13.998711 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:13.998714 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:13.998715 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:13.998908 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:13.999100 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:13.999101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:13.999101 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:13.999284 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:13.999517 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:13.999563 (+ 46us) server_negotiation.cc:299] Negotiation successful
0806 01:03:13.999660 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
W20260806 01:03:14.000257 12954 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34084
I20260806 01:03:14.008673 12803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:14.001511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53214 (local address 127.11.88.126:40069)
0806 01:03:14.001556 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:14.001558 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:14.001569 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:03:14.001626 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:14.001627 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:14.001638 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:14.001713 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:14.002245 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:14.002997 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:14.003702 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:14.003990 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:14.004072 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:14.005352 (+ 1280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:14.005354 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:14.005355 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:14.005363 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:14.007331 (+ 1968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:14.007705 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:14.007706 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:14.007706 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:14.007775 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:14.008042 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:14.008043 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:14.008044 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:14.008210 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:14.008318 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:14.008481 (+ 163us) server_negotiation.cc:299] Negotiation successful
0806 01:03:14.008573 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
W20260806 01:03:14.009055 12753 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53214
I20260806 01:03:14.009656 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 12826
I20260806 01:03:14.018627 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 12969
I20260806 01:03:14.026258 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 13112
I20260806 01:03:14.032151 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 12721
2026-08-06T01:03:14Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2754 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:03:14 dist-test-slave-69rg krb5kdc[13337](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:03:14 dist-test-slave-69rg krb5kdc[13337](info): set up 2 sockets
Aug 06 01:03:14 dist-test-slave-69rg krb5kdc[13337](info): commencing operation
krb5kdc: starting...
W20260806 01:03:15.114689 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:03:15 dist-test-slave-69rg krb5kdc[13337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978195, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:03:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:03:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:03:15.249718 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:45487
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:38221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:45487
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:15.334869 13351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:15.335100 13351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:15.335129 13351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:15.336408 13351 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:03:15.336459 13351 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 01:03:15.336473 13351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:15.336488 13351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:15.336499 13351 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:03:15.336512 13351 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:03:15.338182 13351 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:38221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:45487
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:45487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13351
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:15.338438 13351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:15.338650 13351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:15.345325 13359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:15.345336 13356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:15.345364 13351 server_base.cc:1034] running on GCE node
W20260806 01:03:15.345325 13357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:15.346325 13351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:15.346678 13351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:15.347863 13351 hybrid_clock.cc:648] HybridClock initialized: now 1785978195347844 us; error 33 us; skew 500 ppm
Aug 06 01:03:15 dist-test-slave-69rg krb5kdc[13337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978195, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:15.351504 13351 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:03:15.352128 13351 webserver.cc:460] Webserver started at http://127.11.88.126:46519/ using document root <none> and password file <none>
I20260806 01:03:15.352416 13351 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:15.352496 13351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:15.352674 13351 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:15.353978 13351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "2a3b965aa73948e4bae990dce3d66436"
format_stamp: "Formatted at 2026-08-06 01:03:15 on dist-test-slave-69rg"
server_key: "2a560142b94823d967593d6638453005"
server_key_iv: "20afc6b921cb2261e62703ecacb21694"
server_key_version: "encryptionkey@0"
I20260806 01:03:15.354414 13351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "2a3b965aa73948e4bae990dce3d66436"
format_stamp: "Formatted at 2026-08-06 01:03:15 on dist-test-slave-69rg"
server_key: "2a560142b94823d967593d6638453005"
server_key_iv: "20afc6b921cb2261e62703ecacb21694"
server_key_version: "encryptionkey@0"
I20260806 01:03:15.356112 13351 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 01:03:15.357067 13366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:15.357364 13351 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:15.357472 13351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "2a3b965aa73948e4bae990dce3d66436"
format_stamp: "Formatted at 2026-08-06 01:03:15 on dist-test-slave-69rg"
server_key: "2a560142b94823d967593d6638453005"
server_key_iv: "20afc6b921cb2261e62703ecacb21694"
server_key_version: "encryptionkey@0"
I20260806 01:03:15.357542 13351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:15.388198 13351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:15.390820 13351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:15.390959 13351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:15.396762 13351 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:45487
I20260806 01:03:15.396863 13430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:45487 every 8 connection(s)
I20260806 01:03:15.397281 13351 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:03:15.398175 13431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:15.400729 13431 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a3b965aa73948e4bae990dce3d66436: Bootstrap starting.
I20260806 01:03:15.401467 13431 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a3b965aa73948e4bae990dce3d66436: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:15.401799 13431 log.cc:824] T 00000000000000000000000000000000 P 2a3b965aa73948e4bae990dce3d66436: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:15.402773 13431 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a3b965aa73948e4bae990dce3d66436: No bootstrap required, opened a new log
I20260806 01:03:15.405169 13431 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a3b965aa73948e4bae990dce3d66436 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a3b965aa73948e4bae990dce3d66436" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45487 } }
I20260806 01:03:15.405370 13431 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a3b965aa73948e4bae990dce3d66436 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:15.405421 13431 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a3b965aa73948e4bae990dce3d66436 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a3b965aa73948e4bae990dce3d66436, State: Initialized, Role: FOLLOWER
I20260806 01:03:15.405622 13431 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a3b965aa73948e4bae990dce3d66436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a3b965aa73948e4bae990dce3d66436" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45487 } }
I20260806 01:03:15.405731 13431 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a3b965aa73948e4bae990dce3d66436 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:03:15.405839 13431 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a3b965aa73948e4bae990dce3d66436 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:03:15.405898 13431 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a3b965aa73948e4bae990dce3d66436 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:15.406080 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 13351
I20260806 01:03:15.406160 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:03:15.406337 11617 external_mini_cluster.cc:1428] Setting key 007c2b68936209f34d73174c126f1a2f
I20260806 01:03:15.406811 13431 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a3b965aa73948e4bae990dce3d66436 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a3b965aa73948e4bae990dce3d66436" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45487 } }
I20260806 01:03:15.406939 13431 leader_election.cc:302] T 00000000000000000000000000000000 P 2a3b965aa73948e4bae990dce3d66436 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a3b965aa73948e4bae990dce3d66436; no voters:
I20260806 01:03:15.407195 13431 leader_election.cc:288] T 00000000000000000000000000000000 P 2a3b965aa73948e4bae990dce3d66436 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:03:15.407289 13436 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a3b965aa73948e4bae990dce3d66436 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:15.407472 13436 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a3b965aa73948e4bae990dce3d66436 [term 1 LEADER]: Becoming Leader. State: Replica: 2a3b965aa73948e4bae990dce3d66436, State: Running, Role: LEADER
I20260806 01:03:15.407534 13431 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a3b965aa73948e4bae990dce3d66436 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:03:15.407572 13436 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a3b965aa73948e4bae990dce3d66436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a3b965aa73948e4bae990dce3d66436" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45487 } }
I20260806 01:03:15.407972 13438 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a3b965aa73948e4bae990dce3d66436 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a3b965aa73948e4bae990dce3d66436" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a3b965aa73948e4bae990dce3d66436" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45487 } } }
I20260806 01:03:15.408072 13438 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a3b965aa73948e4bae990dce3d66436 [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:15.408247 13439 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a3b965aa73948e4bae990dce3d66436 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a3b965aa73948e4bae990dce3d66436. Latest consensus state: current_term: 1 leader_uuid: "2a3b965aa73948e4bae990dce3d66436" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a3b965aa73948e4bae990dce3d66436" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45487 } } }
I20260806 01:03:15.408318 13439 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a3b965aa73948e4bae990dce3d66436 [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:15.408572 13445 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:03:15.409376 13445 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:03:15.411212 13445 catalog_manager.cc:1347] Generated new cluster ID: e544e4d48624438ca26fed934750f641
I20260806 01:03:15.411283 13445 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 01:03:15 dist-test-slave-69rg krb5kdc[13337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978195, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:15.419965 13437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:15.407021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52406 (local address 127.11.88.126:45487)
0806 01:03:15.407224 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:15.407235 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:15.407278 (+ 43us) server_negotiation.cc:407] Connection header received
0806 01:03:15.407761 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:15.407769 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:15.407835 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:15.407983 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:15.409317 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:15.410608 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:15.411704 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:15.412409 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:15.412548 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:15.415480 (+ 2932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:15.415485 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:15.415485 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:15.415499 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:15.418111 (+ 2612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:15.418589 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:15.418592 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:15.418592 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:15.418725 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:15.418960 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:15.418961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:15.418961 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:15.419290 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:15.419437 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:15.419569 (+ 132us) server_negotiation.cc:299] Negotiation successful
0806 01:03:15.419722 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":157,"threads_started":1}
I20260806 01:03:15.436177 13445 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:03:15.436856 13445 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:03:15.442046 13445 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a3b965aa73948e4bae990dce3d66436: Generated new TSK 0
I20260806 01:03:15.442293 13445 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.88.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
I20260806 01:03:15.473711 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:0
--local_ip_for_outbound_sockets=127.11.88.65
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:45487
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:38221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:15.561872 13458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:15.562117 13458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:15.562147 13458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:15.563498 13458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:15.563549 13458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:15.563572 13458 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 01:03:15.563584 13458 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 01:03:15.563602 13458 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:03:15.565207 13458 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:38221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.88.126:45487
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13458
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:15.565491 13458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:15.565761 13458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:15.571486 13463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:15.571473 13464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:15.571609 13458 server_base.cc:1034] running on GCE node
W20260806 01:03:15.571468 13466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:15.571982 13458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:15.572296 13458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:15.573495 13458 hybrid_clock.cc:648] HybridClock initialized: now 1785978195573455 us; error 95 us; skew 500 ppm
Aug 06 01:03:15 dist-test-slave-69rg krb5kdc[13337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978195, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:15.576483 13458 init.cc:377] Logged in from keytab as kudu/127.11.88.65@KRBTEST.COM (short username kudu)
I20260806 01:03:15.576985 13458 webserver.cc:460] Webserver started at http://127.11.88.65:38387/ using document root <none> and password file <none>
I20260806 01:03:15.577237 13458 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:15.577309 13458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:15.577472 13458 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:15.578679 13458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-0/data/instance:
uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6"
format_stamp: "Formatted at 2026-08-06 01:03:15 on dist-test-slave-69rg"
server_key: "f92d7c2a03fd9f288684e470eaa7fd1d"
server_key_iv: "c91fcbae4fc99feaca10185f96f23f23"
server_key_version: "encryptionkey@0"
I20260806 01:03:15.579062 13458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance:
uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6"
format_stamp: "Formatted at 2026-08-06 01:03:15 on dist-test-slave-69rg"
server_key: "f92d7c2a03fd9f288684e470eaa7fd1d"
server_key_iv: "c91fcbae4fc99feaca10185f96f23f23"
server_key_version: "encryptionkey@0"
I20260806 01:03:15.580585 13458 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 01:03:15.581559 13473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:15.581902 13458 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:03:15.582026 13458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6"
format_stamp: "Formatted at 2026-08-06 01:03:15 on dist-test-slave-69rg"
server_key: "f92d7c2a03fd9f288684e470eaa7fd1d"
server_key_iv: "c91fcbae4fc99feaca10185f96f23f23"
server_key_version: "encryptionkey@0"
I20260806 01:03:15.582118 13458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:15.591329 13458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:15.594194 13458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:15.594390 13458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:15.595005 13458 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:15.595075 13458 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:15.595110 13458 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:15.595144 13458 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 01:03:15 dist-test-slave-69rg krb5kdc[13337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978195, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:15.603242 13458 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:35507
I20260806 01:03:15.603330 13589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:35507 every 8 connection(s)
I20260806 01:03:15.603641 13458 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
I20260806 01:03:15.606454 13437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:15.595831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:58003 (local address 127.11.88.126:45487)
0806 01:03:15.595920 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:15.595923 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:15.596151 (+ 228us) server_negotiation.cc:407] Connection header received
0806 01:03:15.596826 (+ 675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:15.596828 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:15.596845 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:15.596926 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:15.598009 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:15.598909 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:15.600197 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:15.600472 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:15.600565 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:15.603203 (+ 2638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:15.603205 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:15.603206 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:15.603230 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:15.604822 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:15.605290 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:15.605291 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:15.605291 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:15.605362 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:15.605650 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:15.605651 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:15.605652 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:15.605821 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:15.605913 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:15.606260 (+ 347us) server_negotiation.cc:299] Negotiation successful
0806 01:03:15.606359 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 01:03:15.606659 13482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:15.595811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45487 (local address 127.11.88.65:58003)
0806 01:03:15.596013 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:15.596053 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:15.596623 (+ 570us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:15.597065 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:15.597070 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:15.597520 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:15.597879 (+ 359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:15.597886 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:15.599066 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:15.599067 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:15.600066 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:15.600070 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:15.600606 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:15.600607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:15.600762 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:15.601475 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:15.601484 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:15.603076 (+ 1592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:15.604909 (+ 1833us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:15.604916 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:15.604918 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:15.605161 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:15.605437 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:15.605438 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:15.605438 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:15.605590 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:15.605918 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:15.605926 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:15.606101 (+ 175us) client_negotiation.cc:769] Sending connection context
0806 01:03:15.606231 (+ 130us) client_negotiation.cc:240] Negotiation successful
0806 01:03:15.606409 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":97,"threads_started":1}
I20260806 01:03:15.608167 13590 heartbeater.cc:347] Connected to a master server at 127.11.88.126:45487
I20260806 01:03:15.608264 13590 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:15.608449 13590 heartbeater.cc:511] Master 127.11.88.126:45487 requested a full tablet report, sending...
I20260806 01:03:15.609083 13384 ts_manager.cc:194] Registered new tserver with Master: ea1d9db3a3c2481fa49f4d12de4e89c6 (127.11.88.65:35507)
I20260806 01:03:15.609634 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 13458
I20260806 01:03:15.609748 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance
I20260806 01:03:15.609964 11617 external_mini_cluster.cc:1428] Setting key d307560029d7b502acaece5ac08dd737
I20260806 01:03:15.610102 13384 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.65@KRBTEST.COM'} at 127.11.88.65:58003
I20260806 01:03:15.615219 13437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:15.608395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:34715 (local address 127.11.88.126:45487)
0806 01:03:15.608455 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:15.608457 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:15.608800 (+ 343us) server_negotiation.cc:407] Connection header received
0806 01:03:15.608867 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:15.608868 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:15.608876 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:15.608918 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:15.609318 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:15.610111 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:15.611011 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:15.611224 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:15.611302 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:15.612513 (+ 1211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:15.612514 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:15.612515 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:15.612521 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:15.613982 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:15.614386 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:15.614387 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:15.614387 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:15.614442 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:15.614662 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:15.614663 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:15.614663 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:15.614769 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:15.614853 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:15.615019 (+ 166us) server_negotiation.cc:299] Negotiation successful
0806 01:03:15.615108 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":35}
I20260806 01:03:15.615213 13596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:15.608560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45487 (local address 127.11.88.65:34715)
0806 01:03:15.608717 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:15.608727 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:15.608816 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:15.608924 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:15.608925 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:15.609143 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:15.609220 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:15.609223 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:15.610238 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:15.610239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:15.610927 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:15.610930 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:15.611300 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:15.611301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:15.611391 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:15.611911 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:15.611916 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:15.612415 (+ 499us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:15.614061 (+ 1646us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:15.614062 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:15.614063 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:15.614304 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:15.614516 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:15.614517 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:15.614517 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:15.614598 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:15.614847 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:15.614848 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:15.614901 (+ 53us) client_negotiation.cc:769] Sending connection context
0806 01:03:15.614991 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 01:03:15.615109 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":103,"threads_started":1}
WARNING: no policy specified for kudu/127.11.88.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
I20260806 01:03:15.642985 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:0
--local_ip_for_outbound_sockets=127.11.88.66
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:45487
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:38221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:15.739427 13599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:15.739679 13599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:15.739712 13599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:15.741263 13599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:15.741328 13599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:15.741353 13599 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 01:03:15.741366 13599 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 01:03:15.741386 13599 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:03:15.743289 13599 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:38221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.88.126:45487
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13599
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:15.743594 13599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:15.743865 13599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 01:03:15.750066 13599 server_base.cc:1034] running on GCE node
W20260806 01:03:15.749982 13605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:15.749938 13607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:15.749938 13604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:15.750492 13599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:15.750898 13599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:15.752174 13599 hybrid_clock.cc:648] HybridClock initialized: now 1785978195752239 us; error 163 us; skew 500 ppm
Aug 06 01:03:15 dist-test-slave-69rg krb5kdc[13337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978195, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:15.755260 13599 init.cc:377] Logged in from keytab as kudu/127.11.88.66@KRBTEST.COM (short username kudu)
I20260806 01:03:15.755831 13599 webserver.cc:460] Webserver started at http://127.11.88.66:32889/ using document root <none> and password file <none>
I20260806 01:03:15.756119 13599 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:15.756193 13599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:15.756348 13599 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:15.757512 13599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-1/data/instance:
uuid: "c47ae1cb0ea546699de4511eaa92a576"
format_stamp: "Formatted at 2026-08-06 01:03:15 on dist-test-slave-69rg"
server_key: "0560a6909309537d55eadcbef5b6c886"
server_key_iv: "34913a5b311ba08e5f1355ae103be685"
server_key_version: "encryptionkey@0"
I20260806 01:03:15.757969 13599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance:
uuid: "c47ae1cb0ea546699de4511eaa92a576"
format_stamp: "Formatted at 2026-08-06 01:03:15 on dist-test-slave-69rg"
server_key: "0560a6909309537d55eadcbef5b6c886"
server_key_iv: "34913a5b311ba08e5f1355ae103be685"
server_key_version: "encryptionkey@0"
I20260806 01:03:15.759569 13599 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:03:15.760442 13614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:15.760632 13599 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:15.760771 13599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "c47ae1cb0ea546699de4511eaa92a576"
format_stamp: "Formatted at 2026-08-06 01:03:15 on dist-test-slave-69rg"
server_key: "0560a6909309537d55eadcbef5b6c886"
server_key_iv: "34913a5b311ba08e5f1355ae103be685"
server_key_version: "encryptionkey@0"
I20260806 01:03:15.760857 13599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:15.772879 13599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:15.775373 13599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:15.775569 13599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:15.776289 13599 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:15.776350 13599 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:15.776384 13599 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:15.776405 13599 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:15.784327 13599 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:39565
Aug 06 01:03:15 dist-test-slave-69rg krb5kdc[13337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978195, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:15.784432 13730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:39565 every 8 connection(s)
I20260806 01:03:15.784811 13599 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
I20260806 01:03:15.788509 13437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:15.776865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:35899 (local address 127.11.88.126:45487)
0806 01:03:15.776945 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:15.776949 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:15.777239 (+ 290us) server_negotiation.cc:407] Connection header received
0806 01:03:15.778067 (+ 828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:15.778069 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:15.778084 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:15.778179 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:15.778928 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:15.779451 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:15.781345 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:15.781607 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:15.781733 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:15.785002 (+ 3269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:15.785004 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:15.785004 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:15.785016 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:15.786918 (+ 1902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:15.787482 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:15.787484 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:15.787485 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:15.787550 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:15.787844 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:15.787845 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:15.787845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:15.787977 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:15.788037 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:15.788358 (+ 321us) server_negotiation.cc:299] Negotiation successful
0806 01:03:15.788441 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 01:03:15.788673 13623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:15.776842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45487 (local address 127.11.88.66:35899)
0806 01:03:15.777070 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:15.777122 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:15.777923 (+ 801us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:15.778284 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:15.778289 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:15.778592 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:15.778814 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:15.778819 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:15.779606 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:15.779607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:15.781138 (+ 1531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:15.781143 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:15.781769 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:15.781770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:15.781967 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:15.783069 (+ 1102us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:15.783079 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:15.784878 (+ 1799us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:15.787088 (+ 2210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:15.787097 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:15.787099 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:15.787390 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:15.787645 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:15.787645 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:15.787646 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:15.787773 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:15.788041 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:15.788046 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:15.788179 (+ 133us) client_negotiation.cc:769] Sending connection context
0806 01:03:15.788274 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 01:03:15.788421 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":116,"threads_started":1}
I20260806 01:03:15.789254 13731 heartbeater.cc:347] Connected to a master server at 127.11.88.126:45487
I20260806 01:03:15.789345 13731 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:15.789566 13731 heartbeater.cc:511] Master 127.11.88.126:45487 requested a full tablet report, sending...
I20260806 01:03:15.789880 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 13599
I20260806 01:03:15.789984 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance
I20260806 01:03:15.790175 11617 external_mini_cluster.cc:1428] Setting key 2f4a8cbab92379577fc0f694df9ce2ac
I20260806 01:03:15.790844 13385 ts_manager.cc:194] Registered new tserver with Master: c47ae1cb0ea546699de4511eaa92a576 (127.11.88.66:39565)
I20260806 01:03:15.791352 13385 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.66@KRBTEST.COM'} at 127.11.88.66:35899
I20260806 01:03:15.797395 13437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:15.790559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:59295 (local address 127.11.88.126:45487)
0806 01:03:15.790613 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:15.790615 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:15.790703 (+ 88us) server_negotiation.cc:407] Connection header received
0806 01:03:15.790766 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:15.790767 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:15.790776 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:15.790850 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:15.791258 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:15.791909 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:15.792987 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:15.793217 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:15.793354 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:15.794529 (+ 1175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:15.794531 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:15.794531 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:15.794539 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:15.796065 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:15.796458 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:15.796460 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:15.796460 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:15.796526 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:15.796743 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:15.796744 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:15.796744 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:15.796921 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:15.797005 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:15.797187 (+ 182us) server_negotiation.cc:299] Negotiation successful
0806 01:03:15.797289 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 01:03:15.797411 13738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:15.790440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45487 (local address 127.11.88.66:59295)
0806 01:03:15.790642 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:15.790655 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:15.790719 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:15.790858 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:15.790859 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:15.791094 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:15.791168 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:15.791170 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:15.792009 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:15.792010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:15.792712 (+ 702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:15.792716 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:15.793359 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:15.793360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:15.793439 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:15.794042 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:15.794048 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:15.794392 (+ 344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:15.796165 (+ 1773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:15.796166 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:15.796167 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:15.796374 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:15.796602 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:15.796602 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:15.796603 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:15.796677 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:15.796996 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:15.796997 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:15.797053 (+ 56us) client_negotiation.cc:769] Sending connection context
0806 01:03:15.797157 (+ 104us) client_negotiation.cc:240] Negotiation successful
0806 01:03:15.797286 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"mutex_wait_us":2,"thread_start_us":80,"threads_started":1}
WARNING: no policy specified for kudu/127.11.88.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
I20260806 01:03:15.829392 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:0
--local_ip_for_outbound_sockets=127.11.88.67
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:45487
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:38221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:15.929170 13741 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:15.929612 13741 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:15.929695 13741 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:15.931067 13741 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:15.931123 13741 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:15.931146 13741 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 01:03:15.931159 13741 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 01:03:15.931177 13741 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:03:15.932883 13741 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:38221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.88.126:45487
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13741
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:15.933205 13741 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:15.933495 13741 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:15.939320 13746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:15.939375 13749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:15.939353 13747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:15.939534 13741 server_base.cc:1034] running on GCE node
I20260806 01:03:15.939833 13741 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:15.940122 13741 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:15.941339 13741 hybrid_clock.cc:648] HybridClock initialized: now 1785978195941321 us; error 29 us; skew 500 ppm
Aug 06 01:03:15 dist-test-slave-69rg krb5kdc[13337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978195, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:15.944845 13741 init.cc:377] Logged in from keytab as kudu/127.11.88.67@KRBTEST.COM (short username kudu)
I20260806 01:03:15.945866 13741 webserver.cc:460] Webserver started at http://127.11.88.67:46359/ using document root <none> and password file <none>
I20260806 01:03:15.946154 13741 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:15.946447 13741 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:15.946803 13741 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:15.948118 13741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-2/data/instance:
uuid: "b2d3a0e8c9fb4c74888184890683e707"
format_stamp: "Formatted at 2026-08-06 01:03:15 on dist-test-slave-69rg"
server_key: "0b170d066092af4cf400278a41f94913"
server_key_iv: "89287e1ecc22d29061d2cd8ca207638f"
server_key_version: "encryptionkey@0"
I20260806 01:03:15.948523 13741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance:
uuid: "b2d3a0e8c9fb4c74888184890683e707"
format_stamp: "Formatted at 2026-08-06 01:03:15 on dist-test-slave-69rg"
server_key: "0b170d066092af4cf400278a41f94913"
server_key_iv: "89287e1ecc22d29061d2cd8ca207638f"
server_key_version: "encryptionkey@0"
I20260806 01:03:15.950342 13741 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260806 01:03:15.951501 13756 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:15.951858 13741 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:15.952005 13741 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "b2d3a0e8c9fb4c74888184890683e707"
format_stamp: "Formatted at 2026-08-06 01:03:15 on dist-test-slave-69rg"
server_key: "0b170d066092af4cf400278a41f94913"
server_key_iv: "89287e1ecc22d29061d2cd8ca207638f"
server_key_version: "encryptionkey@0"
I20260806 01:03:15.952102 13741 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:15.965984 13741 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:15.968567 13741 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:15.968752 13741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:15.969431 13741 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:15.969488 13741 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:15.969530 13741 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:15.969544 13741 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:15.978302 13741 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:38109
Aug 06 01:03:15 dist-test-slave-69rg krb5kdc[13337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978195, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:15.978485 13872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:38109 every 8 connection(s)
I20260806 01:03:15.978772 13741 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
I20260806 01:03:15.982683 13437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:15.969971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:39915 (local address 127.11.88.126:45487)
0806 01:03:15.970047 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:15.970050 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:15.970362 (+ 312us) server_negotiation.cc:407] Connection header received
0806 01:03:15.971128 (+ 766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:15.971129 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:15.971140 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:15.971185 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:15.972182 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:15.972726 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:15.974451 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:15.974873 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:15.974976 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:15.979177 (+ 4201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:15.979180 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:15.979180 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:15.979193 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:15.980886 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:15.981428 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:15.981429 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:15.981430 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:15.981493 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:15.981944 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:15.981945 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:15.981946 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:15.982099 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:15.982168 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:15.982520 (+ 352us) server_negotiation.cc:299] Negotiation successful
0806 01:03:15.982607 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 01:03:15.982841 13765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:15.969989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45487 (local address 127.11.88.67:39915)
0806 01:03:15.970184 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:15.970238 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:15.970996 (+ 758us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:15.971269 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:15.971275 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:15.971716 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:15.972065 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:15.972073 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:15.972830 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:15.972831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:15.974354 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:15.974357 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:15.975019 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:15.975020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:15.975169 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:15.976415 (+ 1246us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:15.976451 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:15.979004 (+ 2553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:15.981002 (+ 1998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:15.981010 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:15.981012 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:15.981302 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:15.981589 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:15.981590 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:15.981590 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:15.981719 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:15.982211 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:15.982218 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:15.982365 (+ 147us) client_negotiation.cc:769] Sending connection context
0806 01:03:15.982461 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 01:03:15.982614 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":95,"threads_started":1}
I20260806 01:03:15.983469 13873 heartbeater.cc:347] Connected to a master server at 127.11.88.126:45487
I20260806 01:03:15.983562 13873 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:15.983824 13873 heartbeater.cc:511] Master 127.11.88.126:45487 requested a full tablet report, sending...
I20260806 01:03:15.984259 13385 ts_manager.cc:194] Registered new tserver with Master: b2d3a0e8c9fb4c74888184890683e707 (127.11.88.67:38109)
I20260806 01:03:15.984709 13385 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.67@KRBTEST.COM'} at 127.11.88.67:39915
I20260806 01:03:15.986765 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 13741
I20260806 01:03:15.986887 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance
I20260806 01:03:15.987069 11617 external_mini_cluster.cc:1428] Setting key 213d272c4ab88566de2a0da06bd36339
I20260806 01:03:15.988266 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 01:03:15.991547 13879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:15.984830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45487 (local address 127.11.88.67:39243)
0806 01:03:15.984989 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:15.985001 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:15.985059 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:15.985174 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:15.985179 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:15.985346 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:15.985402 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:15.985404 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:15.986222 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:15.986223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:15.986752 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:15.986754 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:15.987267 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:15.987268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:15.987351 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:15.987835 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:15.987839 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:15.988212 (+ 373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:15.990104 (+ 1892us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:15.990105 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:15.990106 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:15.990306 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:15.990553 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:15.990554 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:15.990554 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:15.990625 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:15.991206 (+ 581us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:15.991208 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:15.991273 (+ 65us) client_negotiation.cc:769] Sending connection context
0806 01:03:15.991349 (+ 76us) client_negotiation.cc:240] Negotiation successful
0806 01:03:15.991463 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":74,"threads_started":1}
I20260806 01:03:15.991919 13437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:15.985016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:39243 (local address 127.11.88.126:45487)
0806 01:03:15.985070 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:15.985072 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:15.985081 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:03:15.985104 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:15.985105 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:15.985115 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:15.985170 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:15.985477 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:15.986123 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:15.986837 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:15.987127 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:15.987205 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:15.988335 (+ 1130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:15.988336 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:15.988337 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:15.988345 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:15.990018 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:15.990386 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:15.990387 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:15.990388 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:15.990484 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:15.990693 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:15.990694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:15.990694 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:15.990929 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:15.991200 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:15.991548 (+ 348us) server_negotiation.cc:299] Negotiation successful
0806 01:03:15.991666 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
Aug 06 01:03:16 dist-test-slave-69rg krb5kdc[13337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978196, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 01:03:16 dist-test-slave-69rg krb5kdc[13337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978196, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:16.021057 13437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:16.010747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52408 (local address 127.11.88.126:45487)
0806 01:03:16.010877 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:16.010880 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:16.010891 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:03:16.010922 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:16.010923 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:16.010934 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:16.011088 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:16.011742 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.012515 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.013389 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.013915 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.013989 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:16.016945 (+ 2956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:16.016946 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:16.016946 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:16.016956 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:16.019234 (+ 2278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:16.019909 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:16.019911 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:16.019911 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:16.019982 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:16.020271 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:16.020272 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:16.020272 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:16.020413 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:16.020525 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:16.020809 (+ 284us) server_negotiation.cc:299] Negotiation successful
0806 01:03:16.020894 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260806 01:03:16.023343 13385 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52408:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 01:03:16.025169 13385 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:03:16.033537 13890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:16.028618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:38109 (local address 127.0.0.1:35412)
0806 01:03:16.028756 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:16.028800 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:16.028894 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:16.029338 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:16.029342 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:16.029344 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:16.029430 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:16.029433 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.030916 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.030917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:16.032055 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:16.032058 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.033159 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.033161 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:16.033263 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:16.033279 (+ 16us) client_negotiation.cc:769] Sending connection context
0806 01:03:16.033357 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 01:03:16.033430 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":79,"threads_started":1}
I20260806 01:03:16.033921 13893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:16.028926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35412 (local address 127.11.88.67:38109)
0806 01:03:16.029110 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:16.029115 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:16.029126 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:03:16.029171 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:16.029173 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:16.029191 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:16.029309 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:16.029571 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.030813 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.032197 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.033055 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.033162 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:16.033239 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:16.033580 (+ 341us) server_negotiation.cc:299] Negotiation successful
0806 01:03:16.033627 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":103,"threads_started":1}
I20260806 01:03:16.033537 13891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:16.028626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:35507 (local address 127.0.0.1:54482)
0806 01:03:16.029122 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:16.029134 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:16.029183 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:16.029444 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:16.029445 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:16.029447 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:16.029494 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:16.029495 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.030496 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.030497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:16.031723 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:16.031726 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.033316 (+ 1590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.033317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:16.033385 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:16.033388 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:03:16.033430 (+ 42us) client_negotiation.cc:240] Negotiation successful
0806 01:03:16.033464 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"mutex_wait_us":3,"thread_start_us":99,"threads_started":1}
I20260806 01:03:16.034262 13894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:16.028937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54482 (local address 127.11.88.65:35507)
0806 01:03:16.029158 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:16.029163 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:16.029175 (+ 12us) server_negotiation.cc:407] Connection header received
0806 01:03:16.029260 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:16.029262 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:16.029281 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:16.029370 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:16.029554 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.030405 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.032004 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.033233 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.033422 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:16.033504 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:16.033544 (+ 40us) server_negotiation.cc:299] Negotiation successful
0806 01:03:16.033600 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":123,"threads_started":1}
I20260806 01:03:16.034699 13807 tablet_service.cc:1467] Processing CreateTablet for tablet d075b634d5324e56ba71b40757702ec8 (DEFAULT_TABLE table=test-table [id=83c9690556924dfd9c17ff458680c592]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:16.035097 13807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d075b634d5324e56ba71b40757702ec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:16.035490 13892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:16.028626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:39565 (local address 127.0.0.1:59872)
0806 01:03:16.028915 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:16.028926 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:16.028982 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:16.029850 (+ 868us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:16.029851 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:16.029854 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:16.029904 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:16.029906 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.031265 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.031266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:16.032887 (+ 1621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:16.032891 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.035061 (+ 2170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.035063 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:16.035305 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:16.035314 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 01:03:16.035363 (+ 49us) client_negotiation.cc:240] Negotiation successful
0806 01:03:16.035428 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":107,"threads_started":1}
I20260806 01:03:16.036132 13895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:16.029200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59872 (local address 127.11.88.66:39565)
0806 01:03:16.029614 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:16.029620 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:16.029632 (+ 12us) server_negotiation.cc:407] Connection header received
0806 01:03:16.029678 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:16.029680 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:16.029697 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:16.030017 (+ 320us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:16.030086 (+ 69us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.031172 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.033242 (+ 2070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.034503 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.035648 (+ 1145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:16.035950 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:16.035992 (+ 42us) server_negotiation.cc:299] Negotiation successful
0806 01:03:16.036038 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":107,"threads_started":1}
I20260806 01:03:16.037356 13664 tablet_service.cc:1467] Processing CreateTablet for tablet d075b634d5324e56ba71b40757702ec8 (DEFAULT_TABLE table=test-table [id=83c9690556924dfd9c17ff458680c592]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:16.037967 13664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d075b634d5324e56ba71b40757702ec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:16.039044 13896 tablet_bootstrap.cc:492] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707: Bootstrap starting.
I20260806 01:03:16.040103 13523 tablet_service.cc:1467] Processing CreateTablet for tablet d075b634d5324e56ba71b40757702ec8 (DEFAULT_TABLE table=test-table [id=83c9690556924dfd9c17ff458680c592]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:16.040262 13896 tablet_bootstrap.cc:654] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:16.040524 13523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d075b634d5324e56ba71b40757702ec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:16.040755 13896 log.cc:824] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:16.041940 13896 tablet_bootstrap.cc:492] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707: No bootstrap required, opened a new log
I20260806 01:03:16.042016 13896 ts_tablet_manager.cc:1397] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260806 01:03:16.042333 13898 tablet_bootstrap.cc:492] T d075b634d5324e56ba71b40757702ec8 P c47ae1cb0ea546699de4511eaa92a576: Bootstrap starting.
I20260806 01:03:16.043392 13898 tablet_bootstrap.cc:654] T d075b634d5324e56ba71b40757702ec8 P c47ae1cb0ea546699de4511eaa92a576: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:16.043744 13898 log.cc:824] T d075b634d5324e56ba71b40757702ec8 P c47ae1cb0ea546699de4511eaa92a576: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:16.043836 13896 raft_consensus.cc:348] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:16.044021 13896 raft_consensus.cc:374] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:16.044064 13896 raft_consensus.cc:729] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d3a0e8c9fb4c74888184890683e707, State: Initialized, Role: FOLLOWER
I20260806 01:03:16.044199 13896 consensus_queue.cc:260] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:16.044556 13896 ts_tablet_manager.cc:1428] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 01:03:16.044726 13873 heartbeater.cc:503] Master 127.11.88.126:45487 was elected leader, sending a full tablet report...
I20260806 01:03:16.044726 13898 tablet_bootstrap.cc:492] T d075b634d5324e56ba71b40757702ec8 P c47ae1cb0ea546699de4511eaa92a576: No bootstrap required, opened a new log
I20260806 01:03:16.044802 13898 ts_tablet_manager.cc:1397] T d075b634d5324e56ba71b40757702ec8 P c47ae1cb0ea546699de4511eaa92a576: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 01:03:16.045439 13901 tablet_bootstrap.cc:492] T d075b634d5324e56ba71b40757702ec8 P ea1d9db3a3c2481fa49f4d12de4e89c6: Bootstrap starting.
I20260806 01:03:16.046195 13901 tablet_bootstrap.cc:654] T d075b634d5324e56ba71b40757702ec8 P ea1d9db3a3c2481fa49f4d12de4e89c6: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:16.046677 13901 log.cc:824] T d075b634d5324e56ba71b40757702ec8 P ea1d9db3a3c2481fa49f4d12de4e89c6: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:16.047705 13901 tablet_bootstrap.cc:492] T d075b634d5324e56ba71b40757702ec8 P ea1d9db3a3c2481fa49f4d12de4e89c6: No bootstrap required, opened a new log
I20260806 01:03:16.047901 13901 ts_tablet_manager.cc:1397] T d075b634d5324e56ba71b40757702ec8 P ea1d9db3a3c2481fa49f4d12de4e89c6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 01:03:16.047797 13898 raft_consensus.cc:348] T d075b634d5324e56ba71b40757702ec8 P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:16.047961 13898 raft_consensus.cc:374] T d075b634d5324e56ba71b40757702ec8 P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:16.048030 13898 raft_consensus.cc:729] T d075b634d5324e56ba71b40757702ec8 P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47ae1cb0ea546699de4511eaa92a576, State: Initialized, Role: FOLLOWER
I20260806 01:03:16.048310 13898 consensus_queue.cc:260] T d075b634d5324e56ba71b40757702ec8 P c47ae1cb0ea546699de4511eaa92a576 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:16.048797 13898 ts_tablet_manager.cc:1428] T d075b634d5324e56ba71b40757702ec8 P c47ae1cb0ea546699de4511eaa92a576: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260806 01:03:16.048851 13731 heartbeater.cc:503] Master 127.11.88.126:45487 was elected leader, sending a full tablet report...
I20260806 01:03:16.051517 13901 raft_consensus.cc:348] T d075b634d5324e56ba71b40757702ec8 P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:16.051712 13901 raft_consensus.cc:374] T d075b634d5324e56ba71b40757702ec8 P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:16.051736 13901 raft_consensus.cc:729] T d075b634d5324e56ba71b40757702ec8 P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea1d9db3a3c2481fa49f4d12de4e89c6, State: Initialized, Role: FOLLOWER
I20260806 01:03:16.051864 13901 consensus_queue.cc:260] T d075b634d5324e56ba71b40757702ec8 P ea1d9db3a3c2481fa49f4d12de4e89c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:16.052366 13901 ts_tablet_manager.cc:1428] T d075b634d5324e56ba71b40757702ec8 P ea1d9db3a3c2481fa49f4d12de4e89c6: Time spent starting tablet: real 0.004s user 0.002s sys 0.003s
I20260806 01:03:16.052385 13590 heartbeater.cc:503] Master 127.11.88.126:45487 was elected leader, sending a full tablet report...
W20260806 01:03:16.104777 13591 tablet.cc:2369] T d075b634d5324e56ba71b40757702ec8 P ea1d9db3a3c2481fa49f4d12de4e89c6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 01:03:16.164503 13900 raft_consensus.cc:482] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:03:16.164680 13900 raft_consensus.cc:504] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:16.165123 13900 leader_election.cc:288] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c47ae1cb0ea546699de4511eaa92a576 (127.11.88.66:39565), ea1d9db3a3c2481fa49f4d12de4e89c6 (127.11.88.65:35507)
I20260806 01:03:16.168409 13765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:16.165367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:35507 (local address 127.11.88.67:54085)
0806 01:03:16.165418 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:16.165429 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:16.165478 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:16.165658 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:16.165659 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:16.165661 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:16.165754 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:16.165756 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.166585 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.166586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:16.167404 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:16.167406 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.168074 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.168075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:16.168198 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:16.168202 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:03:16.168267 (+ 65us) client_negotiation.cc:240] Negotiation successful
0806 01:03:16.168317 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260806 01:03:16.168433 13894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:16.165459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:54085 (local address 127.11.88.65:35507)
0806 01:03:16.165509 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:16.165511 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:16.165529 (+ 18us) server_negotiation.cc:407] Connection header received
0806 01:03:16.165559 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:16.165560 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:16.165568 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:16.165632 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:16.165908 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.166504 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.167516 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.167980 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.168077 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:16.168088 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:16.168292 (+ 204us) server_negotiation.cc:299] Negotiation successful
0806 01:03:16.168364 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 01:03:16.168466 13895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:16.165444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:57749 (local address 127.11.88.66:39565)
0806 01:03:16.165500 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:16.165502 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:16.165852 (+ 350us) server_negotiation.cc:407] Connection header received
0806 01:03:16.165914 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:16.165915 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:16.165927 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:16.165974 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:16.166160 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.166669 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.167655 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.168126 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.168186 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:16.168192 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:16.168357 (+ 165us) server_negotiation.cc:299] Negotiation successful
0806 01:03:16.168400 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 01:03:16.168690 13905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:16.165367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:39565 (local address 127.11.88.67:57749)
0806 01:03:16.165746 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:16.165756 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:16.165857 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:16.165996 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:16.165997 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:16.165999 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:16.166075 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:16.166077 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.166766 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.166767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:16.167563 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:16.167565 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.168206 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.168207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:16.168284 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:16.168286 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 01:03:16.168337 (+ 51us) client_negotiation.cc:240] Negotiation successful
0806 01:03:16.168368 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"mutex_wait_us":162,"thread_start_us":118,"threads_started":1}
I20260806 01:03:16.168952 13543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d075b634d5324e56ba71b40757702ec8" candidate_uuid: "b2d3a0e8c9fb4c74888184890683e707" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" is_pre_election: true
I20260806 01:03:16.169070 13684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d075b634d5324e56ba71b40757702ec8" candidate_uuid: "b2d3a0e8c9fb4c74888184890683e707" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47ae1cb0ea546699de4511eaa92a576" is_pre_election: true
I20260806 01:03:16.169150 13543 raft_consensus.cc:2454] T d075b634d5324e56ba71b40757702ec8 P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d3a0e8c9fb4c74888184890683e707 in term 0.
I20260806 01:03:16.169205 13684 raft_consensus.cc:2454] T d075b634d5324e56ba71b40757702ec8 P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2d3a0e8c9fb4c74888184890683e707 in term 0.
I20260806 01:03:16.169415 13757 leader_election.cc:302] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2d3a0e8c9fb4c74888184890683e707, c47ae1cb0ea546699de4511eaa92a576; no voters:
I20260806 01:03:16.169615 13900 raft_consensus.cc:2781] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:03:16.169704 13900 raft_consensus.cc:482] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:03:16.169741 13900 raft_consensus.cc:3037] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:16.170612 13900 raft_consensus.cc:504] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:16.170794 13900 leader_election.cc:288] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707 [CANDIDATE]: Term 1 election: Requested vote from peers c47ae1cb0ea546699de4511eaa92a576 (127.11.88.66:39565), ea1d9db3a3c2481fa49f4d12de4e89c6 (127.11.88.65:35507)
I20260806 01:03:16.171001 13684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d075b634d5324e56ba71b40757702ec8" candidate_uuid: "b2d3a0e8c9fb4c74888184890683e707" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47ae1cb0ea546699de4511eaa92a576"
I20260806 01:03:16.170987 13543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d075b634d5324e56ba71b40757702ec8" candidate_uuid: "b2d3a0e8c9fb4c74888184890683e707" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6"
I20260806 01:03:16.171080 13543 raft_consensus.cc:3037] T d075b634d5324e56ba71b40757702ec8 P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:16.171103 13684 raft_consensus.cc:3037] T d075b634d5324e56ba71b40757702ec8 P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:16.171857 13684 raft_consensus.cc:2454] T d075b634d5324e56ba71b40757702ec8 P c47ae1cb0ea546699de4511eaa92a576 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d3a0e8c9fb4c74888184890683e707 in term 1.
I20260806 01:03:16.171862 13543 raft_consensus.cc:2454] T d075b634d5324e56ba71b40757702ec8 P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2d3a0e8c9fb4c74888184890683e707 in term 1.
I20260806 01:03:16.172647 13759 leader_election.cc:302] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2d3a0e8c9fb4c74888184890683e707, ea1d9db3a3c2481fa49f4d12de4e89c6; no voters:
I20260806 01:03:16.172827 13900 raft_consensus.cc:2781] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:16.173007 13900 raft_consensus.cc:686] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707 [term 1 LEADER]: Becoming Leader. State: Replica: b2d3a0e8c9fb4c74888184890683e707, State: Running, Role: LEADER
I20260806 01:03:16.173095 13900 consensus_queue.cc:237] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:16.174382 13385 catalog_manager.cc:5495] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2d3a0e8c9fb4c74888184890683e707 (127.11.88.67). New cstate: current_term: 1 leader_uuid: "b2d3a0e8c9fb4c74888184890683e707" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } health_report { overall_health: HEALTHY } } }
Aug 06 01:03:16 dist-test-slave-69rg krb5kdc[13337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978195, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:16.206365 13437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:16.198787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52418 (local address 127.11.88.126:45487)
0806 01:03:16.198894 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:16.198896 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:16.199022 (+ 126us) server_negotiation.cc:407] Connection header received
0806 01:03:16.199152 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:16.199153 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:16.199162 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:16.199234 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:16.199759 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.200256 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.200964 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.201152 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.201237 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:16.203542 (+ 2305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:16.203544 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:16.203544 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:16.203553 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:16.204978 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:16.205439 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:16.205441 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:16.205441 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:16.205506 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:16.205716 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:16.205717 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:16.205717 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:16.205897 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:16.205983 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:16.206141 (+ 158us) server_negotiation.cc:299] Negotiation successful
0806 01:03:16.206236 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 01:03:16.206439 13913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:16.198732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45487 (local address 127.0.0.1:52418)
0806 01:03:16.198944 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:16.198954 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:16.199044 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:16.199241 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:16.199241 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:16.199607 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:16.199668 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:16.199672 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.200346 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.200348 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:16.200876 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:16.200878 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.201240 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.201241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:16.201301 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:16.201923 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:16.201927 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:16.203433 (+ 1506us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:16.205087 (+ 1654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:16.205107 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:16.205110 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:16.205350 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:16.205584 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:16.205585 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:16.205585 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:16.205649 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:16.205972 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:16.205982 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:16.206032 (+ 50us) client_negotiation.cc:769] Sending connection context
0806 01:03:16.206118 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 01:03:16.206298 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"mutex_wait_us":65,"thread_start_us":95,"threads_started":1}
I20260806 01:03:16.209308 13385 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:52418:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 01:03:16.209793 13385 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:03:16.211513 13523 tablet_service.cc:1467] Processing CreateTablet for tablet 8f001b0fddbd44e59885408a81a3ee47 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d973fd2c19ae464f950114b20e8eab5a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 01:03:16.211503 13664 tablet_service.cc:1467] Processing CreateTablet for tablet 8f001b0fddbd44e59885408a81a3ee47 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d973fd2c19ae464f950114b20e8eab5a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 01:03:16.211702 13523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f001b0fddbd44e59885408a81a3ee47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:16.211702 13664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f001b0fddbd44e59885408a81a3ee47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:16.211608 13807 tablet_service.cc:1467] Processing CreateTablet for tablet 8f001b0fddbd44e59885408a81a3ee47 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d973fd2c19ae464f950114b20e8eab5a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 01:03:16.211825 13807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f001b0fddbd44e59885408a81a3ee47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:16.213388 13898 tablet_bootstrap.cc:492] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576: Bootstrap starting.
I20260806 01:03:16.213409 13896 tablet_bootstrap.cc:492] T 8f001b0fddbd44e59885408a81a3ee47 P b2d3a0e8c9fb4c74888184890683e707: Bootstrap starting.
I20260806 01:03:16.213979 13896 tablet_bootstrap.cc:654] T 8f001b0fddbd44e59885408a81a3ee47 P b2d3a0e8c9fb4c74888184890683e707: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:16.214285 13898 tablet_bootstrap.cc:654] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:16.214708 13896 tablet_bootstrap.cc:492] T 8f001b0fddbd44e59885408a81a3ee47 P b2d3a0e8c9fb4c74888184890683e707: No bootstrap required, opened a new log
I20260806 01:03:16.214695 13901 tablet_bootstrap.cc:492] T 8f001b0fddbd44e59885408a81a3ee47 P ea1d9db3a3c2481fa49f4d12de4e89c6: Bootstrap starting.
I20260806 01:03:16.214775 13896 ts_tablet_manager.cc:1397] T 8f001b0fddbd44e59885408a81a3ee47 P b2d3a0e8c9fb4c74888184890683e707: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260806 01:03:16.214939 13896 raft_consensus.cc:348] T 8f001b0fddbd44e59885408a81a3ee47 P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:16.215034 13896 raft_consensus.cc:374] T 8f001b0fddbd44e59885408a81a3ee47 P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:16.215066 13896 raft_consensus.cc:729] T 8f001b0fddbd44e59885408a81a3ee47 P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d3a0e8c9fb4c74888184890683e707, State: Initialized, Role: FOLLOWER
I20260806 01:03:16.215121 13901 tablet_bootstrap.cc:654] T 8f001b0fddbd44e59885408a81a3ee47 P ea1d9db3a3c2481fa49f4d12de4e89c6: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:16.215124 13896 consensus_queue.cc:260] T 8f001b0fddbd44e59885408a81a3ee47 P b2d3a0e8c9fb4c74888184890683e707 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:16.215229 13896 ts_tablet_manager.cc:1428] T 8f001b0fddbd44e59885408a81a3ee47 P b2d3a0e8c9fb4c74888184890683e707: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260806 01:03:16.215407 13900 tablet_replica.cc:439] T 8f001b0fddbd44e59885408a81a3ee47 P b2d3a0e8c9fb4c74888184890683e707: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } } }
I20260806 01:03:16.215502 13900 tablet_replica.cc:442] T 8f001b0fddbd44e59885408a81a3ee47 P b2d3a0e8c9fb4c74888184890683e707: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 01:03:16.215633 13898 tablet_bootstrap.cc:492] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576: No bootstrap required, opened a new log
I20260806 01:03:16.215713 13898 ts_tablet_manager.cc:1397] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 01:03:16.215900 13898 raft_consensus.cc:348] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:16.215978 13898 raft_consensus.cc:374] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:16.216002 13898 raft_consensus.cc:729] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47ae1cb0ea546699de4511eaa92a576, State: Initialized, Role: FOLLOWER
I20260806 01:03:16.216059 13898 consensus_queue.cc:260] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:16.216159 13898 ts_tablet_manager.cc:1428] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:16.216264 13903 tablet_replica.cc:439] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } } }
I20260806 01:03:16.216348 13903 tablet_replica.cc:442] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 01:03:16.216602 13901 tablet_bootstrap.cc:492] T 8f001b0fddbd44e59885408a81a3ee47 P ea1d9db3a3c2481fa49f4d12de4e89c6: No bootstrap required, opened a new log
I20260806 01:03:16.216667 13901 ts_tablet_manager.cc:1397] T 8f001b0fddbd44e59885408a81a3ee47 P ea1d9db3a3c2481fa49f4d12de4e89c6: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260806 01:03:16.216841 13901 raft_consensus.cc:348] T 8f001b0fddbd44e59885408a81a3ee47 P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:16.216928 13901 raft_consensus.cc:374] T 8f001b0fddbd44e59885408a81a3ee47 P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:16.216941 13901 raft_consensus.cc:729] T 8f001b0fddbd44e59885408a81a3ee47 P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea1d9db3a3c2481fa49f4d12de4e89c6, State: Initialized, Role: FOLLOWER
I20260806 01:03:16.217006 13901 consensus_queue.cc:260] T 8f001b0fddbd44e59885408a81a3ee47 P ea1d9db3a3c2481fa49f4d12de4e89c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:16.217108 13901 ts_tablet_manager.cc:1428] T 8f001b0fddbd44e59885408a81a3ee47 P ea1d9db3a3c2481fa49f4d12de4e89c6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:16.217283 13904 tablet_replica.cc:439] T 8f001b0fddbd44e59885408a81a3ee47 P ea1d9db3a3c2481fa49f4d12de4e89c6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } } }
I20260806 01:03:16.217384 13904 tablet_replica.cc:442] T 8f001b0fddbd44e59885408a81a3ee47 P ea1d9db3a3c2481fa49f4d12de4e89c6: This TxnStatusTablet replica's current role is: FOLLOWER
W20260806 01:03:16.229507 13874 tablet.cc:2369] T 8f001b0fddbd44e59885408a81a3ee47 P b2d3a0e8c9fb4c74888184890683e707: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 01:03:16.285641 13732 tablet.cc:2369] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 01:03:16.401944 13903 raft_consensus.cc:482] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:03:16.402047 13903 raft_consensus.cc:504] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:16.402427 13903 leader_election.cc:288] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea1d9db3a3c2481fa49f4d12de4e89c6 (127.11.88.65:35507), b2d3a0e8c9fb4c74888184890683e707 (127.11.88.67:38109)
I20260806 01:03:16.405606 13894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:16.402760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:49951 (local address 127.11.88.65:35507)
0806 01:03:16.402813 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:16.402816 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:16.403039 (+ 223us) server_negotiation.cc:407] Connection header received
0806 01:03:16.403116 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:16.403118 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:16.403129 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:16.403205 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:16.403363 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.403845 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.404858 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.405223 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.405316 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:16.405325 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:16.405492 (+ 167us) server_negotiation.cc:299] Negotiation successful
0806 01:03:16.405532 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 01:03:16.405654 13893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:16.402789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:47569 (local address 127.11.88.67:38109)
0806 01:03:16.402858 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:16.402861 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:16.402943 (+ 82us) server_negotiation.cc:407] Connection header received
0806 01:03:16.403043 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:16.403044 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:16.403054 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:16.403166 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:16.403335 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.403831 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.404886 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.405289 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.405377 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:16.405386 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:16.405540 (+ 154us) server_negotiation.cc:299] Negotiation successful
0806 01:03:16.405578 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260806 01:03:16.405658 13917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:16.402676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:35507 (local address 127.11.88.66:49951)
0806 01:03:16.402960 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:16.402969 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:16.403057 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:16.403209 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:16.403210 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:16.403212 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:16.403281 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:16.403282 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.403930 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.403931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:16.404761 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:16.404763 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.405316 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.405317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:16.405396 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:16.405402 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 01:03:16.405482 (+ 80us) client_negotiation.cc:240] Negotiation successful
0806 01:03:16.405527 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"mutex_wait_us":41,"thread_start_us":87,"threads_started":1}
I20260806 01:03:16.405669 13918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:16.402676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:38109 (local address 127.11.88.66:47569)
0806 01:03:16.402853 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:16.402865 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:16.402959 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:16.403174 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:16.403175 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:16.403178 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:16.403262 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:16.403264 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.403925 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.403926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:16.404786 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:16.404788 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.405378 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.405379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:16.405464 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:16.405467 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:03:16.405535 (+ 68us) client_negotiation.cc:240] Negotiation successful
0806 01:03:16.405584 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":66,"thread_start_us":104,"threads_started":1}
I20260806 01:03:16.406129 13543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f001b0fddbd44e59885408a81a3ee47" candidate_uuid: "c47ae1cb0ea546699de4511eaa92a576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" is_pre_election: true
I20260806 01:03:16.406255 13543 raft_consensus.cc:2454] T 8f001b0fddbd44e59885408a81a3ee47 P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c47ae1cb0ea546699de4511eaa92a576 in term 0.
I20260806 01:03:16.406390 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f001b0fddbd44e59885408a81a3ee47" candidate_uuid: "c47ae1cb0ea546699de4511eaa92a576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d3a0e8c9fb4c74888184890683e707" is_pre_election: true
I20260806 01:03:16.406440 13617 leader_election.cc:302] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47ae1cb0ea546699de4511eaa92a576, ea1d9db3a3c2481fa49f4d12de4e89c6; no voters:
I20260806 01:03:16.406526 13827 raft_consensus.cc:2454] T 8f001b0fddbd44e59885408a81a3ee47 P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c47ae1cb0ea546699de4511eaa92a576 in term 0.
I20260806 01:03:16.406610 13903 raft_consensus.cc:2781] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:03:16.406682 13903 raft_consensus.cc:482] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:03:16.406706 13903 raft_consensus.cc:3037] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:16.407568 13903 raft_consensus.cc:504] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:16.407707 13903 leader_election.cc:288] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576 [CANDIDATE]: Term 1 election: Requested vote from peers ea1d9db3a3c2481fa49f4d12de4e89c6 (127.11.88.65:35507), b2d3a0e8c9fb4c74888184890683e707 (127.11.88.67:38109)
I20260806 01:03:16.407913 13543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f001b0fddbd44e59885408a81a3ee47" candidate_uuid: "c47ae1cb0ea546699de4511eaa92a576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6"
I20260806 01:03:16.407917 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f001b0fddbd44e59885408a81a3ee47" candidate_uuid: "c47ae1cb0ea546699de4511eaa92a576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d3a0e8c9fb4c74888184890683e707"
I20260806 01:03:16.408008 13827 raft_consensus.cc:3037] T 8f001b0fddbd44e59885408a81a3ee47 P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:16.408018 13543 raft_consensus.cc:3037] T 8f001b0fddbd44e59885408a81a3ee47 P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:16.408775 13543 raft_consensus.cc:2454] T 8f001b0fddbd44e59885408a81a3ee47 P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47ae1cb0ea546699de4511eaa92a576 in term 1.
I20260806 01:03:16.408922 13827 raft_consensus.cc:2454] T 8f001b0fddbd44e59885408a81a3ee47 P b2d3a0e8c9fb4c74888184890683e707 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47ae1cb0ea546699de4511eaa92a576 in term 1.
I20260806 01:03:16.408957 13617 leader_election.cc:302] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47ae1cb0ea546699de4511eaa92a576, ea1d9db3a3c2481fa49f4d12de4e89c6; no voters:
I20260806 01:03:16.409037 13903 raft_consensus.cc:2781] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:16.409184 13903 raft_consensus.cc:686] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576 [term 1 LEADER]: Becoming Leader. State: Replica: c47ae1cb0ea546699de4511eaa92a576, State: Running, Role: LEADER
I20260806 01:03:16.409309 13903 consensus_queue.cc:237] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:16.409795 13919 tablet_replica.cc:439] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576: TxnStatusTablet state changed. Reason: New leader c47ae1cb0ea546699de4511eaa92a576. Latest consensus state: current_term: 1 leader_uuid: "c47ae1cb0ea546699de4511eaa92a576" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } } }
I20260806 01:03:16.409915 13919 tablet_replica.cc:442] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576: This TxnStatusTablet replica's current role is: LEADER
I20260806 01:03:16.410235 13385 catalog_manager.cc:5495] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576 reported cstate change: term changed from 0 to 1, leader changed from <none> to c47ae1cb0ea546699de4511eaa92a576 (127.11.88.66). New cstate: current_term: 1 leader_uuid: "c47ae1cb0ea546699de4511eaa92a576" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } health_report { overall_health: UNKNOWN } } }
I20260806 01:03:16.410595 13921 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 01:03:16.410712 13921 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 01:03:16.448041 13895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:16.444998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59888 (local address 127.11.88.66:39565)
0806 01:03:16.445055 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:16.445057 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:16.445091 (+ 34us) server_negotiation.cc:407] Connection header received
0806 01:03:16.445206 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:16.445207 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:16.445233 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:16.445322 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:03:16.445561 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.446174 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.447280 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.447465 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.447520 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:16.447721 (+ 201us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:03:16.447829 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:03:16.447889 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:16.447959 (+ 70us) server_negotiation.cc:299] Negotiation successful
0806 01:03:16.447977 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260806 01:03:16.448091 13913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:16.444918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:39565 (local address 127.0.0.1:59888)
0806 01:03:16.445038 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:16.445050 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:16.445104 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:16.445334 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:16.445335 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:16.445337 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 01:03:16.445394 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:16.445396 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.446262 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.446263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:16.447185 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:16.447189 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.447540 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.447541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:16.447608 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:16.447627 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 01:03:16.447892 (+ 265us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 01:03:16.447900 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 01:03:16.447953 (+ 53us) client_negotiation.cc:240] Negotiation successful
0806 01:03:16.448006 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83}
I20260806 01:03:16.450021 13543 raft_consensus.cc:1261] T 8f001b0fddbd44e59885408a81a3ee47 P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 1 FOLLOWER]: Refusing update from remote peer c47ae1cb0ea546699de4511eaa92a576: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:16.450436 13827 raft_consensus.cc:1261] T 8f001b0fddbd44e59885408a81a3ee47 P b2d3a0e8c9fb4c74888184890683e707 [term 1 FOLLOWER]: Refusing update from remote peer c47ae1cb0ea546699de4511eaa92a576: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:16.450423 13919 consensus_queue.cc:1035] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:16.450699 13919 consensus_queue.cc:1035] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:16.451795 13904 tablet_replica.cc:439] T 8f001b0fddbd44e59885408a81a3ee47 P ea1d9db3a3c2481fa49f4d12de4e89c6: TxnStatusTablet state changed. Reason: New leader c47ae1cb0ea546699de4511eaa92a576. Latest consensus state: current_term: 1 leader_uuid: "c47ae1cb0ea546699de4511eaa92a576" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } } }
I20260806 01:03:16.451803 13900 tablet_replica.cc:439] T 8f001b0fddbd44e59885408a81a3ee47 P b2d3a0e8c9fb4c74888184890683e707: TxnStatusTablet state changed. Reason: New leader c47ae1cb0ea546699de4511eaa92a576. Latest consensus state: current_term: 1 leader_uuid: "c47ae1cb0ea546699de4511eaa92a576" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } } }
I20260806 01:03:16.451893 13904 tablet_replica.cc:442] T 8f001b0fddbd44e59885408a81a3ee47 P ea1d9db3a3c2481fa49f4d12de4e89c6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 01:03:16.451895 13900 tablet_replica.cc:442] T 8f001b0fddbd44e59885408a81a3ee47 P b2d3a0e8c9fb4c74888184890683e707: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 01:03:16.452797 13903 tablet_replica.cc:439] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c47ae1cb0ea546699de4511eaa92a576" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } } }
I20260806 01:03:16.452884 13903 tablet_replica.cc:442] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576: This TxnStatusTablet replica's current role is: LEADER
I20260806 01:03:16.452867 13900 tablet_replica.cc:439] T 8f001b0fddbd44e59885408a81a3ee47 P b2d3a0e8c9fb4c74888184890683e707: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c47ae1cb0ea546699de4511eaa92a576" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } } }
I20260806 01:03:16.452942 13900 tablet_replica.cc:442] T 8f001b0fddbd44e59885408a81a3ee47 P b2d3a0e8c9fb4c74888184890683e707: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 01:03:16.453178 13924 mvcc.cc:205] Tried to move back new op lower bound from 7315366692656517120 to 7315366692493324288. Current Snapshot: MvccSnapshot[applied={T|T < 7315366692656517120}]
I20260806 01:03:16.453492 13919 tablet_replica.cc:439] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c47ae1cb0ea546699de4511eaa92a576" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } } }
I20260806 01:03:16.453572 13919 tablet_replica.cc:442] T 8f001b0fddbd44e59885408a81a3ee47 P c47ae1cb0ea546699de4511eaa92a576: This TxnStatusTablet replica's current role is: LEADER
I20260806 01:03:16.454123 13904 tablet_replica.cc:439] T 8f001b0fddbd44e59885408a81a3ee47 P ea1d9db3a3c2481fa49f4d12de4e89c6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c47ae1cb0ea546699de4511eaa92a576" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } } }
I20260806 01:03:16.454214 13904 tablet_replica.cc:442] T 8f001b0fddbd44e59885408a81a3ee47 P ea1d9db3a3c2481fa49f4d12de4e89c6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 01:03:16.454726 13925 mvcc.cc:205] Tried to move back new op lower bound from 7315366692656517120 to 7315366692493324288. Current Snapshot: MvccSnapshot[applied={T|T < 7315366692656517120 or (T in {7315366692656517120})}]
I20260806 01:03:16.455243 13926 mvcc.cc:205] Tried to move back new op lower bound from 7315366692656517120 to 7315366692493324288. Current Snapshot: MvccSnapshot[applied={T|T < 7315366692656517120}]
I20260806 01:03:16.458251 13893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:16.455696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35416 (local address 127.11.88.67:38109)
0806 01:03:16.455761 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:16.455763 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:16.455772 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:03:16.455847 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:16.455848 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:16.455888 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:16.455964 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:03:16.456134 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.456620 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.457392 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.457612 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.457689 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:16.457898 (+ 209us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:03:16.458003 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:03:16.458117 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:16.458140 (+ 23us) server_negotiation.cc:299] Negotiation successful
0806 01:03:16.458166 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 01:03:16.463338 13879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:16.460663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:39565 (local address 127.11.88.67:53523)
0806 01:03:16.460740 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:16.460760 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:16.460798 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:16.460942 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:16.460943 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:16.460944 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 01:03:16.461007 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:16.461008 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.461614 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.461615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:16.462545 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:16.462549 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.462887 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.462888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:16.462957 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:16.462973 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 01:03:16.463158 (+ 185us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 01:03:16.463161 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:03:16.463210 (+ 49us) client_negotiation.cc:240] Negotiation successful
0806 01:03:16.463256 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260806 01:03:16.463364 13895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:16.460776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:53523 (local address 127.11.88.66:39565)
0806 01:03:16.460820 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:16.460822 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:16.460831 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:03:16.460863 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:16.460864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:16.460872 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:16.460921 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:03:16.461070 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.461547 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.462629 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.462811 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.462865 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:16.463075 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:03:16.463101 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:03:16.463135 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:16.463211 (+ 76us) server_negotiation.cc:299] Negotiation successful
0806 01:03:16.463228 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 01:03:16.465978 13543 raft_consensus.cc:1261] T d075b634d5324e56ba71b40757702ec8 P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 1 FOLLOWER]: Refusing update from remote peer b2d3a0e8c9fb4c74888184890683e707: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:16.466064 13684 raft_consensus.cc:1261] T d075b634d5324e56ba71b40757702ec8 P c47ae1cb0ea546699de4511eaa92a576 [term 1 FOLLOWER]: Refusing update from remote peer b2d3a0e8c9fb4c74888184890683e707: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:16.466248 13906 consensus_queue.cc:1035] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:16.466481 13906 consensus_queue.cc:1035] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:16.476114 13893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:16.473396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:40441 (local address 127.11.88.67:38109)
0806 01:03:16.473456 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:16.473458 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:16.473623 (+ 165us) server_negotiation.cc:407] Connection header received
0806 01:03:16.473665 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:16.473666 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:16.473675 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:16.473716 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:03:16.473904 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.474384 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.475377 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.475565 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.475645 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:16.475842 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:03:16.475880 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:03:16.475937 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:16.476007 (+ 70us) server_negotiation.cc:299] Negotiation successful
0806 01:03:16.476030 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260806 01:03:16.476140 13940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:16.473378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:38109 (local address 127.11.88.66:40441)
0806 01:03:16.473540 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:16.473551 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:16.473613 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:16.473729 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:16.473729 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:16.473731 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 01:03:16.473852 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:16.473854 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.474468 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.474469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:16.475294 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:16.475298 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.475645 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.475646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:16.475724 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:16.475745 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 01:03:16.475950 (+ 205us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 01:03:16.475953 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:03:16.476002 (+ 49us) client_negotiation.cc:240] Negotiation successful
0806 01:03:16.476053 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":77,"threads_started":1}
I20260806 01:03:16.486281 13385 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52408:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:16.486419 13385 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52408:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:16.487319 13385 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2a3b965aa73948e4bae990dce3d66436: Sending DeleteTablet for 3 replicas of tablet d075b634d5324e56ba71b40757702ec8
I20260806 01:03:16.487666 13523 tablet_service.cc:1514] Processing DeleteTablet for tablet d075b634d5324e56ba71b40757702ec8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:16 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:54482
I20260806 01:03:16.487774 13664 tablet_service.cc:1514] Processing DeleteTablet for tablet d075b634d5324e56ba71b40757702ec8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:16 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:59872
I20260806 01:03:16.488070 13807 tablet_service.cc:1514] Processing DeleteTablet for tablet d075b634d5324e56ba71b40757702ec8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:16 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:35412
I20260806 01:03:16.488373 13944 tablet_replica.cc:330] T d075b634d5324e56ba71b40757702ec8 P c47ae1cb0ea546699de4511eaa92a576: stopping tablet replica
I20260806 01:03:16.488339 13385 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52408:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 01:03:16.488492 13385 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:03:16.488495 13944 raft_consensus.cc:2229] T d075b634d5324e56ba71b40757702ec8 P c47ae1cb0ea546699de4511eaa92a576 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:03:16.488552 13944 raft_consensus.cc:2258] T d075b634d5324e56ba71b40757702ec8 P c47ae1cb0ea546699de4511eaa92a576 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:16.489070 13944 ts_tablet_manager.cc:1905] T d075b634d5324e56ba71b40757702ec8 P c47ae1cb0ea546699de4511eaa92a576: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:16.490564 13664 tablet_service.cc:1467] Processing CreateTablet for tablet 569159130149444b9011971dda7aab1d (DEFAULT_TABLE table=test-table [id=0a0618bb86de443da22ec67e61e1ef73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:16.490686 13664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 569159130149444b9011971dda7aab1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:16.491060 13943 tablet_replica.cc:330] T d075b634d5324e56ba71b40757702ec8 P ea1d9db3a3c2481fa49f4d12de4e89c6: stopping tablet replica
I20260806 01:03:16.491192 13943 raft_consensus.cc:2229] T d075b634d5324e56ba71b40757702ec8 P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:03:16.491266 13943 raft_consensus.cc:2258] T d075b634d5324e56ba71b40757702ec8 P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:16.491531 13807 tablet_service.cc:1467] Processing CreateTablet for tablet 569159130149444b9011971dda7aab1d (DEFAULT_TABLE table=test-table [id=0a0618bb86de443da22ec67e61e1ef73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:16.491663 13807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 569159130149444b9011971dda7aab1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:16.492085 13898 tablet_bootstrap.cc:492] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576: Bootstrap starting.
I20260806 01:03:16.492673 13898 tablet_bootstrap.cc:654] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:16.493075 13896 tablet_bootstrap.cc:492] T 569159130149444b9011971dda7aab1d P b2d3a0e8c9fb4c74888184890683e707: Bootstrap starting.
I20260806 01:03:16.493196 13944 ts_tablet_manager.cc:1918] T d075b634d5324e56ba71b40757702ec8 P c47ae1cb0ea546699de4511eaa92a576: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 01:03:16.493292 13944 log.cc:1196] T d075b634d5324e56ba71b40757702ec8 P c47ae1cb0ea546699de4511eaa92a576: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-1/wal/wals/d075b634d5324e56ba71b40757702ec8
I20260806 01:03:16.493522 13896 tablet_bootstrap.cc:654] T 569159130149444b9011971dda7aab1d P b2d3a0e8c9fb4c74888184890683e707: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:16.493680 13944 ts_tablet_manager.cc:1939] T d075b634d5324e56ba71b40757702ec8 P c47ae1cb0ea546699de4511eaa92a576: Deleting consensus metadata
I20260806 01:03:16.494081 13523 tablet_service.cc:1467] Processing CreateTablet for tablet 569159130149444b9011971dda7aab1d (DEFAULT_TABLE table=test-table [id=0a0618bb86de443da22ec67e61e1ef73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:16.494217 13523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 569159130149444b9011971dda7aab1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:16.494182 13367 catalog_manager.cc:4841] TS c47ae1cb0ea546699de4511eaa92a576 (127.11.88.66:39565): tablet d075b634d5324e56ba71b40757702ec8 (table test-table [id=83c9690556924dfd9c17ff458680c592]) successfully deleted
I20260806 01:03:16.494887 13943 ts_tablet_manager.cc:1905] T d075b634d5324e56ba71b40757702ec8 P ea1d9db3a3c2481fa49f4d12de4e89c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:16.496573 13901 tablet_bootstrap.cc:492] T 569159130149444b9011971dda7aab1d P ea1d9db3a3c2481fa49f4d12de4e89c6: Bootstrap starting.
I20260806 01:03:16.497005 13901 tablet_bootstrap.cc:654] T 569159130149444b9011971dda7aab1d P ea1d9db3a3c2481fa49f4d12de4e89c6: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:16.497136 13943 ts_tablet_manager.cc:1918] T d075b634d5324e56ba71b40757702ec8 P ea1d9db3a3c2481fa49f4d12de4e89c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 01:03:16.497215 13943 log.cc:1196] T d075b634d5324e56ba71b40757702ec8 P ea1d9db3a3c2481fa49f4d12de4e89c6: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-0/wal/wals/d075b634d5324e56ba71b40757702ec8
I20260806 01:03:16.497498 13943 ts_tablet_manager.cc:1939] T d075b634d5324e56ba71b40757702ec8 P ea1d9db3a3c2481fa49f4d12de4e89c6: Deleting consensus metadata
I20260806 01:03:16.497939 13946 tablet_replica.cc:330] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707: stopping tablet replica
I20260806 01:03:16.498078 13369 catalog_manager.cc:4841] TS ea1d9db3a3c2481fa49f4d12de4e89c6 (127.11.88.65:35507): tablet d075b634d5324e56ba71b40757702ec8 (table test-table [id=83c9690556924dfd9c17ff458680c592]) successfully deleted
I20260806 01:03:16.498122 13946 raft_consensus.cc:2229] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707 [term 1 LEADER]: Raft consensus shutting down.
I20260806 01:03:16.498250 13946 raft_consensus.cc:2258] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:16.498275 13898 tablet_bootstrap.cc:492] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576: No bootstrap required, opened a new log
I20260806 01:03:16.498314 13898 ts_tablet_manager.cc:1397] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260806 01:03:16.498513 13898 raft_consensus.cc:348] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:16.498595 13898 raft_consensus.cc:374] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:16.498610 13898 raft_consensus.cc:729] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47ae1cb0ea546699de4511eaa92a576, State: Initialized, Role: FOLLOWER
I20260806 01:03:16.498672 13898 consensus_queue.cc:260] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:16.498716 13946 ts_tablet_manager.cc:1905] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:16.498781 13898 ts_tablet_manager.cc:1428] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260806 01:03:16.500689 13901 tablet_bootstrap.cc:492] T 569159130149444b9011971dda7aab1d P ea1d9db3a3c2481fa49f4d12de4e89c6: No bootstrap required, opened a new log
I20260806 01:03:16.500687 13946 ts_tablet_manager.cc:1918] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 01:03:16.500757 13901 ts_tablet_manager.cc:1397] T 569159130149444b9011971dda7aab1d P ea1d9db3a3c2481fa49f4d12de4e89c6: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.000s
I20260806 01:03:16.500870 13946 log.cc:1196] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-2/wal/wals/d075b634d5324e56ba71b40757702ec8
I20260806 01:03:16.500916 13901 raft_consensus.cc:348] T 569159130149444b9011971dda7aab1d P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:16.501008 13901 raft_consensus.cc:374] T 569159130149444b9011971dda7aab1d P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:16.501039 13901 raft_consensus.cc:729] T 569159130149444b9011971dda7aab1d P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea1d9db3a3c2481fa49f4d12de4e89c6, State: Initialized, Role: FOLLOWER
I20260806 01:03:16.501108 13901 consensus_queue.cc:260] T 569159130149444b9011971dda7aab1d P ea1d9db3a3c2481fa49f4d12de4e89c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:16.501219 13901 ts_tablet_manager.cc:1428] T 569159130149444b9011971dda7aab1d P ea1d9db3a3c2481fa49f4d12de4e89c6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:16.501418 13946 ts_tablet_manager.cc:1939] T d075b634d5324e56ba71b40757702ec8 P b2d3a0e8c9fb4c74888184890683e707: Deleting consensus metadata
I20260806 01:03:16.501895 13370 catalog_manager.cc:4841] TS b2d3a0e8c9fb4c74888184890683e707 (127.11.88.67:38109): tablet d075b634d5324e56ba71b40757702ec8 (table test-table [id=83c9690556924dfd9c17ff458680c592]) successfully deleted
I20260806 01:03:16.506351 13896 tablet_bootstrap.cc:492] T 569159130149444b9011971dda7aab1d P b2d3a0e8c9fb4c74888184890683e707: No bootstrap required, opened a new log
I20260806 01:03:16.506425 13896 ts_tablet_manager.cc:1397] T 569159130149444b9011971dda7aab1d P b2d3a0e8c9fb4c74888184890683e707: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.001s
I20260806 01:03:16.506610 13896 raft_consensus.cc:348] T 569159130149444b9011971dda7aab1d P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:16.506702 13896 raft_consensus.cc:374] T 569159130149444b9011971dda7aab1d P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:16.506726 13896 raft_consensus.cc:729] T 569159130149444b9011971dda7aab1d P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d3a0e8c9fb4c74888184890683e707, State: Initialized, Role: FOLLOWER
I20260806 01:03:16.506776 13896 consensus_queue.cc:260] T 569159130149444b9011971dda7aab1d P b2d3a0e8c9fb4c74888184890683e707 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:16.506878 13896 ts_tablet_manager.cc:1428] T 569159130149444b9011971dda7aab1d P b2d3a0e8c9fb4c74888184890683e707: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:16.727136 13938 raft_consensus.cc:482] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:03:16.727254 13938 raft_consensus.cc:504] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:16.727496 13938 leader_election.cc:288] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea1d9db3a3c2481fa49f4d12de4e89c6 (127.11.88.65:35507), b2d3a0e8c9fb4c74888184890683e707 (127.11.88.67:38109)
I20260806 01:03:16.727744 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "569159130149444b9011971dda7aab1d" candidate_uuid: "c47ae1cb0ea546699de4511eaa92a576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d3a0e8c9fb4c74888184890683e707" is_pre_election: true
I20260806 01:03:16.727852 13827 raft_consensus.cc:2454] T 569159130149444b9011971dda7aab1d P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c47ae1cb0ea546699de4511eaa92a576 in term 0.
I20260806 01:03:16.727784 13543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "569159130149444b9011971dda7aab1d" candidate_uuid: "c47ae1cb0ea546699de4511eaa92a576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" is_pre_election: true
I20260806 01:03:16.727890 13543 raft_consensus.cc:2454] T 569159130149444b9011971dda7aab1d P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c47ae1cb0ea546699de4511eaa92a576 in term 0.
I20260806 01:03:16.728027 13618 leader_election.cc:302] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2d3a0e8c9fb4c74888184890683e707, c47ae1cb0ea546699de4511eaa92a576; no voters:
I20260806 01:03:16.728142 13938 raft_consensus.cc:2781] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:03:16.728191 13938 raft_consensus.cc:482] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:03:16.728207 13938 raft_consensus.cc:3037] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:16.729017 13938 raft_consensus.cc:504] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:16.729164 13938 leader_election.cc:288] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576 [CANDIDATE]: Term 1 election: Requested vote from peers ea1d9db3a3c2481fa49f4d12de4e89c6 (127.11.88.65:35507), b2d3a0e8c9fb4c74888184890683e707 (127.11.88.67:38109)
I20260806 01:03:16.729296 13543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "569159130149444b9011971dda7aab1d" candidate_uuid: "c47ae1cb0ea546699de4511eaa92a576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6"
I20260806 01:03:16.729387 13543 raft_consensus.cc:3037] T 569159130149444b9011971dda7aab1d P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:16.729369 13827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "569159130149444b9011971dda7aab1d" candidate_uuid: "c47ae1cb0ea546699de4511eaa92a576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d3a0e8c9fb4c74888184890683e707"
I20260806 01:03:16.729441 13827 raft_consensus.cc:3037] T 569159130149444b9011971dda7aab1d P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:16.730299 13543 raft_consensus.cc:2454] T 569159130149444b9011971dda7aab1d P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47ae1cb0ea546699de4511eaa92a576 in term 1.
I20260806 01:03:16.730449 13827 raft_consensus.cc:2454] T 569159130149444b9011971dda7aab1d P b2d3a0e8c9fb4c74888184890683e707 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47ae1cb0ea546699de4511eaa92a576 in term 1.
I20260806 01:03:16.730521 13617 leader_election.cc:302] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47ae1cb0ea546699de4511eaa92a576, ea1d9db3a3c2481fa49f4d12de4e89c6; no voters:
I20260806 01:03:16.730687 13938 raft_consensus.cc:2781] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:16.730733 13938 raft_consensus.cc:686] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576 [term 1 LEADER]: Becoming Leader. State: Replica: c47ae1cb0ea546699de4511eaa92a576, State: Running, Role: LEADER
I20260806 01:03:16.730820 13938 consensus_queue.cc:237] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:16.731516 13384 catalog_manager.cc:5495] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576 reported cstate change: term changed from 0 to 1, leader changed from <none> to c47ae1cb0ea546699de4511eaa92a576 (127.11.88.66). New cstate: current_term: 1 leader_uuid: "c47ae1cb0ea546699de4511eaa92a576" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } health_report { overall_health: UNKNOWN } } }
I20260806 01:03:16.789333 13895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:16.787063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59902 (local address 127.11.88.66:39565)
0806 01:03:16.787123 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:16.787126 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:16.787135 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:03:16.787180 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:16.787181 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:16.787195 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:16.787251 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:03:16.787366 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.787873 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.788633 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.788847 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.788921 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:16.789069 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:03:16.789109 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:03:16.789169 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:16.789224 (+ 55us) server_negotiation.cc:299] Negotiation successful
0806 01:03:16.789247 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260806 01:03:16.793704 13940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:16.791516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:39565 (local address 127.11.88.66:32955)
0806 01:03:16.791585 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:16.791597 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:16.791642 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:16.791791 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:16.791792 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:16.791793 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 01:03:16.791828 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:16.791829 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.792437 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.792438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:16.792970 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:16.792972 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.793315 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.793316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:16.793365 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:16.793371 (+ 6us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 01:03:16.793545 (+ 174us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 01:03:16.793547 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 01:03:16.793595 (+ 48us) client_negotiation.cc:240] Negotiation successful
0806 01:03:16.793638 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260806 01:03:16.793704 13895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:16.791587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:32955 (local address 127.11.88.66:39565)
0806 01:03:16.791649 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:16.791651 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:16.791661 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:03:16.791691 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:16.791692 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:16.791701 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:16.791764 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:03:16.791909 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.792356 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.793057 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:16.793239 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:16.793318 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:16.793450 (+ 132us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:03:16.793484 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:03:16.793543 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:16.793595 (+ 52us) server_negotiation.cc:299] Negotiation successful
0806 01:03:16.793613 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 01:03:16.796000 13827 raft_consensus.cc:1261] T 569159130149444b9011971dda7aab1d P b2d3a0e8c9fb4c74888184890683e707 [term 1 FOLLOWER]: Refusing update from remote peer c47ae1cb0ea546699de4511eaa92a576: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:16.796006 13543 raft_consensus.cc:1261] T 569159130149444b9011971dda7aab1d P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 1 FOLLOWER]: Refusing update from remote peer c47ae1cb0ea546699de4511eaa92a576: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:16.796231 13919 consensus_queue.cc:1035] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:16.796357 13938 consensus_queue.cc:1035] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 01:03:16.801397 13924 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 01:03:18.320482 13384 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52408:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:18.320590 13384 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52408:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:18.321544 13384 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2a3b965aa73948e4bae990dce3d66436: Sending DeleteTablet for 3 replicas of tablet 569159130149444b9011971dda7aab1d
I20260806 01:03:18.321795 13523 tablet_service.cc:1514] Processing DeleteTablet for tablet 569159130149444b9011971dda7aab1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:18 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:54482
I20260806 01:03:18.321915 13664 tablet_service.cc:1514] Processing DeleteTablet for tablet 569159130149444b9011971dda7aab1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:18 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:59872
I20260806 01:03:18.321902 13807 tablet_service.cc:1514] Processing DeleteTablet for tablet 569159130149444b9011971dda7aab1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:18 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:35412
I20260806 01:03:18.322130 13975 tablet_replica.cc:330] T 569159130149444b9011971dda7aab1d P ea1d9db3a3c2481fa49f4d12de4e89c6: stopping tablet replica
I20260806 01:03:18.322199 13975 raft_consensus.cc:2229] T 569159130149444b9011971dda7aab1d P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:03:18.322479 13975 raft_consensus.cc:2258] T 569159130149444b9011971dda7aab1d P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:18.322799 13975 ts_tablet_manager.cc:1905] T 569159130149444b9011971dda7aab1d P ea1d9db3a3c2481fa49f4d12de4e89c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:18.325132 13975 ts_tablet_manager.cc:1918] T 569159130149444b9011971dda7aab1d P ea1d9db3a3c2481fa49f4d12de4e89c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 01:03:18.325254 13975 log.cc:1196] T 569159130149444b9011971dda7aab1d P ea1d9db3a3c2481fa49f4d12de4e89c6: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-0/wal/wals/569159130149444b9011971dda7aab1d
I20260806 01:03:18.325584 13975 ts_tablet_manager.cc:1939] T 569159130149444b9011971dda7aab1d P ea1d9db3a3c2481fa49f4d12de4e89c6: Deleting consensus metadata
I20260806 01:03:18.326180 13977 tablet_replica.cc:330] T 569159130149444b9011971dda7aab1d P b2d3a0e8c9fb4c74888184890683e707: stopping tablet replica
I20260806 01:03:18.326215 13369 catalog_manager.cc:4841] TS ea1d9db3a3c2481fa49f4d12de4e89c6 (127.11.88.65:35507): tablet 569159130149444b9011971dda7aab1d (table test-table [id=0a0618bb86de443da22ec67e61e1ef73]) successfully deleted
I20260806 01:03:18.326262 13977 raft_consensus.cc:2229] T 569159130149444b9011971dda7aab1d P b2d3a0e8c9fb4c74888184890683e707 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:03:18.326315 13977 raft_consensus.cc:2258] T 569159130149444b9011971dda7aab1d P b2d3a0e8c9fb4c74888184890683e707 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:18.326493 13976 tablet_replica.cc:330] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576: stopping tablet replica
I20260806 01:03:18.326570 13976 raft_consensus.cc:2229] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576 [term 1 LEADER]: Raft consensus shutting down.
I20260806 01:03:18.326691 13976 raft_consensus.cc:2258] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:18.326705 13977 ts_tablet_manager.cc:1905] T 569159130149444b9011971dda7aab1d P b2d3a0e8c9fb4c74888184890683e707: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:18.326946 13976 ts_tablet_manager.cc:1905] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:18.328619 13977 ts_tablet_manager.cc:1918] T 569159130149444b9011971dda7aab1d P b2d3a0e8c9fb4c74888184890683e707: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 01:03:18.328696 13977 log.cc:1196] T 569159130149444b9011971dda7aab1d P b2d3a0e8c9fb4c74888184890683e707: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-2/wal/wals/569159130149444b9011971dda7aab1d
I20260806 01:03:18.328799 13976 ts_tablet_manager.cc:1918] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 01:03:18.328876 13976 log.cc:1196] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-1/wal/wals/569159130149444b9011971dda7aab1d
I20260806 01:03:18.328930 13977 ts_tablet_manager.cc:1939] T 569159130149444b9011971dda7aab1d P b2d3a0e8c9fb4c74888184890683e707: Deleting consensus metadata
I20260806 01:03:18.329128 13976 ts_tablet_manager.cc:1939] T 569159130149444b9011971dda7aab1d P c47ae1cb0ea546699de4511eaa92a576: Deleting consensus metadata
I20260806 01:03:18.329362 13370 catalog_manager.cc:4841] TS b2d3a0e8c9fb4c74888184890683e707 (127.11.88.67:38109): tablet 569159130149444b9011971dda7aab1d (table test-table [id=0a0618bb86de443da22ec67e61e1ef73]) successfully deleted
I20260806 01:03:18.329582 13367 catalog_manager.cc:4841] TS c47ae1cb0ea546699de4511eaa92a576 (127.11.88.66:39565): tablet 569159130149444b9011971dda7aab1d (table test-table [id=0a0618bb86de443da22ec67e61e1ef73]) successfully deleted
Aug 06 01:03:18 dist-test-slave-69rg krb5kdc[13337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978198, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 01:03:18 dist-test-slave-69rg krb5kdc[13337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978198, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:18.353941 13985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:18.340381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52426 (local address 127.11.88.126:45487)
0806 01:03:18.340535 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:18.340537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:18.340549 (+ 12us) server_negotiation.cc:407] Connection header received
0806 01:03:18.340632 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:18.340633 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:18.340651 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:18.340729 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:18.341313 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:18.341907 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:18.342658 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:18.342871 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:18.342951 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:18.350946 (+ 7995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:18.350948 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:18.350948 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:18.350957 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:18.352586 (+ 1629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:18.353027 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:18.353028 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:18.353028 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:18.353094 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:18.353310 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:18.353311 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:18.353311 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:18.353442 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:18.353555 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:18.353704 (+ 149us) server_negotiation.cc:299] Negotiation successful
0806 01:03:18.353800 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":79,"threads_started":1}
I20260806 01:03:18.355690 13384 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52426:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 01:03:18.355854 13384 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:03:18.357432 13807 tablet_service.cc:1467] Processing CreateTablet for tablet 46df9bd6293b430195506d1984cf90ed (DEFAULT_TABLE table=test-table [id=574cb33555c24e27bd35962914a7eb43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:18.357432 13523 tablet_service.cc:1467] Processing CreateTablet for tablet 46df9bd6293b430195506d1984cf90ed (DEFAULT_TABLE table=test-table [id=574cb33555c24e27bd35962914a7eb43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:18.357479 13664 tablet_service.cc:1467] Processing CreateTablet for tablet 46df9bd6293b430195506d1984cf90ed (DEFAULT_TABLE table=test-table [id=574cb33555c24e27bd35962914a7eb43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:18.357601 13807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46df9bd6293b430195506d1984cf90ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:18.357602 13523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46df9bd6293b430195506d1984cf90ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:18.357651 13664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46df9bd6293b430195506d1984cf90ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:18.358848 13986 tablet_bootstrap.cc:492] T 46df9bd6293b430195506d1984cf90ed P c47ae1cb0ea546699de4511eaa92a576: Bootstrap starting.
I20260806 01:03:18.359191 13989 tablet_bootstrap.cc:492] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6: Bootstrap starting.
I20260806 01:03:18.359418 13986 tablet_bootstrap.cc:654] T 46df9bd6293b430195506d1984cf90ed P c47ae1cb0ea546699de4511eaa92a576: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:18.359952 13989 tablet_bootstrap.cc:654] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:18.360221 13986 tablet_bootstrap.cc:492] T 46df9bd6293b430195506d1984cf90ed P c47ae1cb0ea546699de4511eaa92a576: No bootstrap required, opened a new log
I20260806 01:03:18.360288 13986 ts_tablet_manager.cc:1397] T 46df9bd6293b430195506d1984cf90ed P c47ae1cb0ea546699de4511eaa92a576: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:18.360394 13987 tablet_bootstrap.cc:492] T 46df9bd6293b430195506d1984cf90ed P b2d3a0e8c9fb4c74888184890683e707: Bootstrap starting.
I20260806 01:03:18.360425 13986 raft_consensus.cc:348] T 46df9bd6293b430195506d1984cf90ed P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:18.360504 13986 raft_consensus.cc:374] T 46df9bd6293b430195506d1984cf90ed P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:18.360526 13986 raft_consensus.cc:729] T 46df9bd6293b430195506d1984cf90ed P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47ae1cb0ea546699de4511eaa92a576, State: Initialized, Role: FOLLOWER
I20260806 01:03:18.360637 13986 consensus_queue.cc:260] T 46df9bd6293b430195506d1984cf90ed P c47ae1cb0ea546699de4511eaa92a576 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:18.360841 13987 tablet_bootstrap.cc:654] T 46df9bd6293b430195506d1984cf90ed P b2d3a0e8c9fb4c74888184890683e707: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:18.360868 13989 tablet_bootstrap.cc:492] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6: No bootstrap required, opened a new log
I20260806 01:03:18.360904 13986 ts_tablet_manager.cc:1428] T 46df9bd6293b430195506d1984cf90ed P c47ae1cb0ea546699de4511eaa92a576: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:18.360920 13989 ts_tablet_manager.cc:1397] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 01:03:18.361101 13989 raft_consensus.cc:348] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:18.361184 13989 raft_consensus.cc:374] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:18.361209 13989 raft_consensus.cc:729] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea1d9db3a3c2481fa49f4d12de4e89c6, State: Initialized, Role: FOLLOWER
I20260806 01:03:18.361285 13989 consensus_queue.cc:260] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:18.361495 13989 ts_tablet_manager.cc:1428] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:18.362195 13987 tablet_bootstrap.cc:492] T 46df9bd6293b430195506d1984cf90ed P b2d3a0e8c9fb4c74888184890683e707: No bootstrap required, opened a new log
I20260806 01:03:18.362241 13987 ts_tablet_manager.cc:1397] T 46df9bd6293b430195506d1984cf90ed P b2d3a0e8c9fb4c74888184890683e707: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 01:03:18.362411 13987 raft_consensus.cc:348] T 46df9bd6293b430195506d1984cf90ed P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:18.362468 13987 raft_consensus.cc:374] T 46df9bd6293b430195506d1984cf90ed P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:18.362481 13987 raft_consensus.cc:729] T 46df9bd6293b430195506d1984cf90ed P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d3a0e8c9fb4c74888184890683e707, State: Initialized, Role: FOLLOWER
I20260806 01:03:18.362543 13987 consensus_queue.cc:260] T 46df9bd6293b430195506d1984cf90ed P b2d3a0e8c9fb4c74888184890683e707 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:18.362784 13987 ts_tablet_manager.cc:1428] T 46df9bd6293b430195506d1984cf90ed P b2d3a0e8c9fb4c74888184890683e707: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:18.459983 13993 raft_consensus.cc:482] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:03:18.460103 13993 raft_consensus.cc:504] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:18.460510 13993 leader_election.cc:288] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c47ae1cb0ea546699de4511eaa92a576 (127.11.88.66:39565), b2d3a0e8c9fb4c74888184890683e707 (127.11.88.67:38109)
I20260806 01:03:18.463789 13998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:18.460884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:37605 (local address 127.11.88.66:39565)
0806 01:03:18.461037 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:18.461040 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:18.461174 (+ 134us) server_negotiation.cc:407] Connection header received
0806 01:03:18.461209 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:18.461210 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:18.461225 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:18.461308 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:18.461471 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:18.462040 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:18.463010 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:18.463418 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:18.463504 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:18.463515 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:18.463658 (+ 143us) server_negotiation.cc:299] Negotiation successful
0806 01:03:18.463705 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":90,"threads_started":1}
I20260806 01:03:18.463807 13997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:18.460820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:39565 (local address 127.11.88.65:37605)
0806 01:03:18.461051 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:18.461062 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:18.461134 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:18.461314 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:18.461315 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:18.461317 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:18.461377 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:18.461385 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:18.462138 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:18.462139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:18.462913 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:18.462915 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:18.463511 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:18.463512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:18.463582 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:18.463586 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:03:18.463653 (+ 67us) client_negotiation.cc:240] Negotiation successful
0806 01:03:18.463698 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":125,"threads_started":1}
I20260806 01:03:18.464280 13684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46df9bd6293b430195506d1984cf90ed" candidate_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47ae1cb0ea546699de4511eaa92a576" is_pre_election: true
I20260806 01:03:18.464393 13684 raft_consensus.cc:2454] T 46df9bd6293b430195506d1984cf90ed P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea1d9db3a3c2481fa49f4d12de4e89c6 in term 0.
I20260806 01:03:18.464540 13996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:18.460804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:35931 (local address 127.11.88.67:38109)
0806 01:03:18.461013 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:18.461015 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:18.461147 (+ 132us) server_negotiation.cc:407] Connection header received
0806 01:03:18.461185 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:18.461186 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:18.461198 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:18.461264 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:18.461934 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:18.462470 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:18.463538 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:18.464111 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:18.464197 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:18.464206 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:18.464419 (+ 213us) server_negotiation.cc:299] Negotiation successful
0806 01:03:18.464471 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":89,"threads_started":1}
I20260806 01:03:18.464592 13474 leader_election.cc:302] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47ae1cb0ea546699de4511eaa92a576, ea1d9db3a3c2481fa49f4d12de4e89c6; no voters:
I20260806 01:03:18.464646 13995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:18.460734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:38109 (local address 127.11.88.65:35931)
0806 01:03:18.461010 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:18.461023 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:18.461118 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:18.461287 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:18.461287 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:18.461290 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:18.461839 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:18.461842 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:18.462563 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:18.462564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:18.463434 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:18.463436 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:18.464196 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:18.464198 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:18.464324 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:18.464328 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:03:18.464397 (+ 69us) client_negotiation.cc:240] Negotiation successful
0806 01:03:18.464440 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":131,"threads_started":1}
I20260806 01:03:18.464775 13993 raft_consensus.cc:2781] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:03:18.464809 13993 raft_consensus.cc:482] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:03:18.464843 13993 raft_consensus.cc:3037] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:18.464980 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46df9bd6293b430195506d1984cf90ed" candidate_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d3a0e8c9fb4c74888184890683e707" is_pre_election: true
I20260806 01:03:18.465104 13826 raft_consensus.cc:2454] T 46df9bd6293b430195506d1984cf90ed P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea1d9db3a3c2481fa49f4d12de4e89c6 in term 0.
I20260806 01:03:18.465689 13993 raft_consensus.cc:504] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:18.465878 13993 leader_election.cc:288] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6 [CANDIDATE]: Term 1 election: Requested vote from peers c47ae1cb0ea546699de4511eaa92a576 (127.11.88.66:39565), b2d3a0e8c9fb4c74888184890683e707 (127.11.88.67:38109)
I20260806 01:03:18.466015 13684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46df9bd6293b430195506d1984cf90ed" candidate_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47ae1cb0ea546699de4511eaa92a576"
I20260806 01:03:18.466037 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46df9bd6293b430195506d1984cf90ed" candidate_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d3a0e8c9fb4c74888184890683e707"
I20260806 01:03:18.466158 13826 raft_consensus.cc:3037] T 46df9bd6293b430195506d1984cf90ed P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:18.466161 13684 raft_consensus.cc:3037] T 46df9bd6293b430195506d1984cf90ed P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:18.466830 13826 raft_consensus.cc:2454] T 46df9bd6293b430195506d1984cf90ed P b2d3a0e8c9fb4c74888184890683e707 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea1d9db3a3c2481fa49f4d12de4e89c6 in term 1.
I20260806 01:03:18.466857 13684 raft_consensus.cc:2454] T 46df9bd6293b430195506d1984cf90ed P c47ae1cb0ea546699de4511eaa92a576 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea1d9db3a3c2481fa49f4d12de4e89c6 in term 1.
I20260806 01:03:18.467109 13477 leader_election.cc:302] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2d3a0e8c9fb4c74888184890683e707, ea1d9db3a3c2481fa49f4d12de4e89c6; no voters:
I20260806 01:03:18.467226 13993 raft_consensus.cc:2781] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:18.467386 13993 raft_consensus.cc:686] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 1 LEADER]: Becoming Leader. State: Replica: ea1d9db3a3c2481fa49f4d12de4e89c6, State: Running, Role: LEADER
I20260806 01:03:18.467444 13993 consensus_queue.cc:237] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:18.468304 13384 catalog_manager.cc:5495] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea1d9db3a3c2481fa49f4d12de4e89c6 (127.11.88.65). New cstate: current_term: 1 leader_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } health_report { overall_health: UNKNOWN } } }
I20260806 01:03:18.483588 14002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:18.480152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54498 (local address 127.11.88.65:35507)
0806 01:03:18.480325 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:18.480327 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:18.480340 (+ 13us) server_negotiation.cc:407] Connection header received
0806 01:03:18.480413 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:18.480413 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:18.480433 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:18.480504 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:03:18.480662 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:18.481388 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:18.482296 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:18.482558 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:18.482619 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:18.482962 (+ 343us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:03:18.483123 (+ 161us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:03:18.483198 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:18.483291 (+ 93us) server_negotiation.cc:299] Negotiation successful
0806 01:03:18.483314 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":105,"threads_started":1}
I20260806 01:03:18.490875 13998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:18.487160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:42721 (local address 127.11.88.66:39565)
0806 01:03:18.487240 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:18.487242 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:18.487289 (+ 47us) server_negotiation.cc:407] Connection header received
0806 01:03:18.487350 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:18.487351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:18.487364 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:18.487412 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:03:18.487735 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:18.488218 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:18.489944 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:18.490212 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:18.490277 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:18.490589 (+ 312us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:03:18.490625 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:03:18.490676 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:18.490783 (+ 107us) server_negotiation.cc:299] Negotiation successful
0806 01:03:18.490810 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 01:03:18.491020 14005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:18.486933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:39565 (local address 127.11.88.65:42721)
0806 01:03:18.487237 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:18.487248 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:18.487304 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:18.487460 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:18.487461 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:18.487463 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 01:03:18.487605 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:18.487607 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:18.488456 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:18.488458 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:18.489746 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:18.489750 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:18.490331 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:18.490332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:18.490425 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:18.490450 (+ 25us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 01:03:18.490712 (+ 262us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 01:03:18.490714 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 01:03:18.490768 (+ 54us) client_negotiation.cc:240] Negotiation successful
0806 01:03:18.490814 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":76,"threads_started":1}
I20260806 01:03:18.494271 13684 raft_consensus.cc:1261] T 46df9bd6293b430195506d1984cf90ed P c47ae1cb0ea546699de4511eaa92a576 [term 1 FOLLOWER]: Refusing update from remote peer ea1d9db3a3c2481fa49f4d12de4e89c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:18.494357 13826 raft_consensus.cc:1261] T 46df9bd6293b430195506d1984cf90ed P b2d3a0e8c9fb4c74888184890683e707 [term 1 FOLLOWER]: Refusing update from remote peer ea1d9db3a3c2481fa49f4d12de4e89c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:18.494588 13993 consensus_queue.cc:1035] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:18.494789 13999 consensus_queue.cc:1035] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:18.502884 14010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:18.500233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:35507 (local address 127.11.88.66:56167)
0806 01:03:18.500492 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:18.500503 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:18.500569 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:18.500668 (+ 99us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:18.500669 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:18.500671 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 01:03:18.500719 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:18.500720 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:18.501291 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:18.501292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:18.501971 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:18.501975 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:18.502425 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:18.502426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:18.502489 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:18.502494 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 01:03:18.502716 (+ 222us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 01:03:18.502718 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 01:03:18.502756 (+ 38us) client_negotiation.cc:240] Negotiation successful
0806 01:03:18.502809 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":197,"threads_started":1}
I20260806 01:03:18.502871 14002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:18.500267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:56167 (local address 127.11.88.65:35507)
0806 01:03:18.500423 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:18.500425 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:18.500563 (+ 138us) server_negotiation.cc:407] Connection header received
0806 01:03:18.500612 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:18.500613 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:18.500623 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:18.500667 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:03:18.500753 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:18.501225 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:18.502061 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:18.502360 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:18.502425 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:18.502595 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:03:18.502633 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:03:18.502698 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:18.502768 (+ 70us) server_negotiation.cc:299] Negotiation successful
0806 01:03:18.502791 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128}
I20260806 01:03:18.513423 13381 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52426:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:18.513561 13381 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52426:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:18.514343 13381 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2a3b965aa73948e4bae990dce3d66436: Sending DeleteTablet for 3 replicas of tablet 46df9bd6293b430195506d1984cf90ed
I20260806 01:03:18.514624 13664 tablet_service.cc:1514] Processing DeleteTablet for tablet 46df9bd6293b430195506d1984cf90ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:18 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:59872
I20260806 01:03:18.514662 13807 tablet_service.cc:1514] Processing DeleteTablet for tablet 46df9bd6293b430195506d1984cf90ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:18 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:35412
I20260806 01:03:18.514750 13977 tablet_replica.cc:330] T 46df9bd6293b430195506d1984cf90ed P b2d3a0e8c9fb4c74888184890683e707: stopping tablet replica
I20260806 01:03:18.514809 13977 raft_consensus.cc:2229] T 46df9bd6293b430195506d1984cf90ed P b2d3a0e8c9fb4c74888184890683e707 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:03:18.514796 13976 tablet_replica.cc:330] T 46df9bd6293b430195506d1984cf90ed P c47ae1cb0ea546699de4511eaa92a576: stopping tablet replica
I20260806 01:03:18.514858 13977 raft_consensus.cc:2258] T 46df9bd6293b430195506d1984cf90ed P b2d3a0e8c9fb4c74888184890683e707 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:18.514873 13976 raft_consensus.cc:2229] T 46df9bd6293b430195506d1984cf90ed P c47ae1cb0ea546699de4511eaa92a576 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:03:18.514912 13976 raft_consensus.cc:2258] T 46df9bd6293b430195506d1984cf90ed P c47ae1cb0ea546699de4511eaa92a576 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:18.514959 13381 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52426:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 01:03:18.515136 13381 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:03:18.515362 13523 tablet_service.cc:1514] Processing DeleteTablet for tablet 46df9bd6293b430195506d1984cf90ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:18 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:54482
I20260806 01:03:18.515484 13975 tablet_replica.cc:330] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6: stopping tablet replica
I20260806 01:03:18.515559 13975 raft_consensus.cc:2229] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 1 LEADER]: Raft consensus shutting down.
I20260806 01:03:18.515647 13975 raft_consensus.cc:2258] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:18.515755 13976 ts_tablet_manager.cc:1905] T 46df9bd6293b430195506d1984cf90ed P c47ae1cb0ea546699de4511eaa92a576: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:18.515930 13977 ts_tablet_manager.cc:1905] T 46df9bd6293b430195506d1984cf90ed P b2d3a0e8c9fb4c74888184890683e707: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:18.517771 13977 ts_tablet_manager.cc:1918] T 46df9bd6293b430195506d1984cf90ed P b2d3a0e8c9fb4c74888184890683e707: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 01:03:18.517854 13977 log.cc:1196] T 46df9bd6293b430195506d1984cf90ed P b2d3a0e8c9fb4c74888184890683e707: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-2/wal/wals/46df9bd6293b430195506d1984cf90ed
I20260806 01:03:18.517879 13976 ts_tablet_manager.cc:1918] T 46df9bd6293b430195506d1984cf90ed P c47ae1cb0ea546699de4511eaa92a576: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 01:03:18.517936 13976 log.cc:1196] T 46df9bd6293b430195506d1984cf90ed P c47ae1cb0ea546699de4511eaa92a576: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-1/wal/wals/46df9bd6293b430195506d1984cf90ed
I20260806 01:03:18.518115 13977 ts_tablet_manager.cc:1939] T 46df9bd6293b430195506d1984cf90ed P b2d3a0e8c9fb4c74888184890683e707: Deleting consensus metadata
I20260806 01:03:18.518200 13976 ts_tablet_manager.cc:1939] T 46df9bd6293b430195506d1984cf90ed P c47ae1cb0ea546699de4511eaa92a576: Deleting consensus metadata
I20260806 01:03:18.518436 13370 catalog_manager.cc:4841] TS b2d3a0e8c9fb4c74888184890683e707 (127.11.88.67:38109): tablet 46df9bd6293b430195506d1984cf90ed (table test-table [id=574cb33555c24e27bd35962914a7eb43]) successfully deleted
I20260806 01:03:18.518638 13807 tablet_service.cc:1467] Processing CreateTablet for tablet f95f330a6637486a83e68fd4036c3edf (DEFAULT_TABLE table=test-table [id=e45a33ba0096452b83dc11d0b5d95a38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:18.518740 13807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f95f330a6637486a83e68fd4036c3edf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:18.518821 13975 ts_tablet_manager.cc:1905] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:18.519739 13987 tablet_bootstrap.cc:492] T f95f330a6637486a83e68fd4036c3edf P b2d3a0e8c9fb4c74888184890683e707: Bootstrap starting.
I20260806 01:03:18.520045 13987 tablet_bootstrap.cc:654] T f95f330a6637486a83e68fd4036c3edf P b2d3a0e8c9fb4c74888184890683e707: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:18.520617 13987 tablet_bootstrap.cc:492] T f95f330a6637486a83e68fd4036c3edf P b2d3a0e8c9fb4c74888184890683e707: No bootstrap required, opened a new log
I20260806 01:03:18.520624 13975 ts_tablet_manager.cc:1918] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 01:03:18.520692 13975 log.cc:1196] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-0/wal/wals/46df9bd6293b430195506d1984cf90ed
I20260806 01:03:18.520695 13987 ts_tablet_manager.cc:1397] T f95f330a6637486a83e68fd4036c3edf P b2d3a0e8c9fb4c74888184890683e707: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:18.520808 13987 raft_consensus.cc:348] T f95f330a6637486a83e68fd4036c3edf P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:18.520898 13987 raft_consensus.cc:374] T f95f330a6637486a83e68fd4036c3edf P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:18.520927 13987 raft_consensus.cc:729] T f95f330a6637486a83e68fd4036c3edf P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d3a0e8c9fb4c74888184890683e707, State: Initialized, Role: FOLLOWER
I20260806 01:03:18.520970 13975 ts_tablet_manager.cc:1939] T 46df9bd6293b430195506d1984cf90ed P ea1d9db3a3c2481fa49f4d12de4e89c6: Deleting consensus metadata
I20260806 01:03:18.520970 13987 consensus_queue.cc:260] T f95f330a6637486a83e68fd4036c3edf P b2d3a0e8c9fb4c74888184890683e707 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:18.521065 13987 ts_tablet_manager.cc:1428] T f95f330a6637486a83e68fd4036c3edf P b2d3a0e8c9fb4c74888184890683e707: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260806 01:03:18.521288 13523 tablet_service.cc:1467] Processing CreateTablet for tablet f95f330a6637486a83e68fd4036c3edf (DEFAULT_TABLE table=test-table [id=e45a33ba0096452b83dc11d0b5d95a38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:18.521394 13523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f95f330a6637486a83e68fd4036c3edf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:18.522053 13369 catalog_manager.cc:4841] TS ea1d9db3a3c2481fa49f4d12de4e89c6 (127.11.88.65:35507): tablet 46df9bd6293b430195506d1984cf90ed (table test-table [id=574cb33555c24e27bd35962914a7eb43]) successfully deleted
I20260806 01:03:18.522277 13367 catalog_manager.cc:4841] TS c47ae1cb0ea546699de4511eaa92a576 (127.11.88.66:39565): tablet 46df9bd6293b430195506d1984cf90ed (table test-table [id=574cb33555c24e27bd35962914a7eb43]) successfully deleted
I20260806 01:03:18.522418 13664 tablet_service.cc:1467] Processing CreateTablet for tablet f95f330a6637486a83e68fd4036c3edf (DEFAULT_TABLE table=test-table [id=e45a33ba0096452b83dc11d0b5d95a38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:18.522559 13664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f95f330a6637486a83e68fd4036c3edf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:18.522758 13989 tablet_bootstrap.cc:492] T f95f330a6637486a83e68fd4036c3edf P ea1d9db3a3c2481fa49f4d12de4e89c6: Bootstrap starting.
I20260806 01:03:18.523587 13986 tablet_bootstrap.cc:492] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576: Bootstrap starting.
I20260806 01:03:18.523900 13986 tablet_bootstrap.cc:654] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:18.524036 13989 tablet_bootstrap.cc:654] T f95f330a6637486a83e68fd4036c3edf P ea1d9db3a3c2481fa49f4d12de4e89c6: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:18.524601 13986 tablet_bootstrap.cc:492] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576: No bootstrap required, opened a new log
I20260806 01:03:18.524672 13986 ts_tablet_manager.cc:1397] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:18.524947 13986 raft_consensus.cc:348] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:18.525045 13986 raft_consensus.cc:374] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:18.525075 13986 raft_consensus.cc:729] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47ae1cb0ea546699de4511eaa92a576, State: Initialized, Role: FOLLOWER
I20260806 01:03:18.525122 13986 consensus_queue.cc:260] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:18.525235 13986 ts_tablet_manager.cc:1428] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:18.525395 13989 tablet_bootstrap.cc:492] T f95f330a6637486a83e68fd4036c3edf P ea1d9db3a3c2481fa49f4d12de4e89c6: No bootstrap required, opened a new log
I20260806 01:03:18.525457 13989 ts_tablet_manager.cc:1397] T f95f330a6637486a83e68fd4036c3edf P ea1d9db3a3c2481fa49f4d12de4e89c6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 01:03:18.526146 13989 raft_consensus.cc:348] T f95f330a6637486a83e68fd4036c3edf P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:18.526304 13989 raft_consensus.cc:374] T f95f330a6637486a83e68fd4036c3edf P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:18.526335 13989 raft_consensus.cc:729] T f95f330a6637486a83e68fd4036c3edf P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea1d9db3a3c2481fa49f4d12de4e89c6, State: Initialized, Role: FOLLOWER
I20260806 01:03:18.526376 13989 consensus_queue.cc:260] T f95f330a6637486a83e68fd4036c3edf P ea1d9db3a3c2481fa49f4d12de4e89c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:18.526906 13989 ts_tablet_manager.cc:1428] T f95f330a6637486a83e68fd4036c3edf P ea1d9db3a3c2481fa49f4d12de4e89c6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:18.554634 13957 raft_consensus.cc:482] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:03:18.554756 13957 raft_consensus.cc:504] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:18.554931 13957 leader_election.cc:288] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea1d9db3a3c2481fa49f4d12de4e89c6 (127.11.88.65:35507), b2d3a0e8c9fb4c74888184890683e707 (127.11.88.67:38109)
I20260806 01:03:18.555164 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f95f330a6637486a83e68fd4036c3edf" candidate_uuid: "c47ae1cb0ea546699de4511eaa92a576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d3a0e8c9fb4c74888184890683e707" is_pre_election: true
I20260806 01:03:18.555298 13826 raft_consensus.cc:2454] T f95f330a6637486a83e68fd4036c3edf P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c47ae1cb0ea546699de4511eaa92a576 in term 0.
I20260806 01:03:18.555209 13543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f95f330a6637486a83e68fd4036c3edf" candidate_uuid: "c47ae1cb0ea546699de4511eaa92a576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" is_pre_election: true
I20260806 01:03:18.555351 13543 raft_consensus.cc:2454] T f95f330a6637486a83e68fd4036c3edf P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c47ae1cb0ea546699de4511eaa92a576 in term 0.
I20260806 01:03:18.555529 13618 leader_election.cc:302] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2d3a0e8c9fb4c74888184890683e707, c47ae1cb0ea546699de4511eaa92a576; no voters:
I20260806 01:03:18.555665 13957 raft_consensus.cc:2781] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:03:18.555742 13957 raft_consensus.cc:482] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:03:18.555775 13957 raft_consensus.cc:3037] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:18.556640 13957 raft_consensus.cc:504] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:18.556802 13957 leader_election.cc:288] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576 [CANDIDATE]: Term 1 election: Requested vote from peers ea1d9db3a3c2481fa49f4d12de4e89c6 (127.11.88.65:35507), b2d3a0e8c9fb4c74888184890683e707 (127.11.88.67:38109)
I20260806 01:03:18.556969 13543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f95f330a6637486a83e68fd4036c3edf" candidate_uuid: "c47ae1cb0ea546699de4511eaa92a576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6"
I20260806 01:03:18.557010 13826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f95f330a6637486a83e68fd4036c3edf" candidate_uuid: "c47ae1cb0ea546699de4511eaa92a576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d3a0e8c9fb4c74888184890683e707"
I20260806 01:03:18.557075 13543 raft_consensus.cc:3037] T f95f330a6637486a83e68fd4036c3edf P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:18.557111 13826 raft_consensus.cc:3037] T f95f330a6637486a83e68fd4036c3edf P b2d3a0e8c9fb4c74888184890683e707 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:18.557714 13543 raft_consensus.cc:2454] T f95f330a6637486a83e68fd4036c3edf P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47ae1cb0ea546699de4511eaa92a576 in term 1.
I20260806 01:03:18.557919 13617 leader_election.cc:302] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47ae1cb0ea546699de4511eaa92a576, ea1d9db3a3c2481fa49f4d12de4e89c6; no voters:
I20260806 01:03:18.558077 13957 raft_consensus.cc:2781] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:18.558153 13957 raft_consensus.cc:686] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576 [term 1 LEADER]: Becoming Leader. State: Replica: c47ae1cb0ea546699de4511eaa92a576, State: Running, Role: LEADER
I20260806 01:03:18.558220 13957 consensus_queue.cc:237] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } }
I20260806 01:03:18.558418 13826 raft_consensus.cc:2454] T f95f330a6637486a83e68fd4036c3edf P b2d3a0e8c9fb4c74888184890683e707 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47ae1cb0ea546699de4511eaa92a576 in term 1.
I20260806 01:03:18.558954 13384 catalog_manager.cc:5495] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576 reported cstate change: term changed from 0 to 1, leader changed from <none> to c47ae1cb0ea546699de4511eaa92a576 (127.11.88.66). New cstate: current_term: 1 leader_uuid: "c47ae1cb0ea546699de4511eaa92a576" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47ae1cb0ea546699de4511eaa92a576" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 39565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 } health_report { overall_health: UNKNOWN } } }
I20260806 01:03:18.569725 13998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:18.567023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59916 (local address 127.11.88.66:39565)
0806 01:03:18.567064 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:18.567066 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:18.567095 (+ 29us) server_negotiation.cc:407] Connection header received
0806 01:03:18.567171 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:18.567171 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:18.567180 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:18.567225 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:03:18.567360 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:18.567825 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:18.568906 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:18.569148 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:18.569222 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:18.569449 (+ 227us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:03:18.569482 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:03:18.569537 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:18.569637 (+ 100us) server_negotiation.cc:299] Negotiation successful
0806 01:03:18.569661 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260806 01:03:18.572449 13543 raft_consensus.cc:1261] T f95f330a6637486a83e68fd4036c3edf P ea1d9db3a3c2481fa49f4d12de4e89c6 [term 1 FOLLOWER]: Refusing update from remote peer c47ae1cb0ea546699de4511eaa92a576: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:18.572443 13826 raft_consensus.cc:1261] T f95f330a6637486a83e68fd4036c3edf P b2d3a0e8c9fb4c74888184890683e707 [term 1 FOLLOWER]: Refusing update from remote peer c47ae1cb0ea546699de4511eaa92a576: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:18.572690 14018 consensus_queue.cc:1035] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea1d9db3a3c2481fa49f4d12de4e89c6" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:18.572811 13962 consensus_queue.cc:1035] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d3a0e8c9fb4c74888184890683e707" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 01:03:18.578405 13955 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 01:03:20.100545 13381 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52426:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:20.100665 13381 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52426:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:20.101768 13381 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2a3b965aa73948e4bae990dce3d66436: Sending DeleteTablet for 3 replicas of tablet f95f330a6637486a83e68fd4036c3edf
I20260806 01:03:20.102152 13523 tablet_service.cc:1514] Processing DeleteTablet for tablet f95f330a6637486a83e68fd4036c3edf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:20 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:54482
I20260806 01:03:20.102381 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 13458
I20260806 01:03:20.102368 13664 tablet_service.cc:1514] Processing DeleteTablet for tablet f95f330a6637486a83e68fd4036c3edf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:20 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:59872
I20260806 01:03:20.102932 13807 tablet_service.cc:1514] Processing DeleteTablet for tablet f95f330a6637486a83e68fd4036c3edf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:20 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:35412
I20260806 01:03:20.103190 14042 tablet_replica.cc:330] T f95f330a6637486a83e68fd4036c3edf P b2d3a0e8c9fb4c74888184890683e707: stopping tablet replica
I20260806 01:03:20.103273 14042 raft_consensus.cc:2229] T f95f330a6637486a83e68fd4036c3edf P b2d3a0e8c9fb4c74888184890683e707 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:03:20.103340 14042 raft_consensus.cc:2258] T f95f330a6637486a83e68fd4036c3edf P b2d3a0e8c9fb4c74888184890683e707 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:20.103760 14042 ts_tablet_manager.cc:1905] T f95f330a6637486a83e68fd4036c3edf P b2d3a0e8c9fb4c74888184890683e707: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:20.106050 14042 ts_tablet_manager.cc:1918] T f95f330a6637486a83e68fd4036c3edf P b2d3a0e8c9fb4c74888184890683e707: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 01:03:20.106139 14042 log.cc:1196] T f95f330a6637486a83e68fd4036c3edf P b2d3a0e8c9fb4c74888184890683e707: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785978186227899-11617-0/minicluster-data/ts-2/wal/wals/f95f330a6637486a83e68fd4036c3edf
I20260806 01:03:20.106432 14042 ts_tablet_manager.cc:1939] T f95f330a6637486a83e68fd4036c3edf P b2d3a0e8c9fb4c74888184890683e707: Deleting consensus metadata
I20260806 01:03:20.107142 13370 catalog_manager.cc:4841] TS b2d3a0e8c9fb4c74888184890683e707 (127.11.88.67:38109): tablet f95f330a6637486a83e68fd4036c3edf (table test-table [id=e45a33ba0096452b83dc11d0b5d95a38]) successfully deleted
I20260806 01:03:20.109965 14041 tablet_replica.cc:330] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576: stopping tablet replica
I20260806 01:03:20.110085 14041 raft_consensus.cc:2229] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576 [term 1 LEADER]: Raft consensus shutting down.
I20260806 01:03:20.110185 14041 raft_consensus.cc:2258] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:20.110489 14041 ts_tablet_manager.cc:1905] T f95f330a6637486a83e68fd4036c3edf P c47ae1cb0ea546699de4511eaa92a576: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260806 01:03:20.112205 13369 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.88.65:35507 (error 108)
I20260806 01:03:20.112478 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 13599
I20260806 01:03:20.113379 14044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:20.112669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:35507 (local address 127.0.0.1:37358)
0806 01:03:20.113267 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:20.113324 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.65:35507: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":74,"threads_started":1}
W20260806 01:03:20.113533 13369 catalog_manager.cc:4584] TS ea1d9db3a3c2481fa49f4d12de4e89c6 (127.11.88.65:35507): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f95f330a6637486a83e68fd4036c3edf: Network error: Client connection negotiation failed: client connection to 127.11.88.65:35507: connect: Connection refused (error 111)
I20260806 01:03:20.120182 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 13741
I20260806 01:03:20.120226 14044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:20.120089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:39565 (local address 127.0.0.1:56914)
0806 01:03:20.120152 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:20.120180 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.66:39565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260806 01:03:20.127490 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 13351
2026-08-06T01:03:20Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6096 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:03:20 dist-test-slave-69rg krb5kdc[14047](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:03:20 dist-test-slave-69rg krb5kdc[14047](info): set up 2 sockets
Aug 06 01:03:20 dist-test-slave-69rg krb5kdc[14047](info): commencing operation
krb5kdc: starting...
W20260806 01:03:21.211102 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:03:21 dist-test-slave-69rg krb5kdc[14047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:03:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:03:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:03:21.354856 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:38009
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:37467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:38009
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:21.446738 14060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:21.446974 14060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:21.447001 14060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:21.448304 14060 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:03:21.448359 14060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:21.448372 14060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:21.448385 14060 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:03:21.448447 14060 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:03:21.450086 14060 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:37467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:38009
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:38009
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14060
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:21.450400 14060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:21.450670 14060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:21.456393 14068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:21.456439 14066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:21.457056 14065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:21.457137 14060 server_base.cc:1034] running on GCE node
I20260806 01:03:21.457417 14060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:21.457703 14060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:21.458942 14060 hybrid_clock.cc:648] HybridClock initialized: now 1785978201458909 us; error 50 us; skew 500 ppm
Aug 06 01:03:21 dist-test-slave-69rg krb5kdc[14047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978201, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:21.461989 14060 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:03:21.462515 14060 webserver.cc:460] Webserver started at http://127.11.88.126:34519/ using document root <none> and password file <none>
I20260806 01:03:21.462795 14060 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:21.462872 14060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:21.463032 14060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:21.464186 14060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "da249b7468224444b41bed76ca5eb446"
format_stamp: "Formatted at 2026-08-06 01:03:21 on dist-test-slave-69rg"
server_key: "bfdcd053cad9b90389133c9d36f1e543"
server_key_iv: "2f5bf8a4174ed7aa1260983b9aa8a043"
server_key_version: "encryptionkey@0"
I20260806 01:03:21.464566 14060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "da249b7468224444b41bed76ca5eb446"
format_stamp: "Formatted at 2026-08-06 01:03:21 on dist-test-slave-69rg"
server_key: "bfdcd053cad9b90389133c9d36f1e543"
server_key_iv: "2f5bf8a4174ed7aa1260983b9aa8a043"
server_key_version: "encryptionkey@0"
I20260806 01:03:21.466112 14060 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:03:21.466955 14075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:21.467175 14060 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:21.467309 14060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "da249b7468224444b41bed76ca5eb446"
format_stamp: "Formatted at 2026-08-06 01:03:21 on dist-test-slave-69rg"
server_key: "bfdcd053cad9b90389133c9d36f1e543"
server_key_iv: "2f5bf8a4174ed7aa1260983b9aa8a043"
server_key_version: "encryptionkey@0"
I20260806 01:03:21.467392 14060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:21.484695 14060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:21.487210 14060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:21.487399 14060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:21.491907 14060 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:38009
I20260806 01:03:21.491967 14127 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:38009 every 8 connection(s)
I20260806 01:03:21.492369 14060 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:03:21.493319 14128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:21.495678 14128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da249b7468224444b41bed76ca5eb446: Bootstrap starting.
I20260806 01:03:21.496261 14128 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P da249b7468224444b41bed76ca5eb446: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:21.496506 14128 log.cc:824] T 00000000000000000000000000000000 P da249b7468224444b41bed76ca5eb446: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:21.497282 14128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da249b7468224444b41bed76ca5eb446: No bootstrap required, opened a new log
I20260806 01:03:21.499091 14128 raft_consensus.cc:348] T 00000000000000000000000000000000 P da249b7468224444b41bed76ca5eb446 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da249b7468224444b41bed76ca5eb446" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 38009 } }
I20260806 01:03:21.499258 14128 raft_consensus.cc:374] T 00000000000000000000000000000000 P da249b7468224444b41bed76ca5eb446 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:21.499284 14128 raft_consensus.cc:729] T 00000000000000000000000000000000 P da249b7468224444b41bed76ca5eb446 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da249b7468224444b41bed76ca5eb446, State: Initialized, Role: FOLLOWER
I20260806 01:03:21.499442 14128 consensus_queue.cc:260] T 00000000000000000000000000000000 P da249b7468224444b41bed76ca5eb446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da249b7468224444b41bed76ca5eb446" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 38009 } }
I20260806 01:03:21.499529 14128 raft_consensus.cc:388] T 00000000000000000000000000000000 P da249b7468224444b41bed76ca5eb446 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:03:21.499554 14128 raft_consensus.cc:482] T 00000000000000000000000000000000 P da249b7468224444b41bed76ca5eb446 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:03:21.499585 14128 raft_consensus.cc:3037] T 00000000000000000000000000000000 P da249b7468224444b41bed76ca5eb446 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:21.500152 14128 raft_consensus.cc:504] T 00000000000000000000000000000000 P da249b7468224444b41bed76ca5eb446 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da249b7468224444b41bed76ca5eb446" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 38009 } }
I20260806 01:03:21.500248 14128 leader_election.cc:302] T 00000000000000000000000000000000 P da249b7468224444b41bed76ca5eb446 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da249b7468224444b41bed76ca5eb446; no voters:
I20260806 01:03:21.500389 14128 leader_election.cc:288] T 00000000000000000000000000000000 P da249b7468224444b41bed76ca5eb446 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:03:21.500461 14131 raft_consensus.cc:2781] T 00000000000000000000000000000000 P da249b7468224444b41bed76ca5eb446 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:21.500655 14131 raft_consensus.cc:686] T 00000000000000000000000000000000 P da249b7468224444b41bed76ca5eb446 [term 1 LEADER]: Becoming Leader. State: Replica: da249b7468224444b41bed76ca5eb446, State: Running, Role: LEADER
I20260806 01:03:21.500701 14128 sys_catalog.cc:564] T 00000000000000000000000000000000 P da249b7468224444b41bed76ca5eb446 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:03:21.500751 14131 consensus_queue.cc:237] T 00000000000000000000000000000000 P da249b7468224444b41bed76ca5eb446 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da249b7468224444b41bed76ca5eb446" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 38009 } }
I20260806 01:03:21.501468 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 14060
I20260806 01:03:21.501578 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:03:21.501767 11617 external_mini_cluster.cc:1428] Setting key 95f6fa79e0f39329a33916b71cdbcf69
I20260806 01:03:21.502200 14133 sys_catalog.cc:455] T 00000000000000000000000000000000 P da249b7468224444b41bed76ca5eb446 [sys.catalog]: SysCatalogTable state changed. Reason: New leader da249b7468224444b41bed76ca5eb446. Latest consensus state: current_term: 1 leader_uuid: "da249b7468224444b41bed76ca5eb446" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da249b7468224444b41bed76ca5eb446" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 38009 } } }
I20260806 01:03:21.502609 14133 sys_catalog.cc:458] T 00000000000000000000000000000000 P da249b7468224444b41bed76ca5eb446 [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:21.502439 14132 sys_catalog.cc:455] T 00000000000000000000000000000000 P da249b7468224444b41bed76ca5eb446 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "da249b7468224444b41bed76ca5eb446" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da249b7468224444b41bed76ca5eb446" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 38009 } } }
W20260806 01:03:21.502794 14146 catalog_manager.cc:1558] T 00000000000000000000000000000000 P da249b7468224444b41bed76ca5eb446: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 01:03:21.502863 14146 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 01:03:21.502799 14132 sys_catalog.cc:458] T 00000000000000000000000000000000 P da249b7468224444b41bed76ca5eb446 [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:21.503053 14150 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:03:21.503216 14150 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:03:21.504815 14150 catalog_manager.cc:1347] Generated new cluster ID: 5801dba2708a42bcb993ee66bd9f35a0
I20260806 01:03:21.504873 14150 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 01:03:21 dist-test-slave-69rg krb5kdc[14047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:21.512516 14148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:21.502283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39892 (local address 127.11.88.126:38009)
0806 01:03:21.502492 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:21.502503 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:21.502538 (+ 35us) server_negotiation.cc:407] Connection header received
0806 01:03:21.502790 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:21.502836 (+ 46us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:21.502932 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:21.503087 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:21.503756 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:21.505069 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:21.505879 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:21.506333 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:21.506454 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:21.508930 (+ 2476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:21.508936 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:21.508937 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:21.508956 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:21.510799 (+ 1843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:21.511218 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:21.511221 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:21.511222 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:21.511339 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:21.511567 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:21.511568 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:21.511568 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:21.511844 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:21.512032 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:21.512113 (+ 81us) server_negotiation.cc:299] Negotiation successful
0806 01:03:21.512270 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":66,"threads_started":1}
I20260806 01:03:21.523592 14150 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:03:21.524158 14150 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:03:21.527545 14150 catalog_manager.cc:5868] T 00000000000000000000000000000000 P da249b7468224444b41bed76ca5eb446: Generated new TSK 0
I20260806 01:03:21.527746 14150 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.88.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
I20260806 01:03:21.562119 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:0
--local_ip_for_outbound_sockets=127.11.88.65
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:38009
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:37467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:21.661577 14154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:21.661800 14154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:21.661895 14154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:21.663332 14154 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:21.663378 14154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:21.663405 14154 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:03:21.664947 14154 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:37467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:38009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14154
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:21.665215 14154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:21.665469 14154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:21.670717 14159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:21.670737 14160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:21.670862 14162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:21.670934 14154 server_base.cc:1034] running on GCE node
I20260806 01:03:21.671180 14154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:21.671451 14154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:21.672675 14154 hybrid_clock.cc:648] HybridClock initialized: now 1785978201672645 us; error 40 us; skew 500 ppm
Aug 06 01:03:21 dist-test-slave-69rg krb5kdc[14047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978201, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:21.675582 14154 init.cc:377] Logged in from keytab as kudu/127.11.88.65@KRBTEST.COM (short username kudu)
I20260806 01:03:21.676139 14154 webserver.cc:460] Webserver started at http://127.11.88.65:35453/ using document root <none> and password file <none>
I20260806 01:03:21.676419 14154 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:21.676492 14154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:21.676649 14154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:21.677809 14154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/data/instance:
uuid: "d28a34970b2645829cd72c7b0eeecd79"
format_stamp: "Formatted at 2026-08-06 01:03:21 on dist-test-slave-69rg"
server_key: "eb62fff5cd4836ef809d4204a19c3080"
server_key_iv: "d9707266baf494f9d9921bf5a093fa98"
server_key_version: "encryptionkey@0"
I20260806 01:03:21.678298 14154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance:
uuid: "d28a34970b2645829cd72c7b0eeecd79"
format_stamp: "Formatted at 2026-08-06 01:03:21 on dist-test-slave-69rg"
server_key: "eb62fff5cd4836ef809d4204a19c3080"
server_key_iv: "d9707266baf494f9d9921bf5a093fa98"
server_key_version: "encryptionkey@0"
I20260806 01:03:21.679843 14154 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 01:03:21.680711 14169 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:21.680953 14154 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:21.681067 14154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "d28a34970b2645829cd72c7b0eeecd79"
format_stamp: "Formatted at 2026-08-06 01:03:21 on dist-test-slave-69rg"
server_key: "eb62fff5cd4836ef809d4204a19c3080"
server_key_iv: "d9707266baf494f9d9921bf5a093fa98"
server_key_version: "encryptionkey@0"
I20260806 01:03:21.681151 14154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:21.698303 14154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:21.700587 14154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:21.700809 14154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:21.701095 14154 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:21.701475 14154 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:21.701532 14154 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:21.701576 14154 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:21.701606 14154 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:21.707901 14154 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:37277
I20260806 01:03:21.707947 14282 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:37277 every 8 connection(s)
I20260806 01:03:21.708289 14154 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
I20260806 01:03:21.709075 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 14154
I20260806 01:03:21.709194 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance
I20260806 01:03:21.709398 11617 external_mini_cluster.cc:1428] Setting key c148d5dfe7621cc5aab7682e8bb61aaa
Aug 06 01:03:21 dist-test-slave-69rg krb5kdc[14047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978201, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.88.66@KRBTEST.COM; defaulting to no policy
I20260806 01:03:21.720054 14148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:21.709112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:50381 (local address 127.11.88.126:38009)
0806 01:03:21.709193 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:21.709195 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:21.709432 (+ 237us) server_negotiation.cc:407] Connection header received
0806 01:03:21.710132 (+ 700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:21.710133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:21.710150 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:21.710271 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:21.711687 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:21.712343 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:21.713479 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:21.713792 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:21.713903 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:21.716644 (+ 2741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:21.716646 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:21.716646 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:21.716655 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:21.718446 (+ 1791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:21.718928 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:21.718929 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:21.718929 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:21.718996 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:21.719276 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:21.719277 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:21.719277 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:21.719450 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:21.719531 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:21.719806 (+ 275us) server_negotiation.cc:299] Negotiation successful
0806 01:03:21.719928 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 01:03:21.720307 14285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:21.709066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:38009 (local address 127.11.88.65:50381)
0806 01:03:21.709285 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:21.709335 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:21.709995 (+ 660us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:21.710367 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:21.710372 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:21.711267 (+ 895us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:21.711557 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:21.711564 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:21.712471 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:21.712472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:21.713367 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:21.713369 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:21.713959 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:21.713960 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:21.714105 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:21.714745 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:21.714760 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:21.716529 (+ 1769us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:21.718543 (+ 2014us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:21.718551 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:21.718553 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:21.718835 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:21.719079 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:21.719079 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:21.719080 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:21.719196 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:21.719528 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:21.719533 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:21.719664 (+ 131us) client_negotiation.cc:769] Sending connection context
0806 01:03:21.719768 (+ 104us) client_negotiation.cc:240] Negotiation successful
0806 01:03:21.719958 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":92,"threads_started":1}
I20260806 01:03:21.720943 14283 heartbeater.cc:347] Connected to a master server at 127.11.88.126:38009
I20260806 01:03:21.721076 14283 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:21.721284 14283 heartbeater.cc:511] Master 127.11.88.126:38009 requested a full tablet report, sending...
I20260806 01:03:21.721985 14092 ts_manager.cc:194] Registered new tserver with Master: d28a34970b2645829cd72c7b0eeecd79 (127.11.88.65:37277)
I20260806 01:03:21.722628 14092 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.65@KRBTEST.COM'} at 127.11.88.65:50381
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
I20260806 01:03:21.742736 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:0
--local_ip_for_outbound_sockets=127.11.88.66
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:38009
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:37467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:21.828779 14288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:21.828991 14288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:21.829017 14288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:21.830222 14288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:21.830257 14288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:21.830286 14288 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:03:21.831686 14288 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:37467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:38009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14288
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:21.831873 14288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:21.832067 14288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:21.837363 14294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:21.837496 14293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:21.837639 14296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:21.837505 14288 server_base.cc:1034] running on GCE node
I20260806 01:03:21.837940 14288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:21.838246 14288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:21.839407 14288 hybrid_clock.cc:648] HybridClock initialized: now 1785978201839393 us; error 29 us; skew 500 ppm
Aug 06 01:03:21 dist-test-slave-69rg krb5kdc[14047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978201, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:21.842058 14288 init.cc:377] Logged in from keytab as kudu/127.11.88.66@KRBTEST.COM (short username kudu)
I20260806 01:03:21.842607 14288 webserver.cc:460] Webserver started at http://127.11.88.66:46141/ using document root <none> and password file <none>
I20260806 01:03:21.842859 14288 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:21.842932 14288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:21.843091 14288 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:21.844205 14288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/data/instance:
uuid: "16d323042e3e4f13b8e0ec41b177116d"
format_stamp: "Formatted at 2026-08-06 01:03:21 on dist-test-slave-69rg"
server_key: "dcd817cef9ccb70fe914849fef06249f"
server_key_iv: "a19e7605f6a7d9e5f1c8aaab20825638"
server_key_version: "encryptionkey@0"
I20260806 01:03:21.844589 14288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance:
uuid: "16d323042e3e4f13b8e0ec41b177116d"
format_stamp: "Formatted at 2026-08-06 01:03:21 on dist-test-slave-69rg"
server_key: "dcd817cef9ccb70fe914849fef06249f"
server_key_iv: "a19e7605f6a7d9e5f1c8aaab20825638"
server_key_version: "encryptionkey@0"
I20260806 01:03:21.846024 14288 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260806 01:03:21.846863 14303 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:21.847047 14288 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:21.847159 14288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "16d323042e3e4f13b8e0ec41b177116d"
format_stamp: "Formatted at 2026-08-06 01:03:21 on dist-test-slave-69rg"
server_key: "dcd817cef9ccb70fe914849fef06249f"
server_key_iv: "a19e7605f6a7d9e5f1c8aaab20825638"
server_key_version: "encryptionkey@0"
I20260806 01:03:21.847275 14288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:21.862427 14288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:21.864727 14288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:21.864907 14288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:21.865209 14288 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:21.865543 14288 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:21.865597 14288 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:21.865633 14288 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:21.865680 14288 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:21.872023 14288 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:33351
I20260806 01:03:21.872079 14420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:33351 every 8 connection(s)
I20260806 01:03:21.872411 14288 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
Aug 06 01:03:21 dist-test-slave-69rg krb5kdc[14047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978201, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:21.878866 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 14288
I20260806 01:03:21.878954 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance
I20260806 01:03:21.879142 11617 external_mini_cluster.cc:1428] Setting key f6f23de4d3e69d25c33eaeb5c52c0eb5
I20260806 01:03:21.882509 14148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:21.873083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:42025 (local address 127.11.88.126:38009)
0806 01:03:21.873162 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:21.873164 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:21.873395 (+ 231us) server_negotiation.cc:407] Connection header received
0806 01:03:21.873930 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:21.873931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:21.873942 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:21.873998 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:21.874951 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:21.875488 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:21.876512 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:21.876709 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:21.876764 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:21.879154 (+ 2390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:21.879157 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:21.879157 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:21.879164 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:21.880804 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:21.881347 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:21.881348 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:21.881348 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:21.881404 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:21.881741 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:21.881743 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:21.881743 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:21.881923 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:21.881962 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:21.882280 (+ 318us) server_negotiation.cc:299] Negotiation successful
0806 01:03:21.882383 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 01:03:21.882529 14423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:21.873066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:38009 (local address 127.11.88.66:42025)
0806 01:03:21.873234 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:21.873278 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:21.873782 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:21.874060 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:21.874063 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:21.874636 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:21.874846 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:21.874850 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:21.875575 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:21.875576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:21.876424 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:21.876427 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:21.876794 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:21.876795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:21.876919 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:21.877499 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:21.877508 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:21.879042 (+ 1534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:21.880902 (+ 1860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:21.880912 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:21.880915 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:21.881268 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:21.881474 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:21.881474 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:21.881475 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:21.881633 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:21.882003 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:21.882009 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:21.882135 (+ 126us) client_negotiation.cc:769] Sending connection context
0806 01:03:21.882220 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 01:03:21.882354 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":95,"threads_started":1}
I20260806 01:03:21.883069 14421 heartbeater.cc:347] Connected to a master server at 127.11.88.126:38009
I20260806 01:03:21.883194 14421 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:21.883411 14421 heartbeater.cc:511] Master 127.11.88.126:38009 requested a full tablet report, sending...
I20260806 01:03:21.883857 14092 ts_manager.cc:194] Registered new tserver with Master: 16d323042e3e4f13b8e0ec41b177116d (127.11.88.66:33351)
I20260806 01:03:21.884439 14092 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.66@KRBTEST.COM'} at 127.11.88.66:42025
WARNING: no policy specified for kudu/127.11.88.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
I20260806 01:03:21.910096 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:0
--local_ip_for_outbound_sockets=127.11.88.67
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:38009
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:37467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:21.994413 14426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:21.994639 14426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:21.994663 14426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:21.995918 14426 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:21.995971 14426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:21.996001 14426 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:03:21.997756 14426 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:37467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:38009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14426
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:21.998149 14426 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:21.998422 14426 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 01:03:22.004668 14426 server_base.cc:1034] running on GCE node
W20260806 01:03:22.004604 14432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:22.004594 14431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:22.004608 14434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:22.005110 14426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:22.005402 14426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:22.006597 14426 hybrid_clock.cc:648] HybridClock initialized: now 1785978202006549 us; error 58 us; skew 500 ppm
Aug 06 01:03:22 dist-test-slave-69rg krb5kdc[14047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978202, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:22.009552 14426 init.cc:377] Logged in from keytab as kudu/127.11.88.67@KRBTEST.COM (short username kudu)
I20260806 01:03:22.010111 14426 webserver.cc:460] Webserver started at http://127.11.88.67:45733/ using document root <none> and password file <none>
I20260806 01:03:22.010392 14426 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:22.010442 14426 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:22.010581 14426 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:22.011737 14426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/data/instance:
uuid: "e48b4a3a3c7f4e9797a0a5b45f4ea4f6"
format_stamp: "Formatted at 2026-08-06 01:03:22 on dist-test-slave-69rg"
server_key: "1be67e48d7597f536ed41338b87ae9f0"
server_key_iv: "57009a2cb441777b901f4c8640ab5134"
server_key_version: "encryptionkey@0"
I20260806 01:03:22.012148 14426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance:
uuid: "e48b4a3a3c7f4e9797a0a5b45f4ea4f6"
format_stamp: "Formatted at 2026-08-06 01:03:22 on dist-test-slave-69rg"
server_key: "1be67e48d7597f536ed41338b87ae9f0"
server_key_iv: "57009a2cb441777b901f4c8640ab5134"
server_key_version: "encryptionkey@0"
I20260806 01:03:22.014075 14426 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260806 01:03:22.015236 14441 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:22.015565 14426 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:22.015658 14426 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "e48b4a3a3c7f4e9797a0a5b45f4ea4f6"
format_stamp: "Formatted at 2026-08-06 01:03:22 on dist-test-slave-69rg"
server_key: "1be67e48d7597f536ed41338b87ae9f0"
server_key_iv: "57009a2cb441777b901f4c8640ab5134"
server_key_version: "encryptionkey@0"
I20260806 01:03:22.015800 14426 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:22.028220 14426 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:22.030881 14426 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:22.031051 14426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:22.031384 14426 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:22.031739 14426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:22.031797 14426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:22.031836 14426 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:22.031881 14426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:22.038690 14426 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:39325
I20260806 01:03:22.038736 14556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:39325 every 8 connection(s)
I20260806 01:03:22.039081 14426 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
Aug 06 01:03:22 dist-test-slave-69rg krb5kdc[14047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978202, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:22.046142 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 14426
I20260806 01:03:22.046258 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance
I20260806 01:03:22.046445 11617 external_mini_cluster.cc:1428] Setting key 31cc5462fd73557944fe39129250c3da
I20260806 01:03:22.049875 14148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:22.039831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:42011 (local address 127.11.88.126:38009)
0806 01:03:22.039944 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:22.039947 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:22.040119 (+ 172us) server_negotiation.cc:407] Connection header received
0806 01:03:22.040710 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:22.040712 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:22.040725 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:22.040783 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:22.041786 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:22.042356 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:22.043460 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:22.043665 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:22.043756 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:22.046232 (+ 2476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:22.046234 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:22.046235 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:22.046242 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:22.048179 (+ 1937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:22.048671 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:22.048673 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:22.048673 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:22.048750 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:22.049051 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:22.049052 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:22.049053 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:22.049200 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:22.049287 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:22.049634 (+ 347us) server_negotiation.cc:299] Negotiation successful
0806 01:03:22.049738 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 01:03:22.050135 14559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:22.039741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:38009 (local address 127.11.88.67:42011)
0806 01:03:22.039979 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:22.040034 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:22.040577 (+ 543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:22.040855 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:22.040860 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:22.041469 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:22.041681 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:22.041686 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:22.042470 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:22.042471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:22.043365 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:22.043367 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:22.043767 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:22.043769 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:22.043897 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:22.044488 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:22.044496 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:22.046095 (+ 1599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:22.048284 (+ 2189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:22.048296 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:22.048299 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:22.048577 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:22.048836 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:22.048837 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:22.048837 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:22.048974 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:22.049290 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:22.049299 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:22.049477 (+ 178us) client_negotiation.cc:769] Sending connection context
0806 01:03:22.049604 (+ 127us) client_negotiation.cc:240] Negotiation successful
0806 01:03:22.049802 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":96,"threads_started":1}
I20260806 01:03:22.050612 14557 heartbeater.cc:347] Connected to a master server at 127.11.88.126:38009
I20260806 01:03:22.050746 14557 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:22.050968 14557 heartbeater.cc:511] Master 127.11.88.126:38009 requested a full tablet report, sending...
I20260806 01:03:22.051469 14092 ts_manager.cc:194] Registered new tserver with Master: e48b4a3a3c7f4e9797a0a5b45f4ea4f6 (127.11.88.67:39325)
I20260806 01:03:22.051942 14092 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.67@KRBTEST.COM'} at 127.11.88.67:42011
I20260806 01:03:22.058737 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 01:03:22.075755 14148 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:22.074448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39902 (local address 127.11.88.126:38009)
0806 01:03:22.074562 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:22.074564 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:22.074638 (+ 74us) server_negotiation.cc:407] Connection header received
0806 01:03:22.074717 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:22.074718 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:22.074729 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:22.074788 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:22.075655 (+ 867us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39902: BlockingRecv error: recv got EOF from 127.0.0.1:39902 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
I20260806 01:03:22.077196 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 14154
I20260806 01:03:22.083868 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 14288
I20260806 01:03:22.090027 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 14426
I20260806 01:03:22.095743 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 14060
2026-08-06T01:03:22Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1966 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:03:22 dist-test-slave-69rg krb5kdc[14569](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:03:22 dist-test-slave-69rg krb5kdc[14569](info): set up 2 sockets
Aug 06 01:03:22 dist-test-slave-69rg krb5kdc[14569](info): commencing operation
krb5kdc: starting...
W20260806 01:03:23.170637 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.052s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:03:23 dist-test-slave-69rg krb5kdc[14569](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978203, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:03:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:03:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:03:23.310952 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:35113
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:35959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:35113
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:23.397462 14582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:23.397710 14582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:23.397749 14582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:23.399005 14582 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:03:23.399076 14582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:23.399102 14582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:23.399143 14582 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:03:23.399171 14582 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:03:23.400734 14582 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:35959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:35113
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:35113
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14582
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:23.401026 14582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:23.401268 14582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:23.406141 14587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:23.406193 14588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:23.406368 14582 server_base.cc:1034] running on GCE node
W20260806 01:03:23.406193 14590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:23.406668 14582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:23.406968 14582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:23.408133 14582 hybrid_clock.cc:648] HybridClock initialized: now 1785978203408127 us; error 36 us; skew 500 ppm
Aug 06 01:03:23 dist-test-slave-69rg krb5kdc[14569](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978203, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:23.414669 14582 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:03:23.415221 14582 webserver.cc:460] Webserver started at http://127.11.88.126:33489/ using document root <none> and password file <none>
I20260806 01:03:23.415501 14582 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:23.415555 14582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:23.415715 14582 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:23.416862 14582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "3a5e026331ae43798a7cfcf2881a49c9"
format_stamp: "Formatted at 2026-08-06 01:03:23 on dist-test-slave-69rg"
server_key: "ed3340533ebcc91dafa395d43ce6ab54"
server_key_iv: "6e11f89ef216ad0c6169ce647b140626"
server_key_version: "encryptionkey@0"
I20260806 01:03:23.417224 14582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "3a5e026331ae43798a7cfcf2881a49c9"
format_stamp: "Formatted at 2026-08-06 01:03:23 on dist-test-slave-69rg"
server_key: "ed3340533ebcc91dafa395d43ce6ab54"
server_key_iv: "6e11f89ef216ad0c6169ce647b140626"
server_key_version: "encryptionkey@0"
I20260806 01:03:23.418823 14582 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 01:03:23.419726 14597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:23.419968 14582 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:03:23.420082 14582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "3a5e026331ae43798a7cfcf2881a49c9"
format_stamp: "Formatted at 2026-08-06 01:03:23 on dist-test-slave-69rg"
server_key: "ed3340533ebcc91dafa395d43ce6ab54"
server_key_iv: "6e11f89ef216ad0c6169ce647b140626"
server_key_version: "encryptionkey@0"
I20260806 01:03:23.420145 14582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:23.448865 14582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:23.451323 14582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:23.451442 14582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:23.455674 14582 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:35113
I20260806 01:03:23.455751 14649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:35113 every 8 connection(s)
I20260806 01:03:23.456241 14582 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:03:23.457077 14650 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:23.457614 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 14582
I20260806 01:03:23.457737 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:03:23.457944 11617 external_mini_cluster.cc:1428] Setting key c7196a791496e3378589bffe16cc817e
I20260806 01:03:23.460304 14650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a5e026331ae43798a7cfcf2881a49c9: Bootstrap starting.
I20260806 01:03:23.460956 14650 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a5e026331ae43798a7cfcf2881a49c9: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:23.461270 14650 log.cc:824] T 00000000000000000000000000000000 P 3a5e026331ae43798a7cfcf2881a49c9: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:23.462155 14650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a5e026331ae43798a7cfcf2881a49c9: No bootstrap required, opened a new log
I20260806 01:03:23.464862 14650 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a5e026331ae43798a7cfcf2881a49c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5e026331ae43798a7cfcf2881a49c9" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 35113 } }
I20260806 01:03:23.465005 14650 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a5e026331ae43798a7cfcf2881a49c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:23.465029 14650 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a5e026331ae43798a7cfcf2881a49c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a5e026331ae43798a7cfcf2881a49c9, State: Initialized, Role: FOLLOWER
I20260806 01:03:23.465168 14650 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a5e026331ae43798a7cfcf2881a49c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5e026331ae43798a7cfcf2881a49c9" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 35113 } }
I20260806 01:03:23.465248 14650 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a5e026331ae43798a7cfcf2881a49c9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:03:23.465276 14650 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a5e026331ae43798a7cfcf2881a49c9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:03:23.465342 14650 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a5e026331ae43798a7cfcf2881a49c9 [term 0 FOLLOWER]: Advancing to term 1
Aug 06 01:03:23 dist-test-slave-69rg krb5kdc[14569](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978203, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:23.466058 14650 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a5e026331ae43798a7cfcf2881a49c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5e026331ae43798a7cfcf2881a49c9" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 35113 } }
I20260806 01:03:23.466187 14650 leader_election.cc:302] T 00000000000000000000000000000000 P 3a5e026331ae43798a7cfcf2881a49c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a5e026331ae43798a7cfcf2881a49c9; no voters:
I20260806 01:03:23.466400 14650 leader_election.cc:288] T 00000000000000000000000000000000 P 3a5e026331ae43798a7cfcf2881a49c9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:03:23.466434 14655 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a5e026331ae43798a7cfcf2881a49c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:23.466580 14655 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a5e026331ae43798a7cfcf2881a49c9 [term 1 LEADER]: Becoming Leader. State: Replica: 3a5e026331ae43798a7cfcf2881a49c9, State: Running, Role: LEADER
I20260806 01:03:23.466718 14650 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a5e026331ae43798a7cfcf2881a49c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:03:23.466713 14655 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a5e026331ae43798a7cfcf2881a49c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5e026331ae43798a7cfcf2881a49c9" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 35113 } }
I20260806 01:03:23.467677 14656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a5e026331ae43798a7cfcf2881a49c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a5e026331ae43798a7cfcf2881a49c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5e026331ae43798a7cfcf2881a49c9" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 35113 } } }
I20260806 01:03:23.467716 14657 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a5e026331ae43798a7cfcf2881a49c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a5e026331ae43798a7cfcf2881a49c9. Latest consensus state: current_term: 1 leader_uuid: "3a5e026331ae43798a7cfcf2881a49c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5e026331ae43798a7cfcf2881a49c9" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 35113 } } }
I20260806 01:03:23.467764 14656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a5e026331ae43798a7cfcf2881a49c9 [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:23.467794 14657 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a5e026331ae43798a7cfcf2881a49c9 [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:23.467976 14665 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:03:23.468659 14665 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:03:23.470052 14653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:23.458572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57920 (local address 127.11.88.126:35113)
0806 01:03:23.458761 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:23.458768 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:23.458794 (+ 26us) server_negotiation.cc:407] Connection header received
0806 01:03:23.459204 (+ 410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:23.459210 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:23.459257 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:23.459372 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:23.460256 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:23.461366 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:23.462509 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:23.462929 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:23.463022 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:23.466007 (+ 2985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:23.466012 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:23.466012 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:23.466025 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:23.468273 (+ 2248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:23.468773 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:23.468776 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:23.468776 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:23.468882 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:23.469103 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:23.469104 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:23.469105 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:23.469418 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:23.469590 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:23.469679 (+ 89us) server_negotiation.cc:299] Negotiation successful
0806 01:03:23.469842 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":86,"threads_started":1}
I20260806 01:03:23.471328 11617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 01:03:23.474983 14665 catalog_manager.cc:1347] Generated new cluster ID: 44578239fcbe4ef39c063974ec1b25ee
I20260806 01:03:23.475045 14665 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:03:23.484105 14665 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:03:23.484884 14665 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:03:23.488653 14653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:23.484141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57936 (local address 127.11.88.126:35113)
0806 01:03:23.484234 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:23.484237 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:23.484484 (+ 247us) server_negotiation.cc:407] Connection header received
0806 01:03:23.484539 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:23.484540 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:23.484552 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:23.484622 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:23.485101 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:23.485875 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:23.487006 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:23.487323 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:23.487384 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:23.488137 (+ 753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:23.488138 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:23.488138 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:03:23.488361 (+ 223us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:23.488379 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:03:23.488385 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:23.488439 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:23.488521 (+ 82us) server_negotiation.cc:299] Negotiation successful
0806 01:03:23.488566 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 01:03:23.497656 14665 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a5e026331ae43798a7cfcf2881a49c9: Generated new TSK 0
I20260806 01:03:23.497907 14665 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:03:23.505700 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 14582
2026-08-06T01:03:23Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1407 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:03:23 dist-test-slave-69rg krb5kdc[14684](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:03:23 dist-test-slave-69rg krb5kdc[14684](info): set up 2 sockets
Aug 06 01:03:23 dist-test-slave-69rg krb5kdc[14684](info): commencing operation
krb5kdc: starting...
W20260806 01:03:24.574519 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.050s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:03:24 dist-test-slave-69rg krb5kdc[14684](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978204, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:03:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:03:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:03:24.700994 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:40169
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:35065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:40169
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:24.791406 14697 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:24.791735 14697 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:24.791787 14697 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:24.793210 14697 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:03:24.793320 14697 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:24.793354 14697 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:24.793387 14697 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:03:24.793417 14697 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:03:24.795333 14697 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:35065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:40169
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:40169
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14697
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:24.795668 14697 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:24.795936 14697 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:24.801613 14703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:24.801594 14705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:24.801594 14702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:24.802058 14697 server_base.cc:1034] running on GCE node
I20260806 01:03:24.802336 14697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:24.802644 14697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:24.803803 14697 hybrid_clock.cc:648] HybridClock initialized: now 1785978204803788 us; error 28 us; skew 500 ppm
Aug 06 01:03:24 dist-test-slave-69rg krb5kdc[14684](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978204, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:24.806619 14697 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:03:24.807163 14697 webserver.cc:460] Webserver started at http://127.11.88.126:42855/ using document root <none> and password file <none>
I20260806 01:03:24.807404 14697 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:24.807472 14697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:24.807634 14697 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:24.808748 14697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "555cdb6188b04188b0b692c8800d3f61"
format_stamp: "Formatted at 2026-08-06 01:03:24 on dist-test-slave-69rg"
server_key: "c9abd4425508758d7b2975a75fa6dcc9"
server_key_iv: "d4830cdadda983c3caac4f3a6f9fd9e5"
server_key_version: "encryptionkey@0"
I20260806 01:03:24.809131 14697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "555cdb6188b04188b0b692c8800d3f61"
format_stamp: "Formatted at 2026-08-06 01:03:24 on dist-test-slave-69rg"
server_key: "c9abd4425508758d7b2975a75fa6dcc9"
server_key_iv: "d4830cdadda983c3caac4f3a6f9fd9e5"
server_key_version: "encryptionkey@0"
I20260806 01:03:24.810613 14697 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 01:03:24.811368 14712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:24.811550 14697 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 01:03:24.811661 14697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "555cdb6188b04188b0b692c8800d3f61"
format_stamp: "Formatted at 2026-08-06 01:03:24 on dist-test-slave-69rg"
server_key: "c9abd4425508758d7b2975a75fa6dcc9"
server_key_iv: "d4830cdadda983c3caac4f3a6f9fd9e5"
server_key_version: "encryptionkey@0"
I20260806 01:03:24.811738 14697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:24.825063 14697 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:24.828207 14697 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:24.828459 14697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:24.833604 14697 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:40169
I20260806 01:03:24.833711 14764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:40169 every 8 connection(s)
I20260806 01:03:24.834141 14697 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:03:24.835414 14765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:24.837478 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 14697
I20260806 01:03:24.837615 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:03:24.837797 11617 external_mini_cluster.cc:1428] Setting key e381fe687f225fa751035f8d758cf6e3
I20260806 01:03:24.838268 14765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 555cdb6188b04188b0b692c8800d3f61: Bootstrap starting.
I20260806 01:03:24.839028 14765 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 555cdb6188b04188b0b692c8800d3f61: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:24.839366 14765 log.cc:824] T 00000000000000000000000000000000 P 555cdb6188b04188b0b692c8800d3f61: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:24.840137 14765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 555cdb6188b04188b0b692c8800d3f61: No bootstrap required, opened a new log
I20260806 01:03:24.842134 14765 raft_consensus.cc:348] T 00000000000000000000000000000000 P 555cdb6188b04188b0b692c8800d3f61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "555cdb6188b04188b0b692c8800d3f61" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40169 } }
I20260806 01:03:24.842317 14765 raft_consensus.cc:374] T 00000000000000000000000000000000 P 555cdb6188b04188b0b692c8800d3f61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:24.842370 14765 raft_consensus.cc:729] T 00000000000000000000000000000000 P 555cdb6188b04188b0b692c8800d3f61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 555cdb6188b04188b0b692c8800d3f61, State: Initialized, Role: FOLLOWER
I20260806 01:03:24.842535 14765 consensus_queue.cc:260] T 00000000000000000000000000000000 P 555cdb6188b04188b0b692c8800d3f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "555cdb6188b04188b0b692c8800d3f61" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40169 } }
I20260806 01:03:24.842655 14765 raft_consensus.cc:388] T 00000000000000000000000000000000 P 555cdb6188b04188b0b692c8800d3f61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:03:24.842720 14765 raft_consensus.cc:482] T 00000000000000000000000000000000 P 555cdb6188b04188b0b692c8800d3f61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:03:24.842772 14765 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 555cdb6188b04188b0b692c8800d3f61 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:24.843590 14765 raft_consensus.cc:504] T 00000000000000000000000000000000 P 555cdb6188b04188b0b692c8800d3f61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "555cdb6188b04188b0b692c8800d3f61" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40169 } }
I20260806 01:03:24.843726 14765 leader_election.cc:302] T 00000000000000000000000000000000 P 555cdb6188b04188b0b692c8800d3f61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 555cdb6188b04188b0b692c8800d3f61; no voters:
I20260806 01:03:24.843942 14765 leader_election.cc:288] T 00000000000000000000000000000000 P 555cdb6188b04188b0b692c8800d3f61 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:03:24.843968 14770 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 555cdb6188b04188b0b692c8800d3f61 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:24.844101 14770 raft_consensus.cc:686] T 00000000000000000000000000000000 P 555cdb6188b04188b0b692c8800d3f61 [term 1 LEADER]: Becoming Leader. State: Replica: 555cdb6188b04188b0b692c8800d3f61, State: Running, Role: LEADER
I20260806 01:03:24.844251 14765 sys_catalog.cc:564] T 00000000000000000000000000000000 P 555cdb6188b04188b0b692c8800d3f61 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:03:24.844364 14770 consensus_queue.cc:237] T 00000000000000000000000000000000 P 555cdb6188b04188b0b692c8800d3f61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "555cdb6188b04188b0b692c8800d3f61" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40169 } }
I20260806 01:03:24.844821 14771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 555cdb6188b04188b0b692c8800d3f61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "555cdb6188b04188b0b692c8800d3f61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "555cdb6188b04188b0b692c8800d3f61" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40169 } } }
I20260806 01:03:24.844854 14772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 555cdb6188b04188b0b692c8800d3f61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 555cdb6188b04188b0b692c8800d3f61. Latest consensus state: current_term: 1 leader_uuid: "555cdb6188b04188b0b692c8800d3f61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "555cdb6188b04188b0b692c8800d3f61" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40169 } } }
I20260806 01:03:24.844957 14772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 555cdb6188b04188b0b692c8800d3f61 [sys.catalog]: This master's current role is: LEADER
Aug 06 01:03:24 dist-test-slave-69rg krb5kdc[14684](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978204, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:24.844911 14771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 555cdb6188b04188b0b692c8800d3f61 [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:24.845286 14778 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:03:24.845913 14778 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:03:24.849133 14768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:24.838492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55232 (local address 127.11.88.126:40169)
0806 01:03:24.838730 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:24.838738 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:24.838766 (+ 28us) server_negotiation.cc:407] Connection header received
0806 01:03:24.839294 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:24.839302 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:24.839360 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:24.839536 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:24.840250 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:24.841169 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:24.842085 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:24.842612 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:24.842736 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:24.845596 (+ 2860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:24.845601 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:24.845601 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:24.845614 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:24.847534 (+ 1920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:24.847923 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:24.847926 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:24.847926 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:24.848027 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:24.848250 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:24.848251 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:24.848251 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:24.848502 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:24.848667 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:24.848786 (+ 119us) server_negotiation.cc:299] Negotiation successful
0806 01:03:24.848934 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":81,"threads_started":1}
I20260806 01:03:24.853279 14778 catalog_manager.cc:1347] Generated new cluster ID: 95f78562381b404e9f368d7d86bf8f05
I20260806 01:03:24.853359 14778 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:03:24.864411 14778 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:03:24.865283 14778 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:03:24.870139 14778 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 555cdb6188b04188b0b692c8800d3f61: Generated new TSK 0
I20260806 01:03:24.870393 14778 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.88.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
I20260806 01:03:24.906028 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:0
--local_ip_for_outbound_sockets=127.11.88.65
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:40169
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:35065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:24.998744 14791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:24.999017 14791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:24.999064 14791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:25.000454 14791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:25.000538 14791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:25.000591 14791 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:03:25.002528 14791 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:35065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:40169
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14791
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:25.002851 14791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:25.003136 14791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:25.009198 14796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:25.009225 14797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:25.009198 14799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:25.009666 14791 server_base.cc:1034] running on GCE node
I20260806 01:03:25.009950 14791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:25.010294 14791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:25.011494 14791 hybrid_clock.cc:648] HybridClock initialized: now 1785978205011486 us; error 38 us; skew 500 ppm
Aug 06 01:03:25 dist-test-slave-69rg krb5kdc[14684](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978205, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:25.014456 14791 init.cc:377] Logged in from keytab as kudu/127.11.88.65@KRBTEST.COM (short username kudu)
I20260806 01:03:25.015020 14791 webserver.cc:460] Webserver started at http://127.11.88.65:44757/ using document root <none> and password file <none>
I20260806 01:03:25.015328 14791 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:25.015393 14791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:25.015556 14791 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:25.016716 14791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/data/instance:
uuid: "1197516815934aceb370b55b5d2eed1d"
format_stamp: "Formatted at 2026-08-06 01:03:25 on dist-test-slave-69rg"
server_key: "2470b342f5f3a0d35a19ace46b0797d4"
server_key_iv: "4bf27ed8942368e2c05c6d74e917bdea"
server_key_version: "encryptionkey@0"
I20260806 01:03:25.017096 14791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance:
uuid: "1197516815934aceb370b55b5d2eed1d"
format_stamp: "Formatted at 2026-08-06 01:03:25 on dist-test-slave-69rg"
server_key: "2470b342f5f3a0d35a19ace46b0797d4"
server_key_iv: "4bf27ed8942368e2c05c6d74e917bdea"
server_key_version: "encryptionkey@0"
I20260806 01:03:25.018595 14791 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:03:25.019440 14806 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:25.019639 14791 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:25.019752 14791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "1197516815934aceb370b55b5d2eed1d"
format_stamp: "Formatted at 2026-08-06 01:03:25 on dist-test-slave-69rg"
server_key: "2470b342f5f3a0d35a19ace46b0797d4"
server_key_iv: "4bf27ed8942368e2c05c6d74e917bdea"
server_key_version: "encryptionkey@0"
I20260806 01:03:25.019830 14791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:25.036828 14791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:25.039026 14791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:25.039219 14791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:25.039484 14791 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:25.039824 14791 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:25.039880 14791 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:25.039922 14791 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:25.039951 14791 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:25.046926 14791 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:36127
I20260806 01:03:25.046991 14921 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:36127 every 8 connection(s)
I20260806 01:03:25.047394 14791 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
I20260806 01:03:25.052614 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 14791
I20260806 01:03:25.052784 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance
I20260806 01:03:25.053028 11617 external_mini_cluster.cc:1428] Setting key 0e5a9968dfd98af9703386ce412dbdfe
Aug 06 01:03:25 dist-test-slave-69rg krb5kdc[14684](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978205, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:25.058776 14768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:25.048314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:56591 (local address 127.11.88.126:40169)
0806 01:03:25.048391 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:25.048394 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:25.048602 (+ 208us) server_negotiation.cc:407] Connection header received
0806 01:03:25.049131 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:25.049133 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:25.049144 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:25.049212 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:25.050329 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:25.050915 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:25.052015 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:25.052253 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:25.052352 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:25.055259 (+ 2907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:25.055260 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:25.055261 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:25.055271 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:25.057006 (+ 1735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:25.057554 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:25.057555 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:25.057555 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:25.057615 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:25.057933 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:25.057933 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:25.057934 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:25.058069 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:25.058125 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:25.058572 (+ 447us) server_negotiation.cc:299] Negotiation successful
0806 01:03:25.058681 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 01:03:25.058993 14924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:25.048260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:40169 (local address 127.11.88.65:56591)
0806 01:03:25.048462 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:25.048509 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:25.049016 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:25.049301 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:25.049308 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:25.049938 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:25.050201 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:25.050207 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:25.051027 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:25.051028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:25.051910 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:25.051915 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:25.052362 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:25.052363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:25.052475 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:25.053156 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:25.053167 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:25.055154 (+ 1987us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:25.057112 (+ 1958us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:25.057122 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:25.057124 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:25.057472 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:25.057687 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:25.057688 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:25.057688 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:25.057874 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:25.058146 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:25.058154 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:25.058359 (+ 205us) client_negotiation.cc:769] Sending connection context
0806 01:03:25.058478 (+ 119us) client_negotiation.cc:240] Negotiation successful
0806 01:03:25.058686 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":104,"threads_started":1}
I20260806 01:03:25.059801 14922 heartbeater.cc:347] Connected to a master server at 127.11.88.126:40169
I20260806 01:03:25.059928 14922 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:25.060169 14922 heartbeater.cc:511] Master 127.11.88.126:40169 requested a full tablet report, sending...
I20260806 01:03:25.060773 14729 ts_manager.cc:194] Registered new tserver with Master: 1197516815934aceb370b55b5d2eed1d (127.11.88.65:36127)
I20260806 01:03:25.061479 14729 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.65@KRBTEST.COM'} at 127.11.88.65:56591
WARNING: no policy specified for kudu/127.11.88.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
I20260806 01:03:25.086684 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:0
--local_ip_for_outbound_sockets=127.11.88.66
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:40169
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:35065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:25.170853 14927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:25.171139 14927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:25.171185 14927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:25.172443 14927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:25.172494 14927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:25.172524 14927 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:03:25.174144 14927 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:35065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:40169
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14927
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:25.174422 14927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:25.174696 14927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:25.180308 14933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:25.180366 14935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:25.180313 14932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:25.180680 14927 server_base.cc:1034] running on GCE node
I20260806 01:03:25.180998 14927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:25.181308 14927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:25.182490 14927 hybrid_clock.cc:648] HybridClock initialized: now 1785978205182474 us; error 45 us; skew 500 ppm
Aug 06 01:03:25 dist-test-slave-69rg krb5kdc[14684](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978205, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:25.185431 14927 init.cc:377] Logged in from keytab as kudu/127.11.88.66@KRBTEST.COM (short username kudu)
I20260806 01:03:25.185997 14927 webserver.cc:460] Webserver started at http://127.11.88.66:43229/ using document root <none> and password file <none>
I20260806 01:03:25.186234 14927 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:25.186280 14927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:25.186380 14927 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:25.187516 14927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/data/instance:
uuid: "8eb01eaed56a4309ac37b3e5cf0976ab"
format_stamp: "Formatted at 2026-08-06 01:03:25 on dist-test-slave-69rg"
server_key: "5709a74d6c4bdb59aa2ec69831f38215"
server_key_iv: "718763c4f8ff2e5651ad322ea9b3a5b2"
server_key_version: "encryptionkey@0"
I20260806 01:03:25.187855 14927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance:
uuid: "8eb01eaed56a4309ac37b3e5cf0976ab"
format_stamp: "Formatted at 2026-08-06 01:03:25 on dist-test-slave-69rg"
server_key: "5709a74d6c4bdb59aa2ec69831f38215"
server_key_iv: "718763c4f8ff2e5651ad322ea9b3a5b2"
server_key_version: "encryptionkey@0"
I20260806 01:03:25.189369 14927 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:03:25.190243 14942 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:25.190443 14927 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:25.190534 14927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "8eb01eaed56a4309ac37b3e5cf0976ab"
format_stamp: "Formatted at 2026-08-06 01:03:25 on dist-test-slave-69rg"
server_key: "5709a74d6c4bdb59aa2ec69831f38215"
server_key_iv: "718763c4f8ff2e5651ad322ea9b3a5b2"
server_key_version: "encryptionkey@0"
I20260806 01:03:25.190596 14927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:25.198725 14927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:25.201021 14927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:25.201139 14927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:25.201319 14927 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:25.201650 14927 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:25.201689 14927 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:25.201711 14927 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:25.201761 14927 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:25.207844 14927 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:40961
I20260806 01:03:25.207926 15056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:40961 every 8 connection(s)
I20260806 01:03:25.208262 14927 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
I20260806 01:03:25.212872 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 14927
I20260806 01:03:25.213006 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance
I20260806 01:03:25.213218 11617 external_mini_cluster.cc:1428] Setting key 7d238d674661f1738004ecb21bd9a83f
Aug 06 01:03:25 dist-test-slave-69rg krb5kdc[14684](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978205, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:25.219115 14768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:25.209066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:33941 (local address 127.11.88.126:40169)
0806 01:03:25.209132 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:25.209149 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:25.209347 (+ 198us) server_negotiation.cc:407] Connection header received
0806 01:03:25.209927 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:25.209929 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:25.209941 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:25.209993 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:25.211013 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:25.211535 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:25.212568 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:25.212878 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:25.212962 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:25.215878 (+ 2916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:25.215879 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:25.215880 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:25.215890 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:25.217418 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:25.217995 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:25.217996 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:25.217997 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:25.218062 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:25.218378 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:25.218379 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:25.218379 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:25.218517 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:25.218590 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:25.218969 (+ 379us) server_negotiation.cc:299] Negotiation successful
0806 01:03:25.219046 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 01:03:25.219436 15059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:25.209038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:40169 (local address 127.11.88.66:33941)
0806 01:03:25.209215 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:25.209257 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:25.209783 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:25.210070 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:25.210073 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:25.210702 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:25.210902 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:25.210908 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:25.211656 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:25.211657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:25.212469 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:25.212471 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:25.213009 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:25.213010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:25.213191 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:25.213797 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:25.213806 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:25.215715 (+ 1909us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:25.217510 (+ 1795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:25.217519 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:25.217521 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:25.217923 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:25.218138 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:25.218139 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:25.218140 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:25.218303 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:25.218602 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:25.218611 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:25.218816 (+ 205us) client_negotiation.cc:769] Sending connection context
0806 01:03:25.218937 (+ 121us) client_negotiation.cc:240] Negotiation successful
0806 01:03:25.219130 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":83,"threads_started":1}
I20260806 01:03:25.220023 15057 heartbeater.cc:347] Connected to a master server at 127.11.88.126:40169
I20260806 01:03:25.220124 15057 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:25.220353 15057 heartbeater.cc:511] Master 127.11.88.126:40169 requested a full tablet report, sending...
I20260806 01:03:25.220752 14729 ts_manager.cc:194] Registered new tserver with Master: 8eb01eaed56a4309ac37b3e5cf0976ab (127.11.88.66:40961)
I20260806 01:03:25.221144 14729 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.66@KRBTEST.COM'} at 127.11.88.66:33941
WARNING: no policy specified for kudu/127.11.88.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
I20260806 01:03:25.241600 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:0
--local_ip_for_outbound_sockets=127.11.88.67
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:40169
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:35065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:25.327976 15062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:25.328289 15062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:25.328334 15062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:25.329743 15062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:25.329834 15062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:25.329931 15062 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:03:25.331750 15062 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:35065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:40169
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:25.332082 15062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:25.332367 15062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:25.337815 15070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:25.337839 15068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:25.337873 15067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:25.337980 15062 server_base.cc:1034] running on GCE node
I20260806 01:03:25.338335 15062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:25.338614 15062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:25.339819 15062 hybrid_clock.cc:648] HybridClock initialized: now 1785978205339815 us; error 38 us; skew 500 ppm
Aug 06 01:03:25 dist-test-slave-69rg krb5kdc[14684](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978205, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:25.342743 15062 init.cc:377] Logged in from keytab as kudu/127.11.88.67@KRBTEST.COM (short username kudu)
I20260806 01:03:25.343247 15062 webserver.cc:460] Webserver started at http://127.11.88.67:38901/ using document root <none> and password file <none>
I20260806 01:03:25.343485 15062 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:25.343554 15062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:25.343720 15062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:25.344920 15062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/data/instance:
uuid: "bb5f211b378e4513a5fc9ff8d3264f1a"
format_stamp: "Formatted at 2026-08-06 01:03:25 on dist-test-slave-69rg"
server_key: "99c7bfdf8b4c818313e3b9cd8c934f0d"
server_key_iv: "6d96891187b47ac7a3cfaa0f33d63dd0"
server_key_version: "encryptionkey@0"
I20260806 01:03:25.345474 15062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance:
uuid: "bb5f211b378e4513a5fc9ff8d3264f1a"
format_stamp: "Formatted at 2026-08-06 01:03:25 on dist-test-slave-69rg"
server_key: "99c7bfdf8b4c818313e3b9cd8c934f0d"
server_key_iv: "6d96891187b47ac7a3cfaa0f33d63dd0"
server_key_version: "encryptionkey@0"
I20260806 01:03:25.347182 15062 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260806 01:03:25.348006 15077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:25.348255 15062 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:03:25.348371 15062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "bb5f211b378e4513a5fc9ff8d3264f1a"
format_stamp: "Formatted at 2026-08-06 01:03:25 on dist-test-slave-69rg"
server_key: "99c7bfdf8b4c818313e3b9cd8c934f0d"
server_key_iv: "6d96891187b47ac7a3cfaa0f33d63dd0"
server_key_version: "encryptionkey@0"
I20260806 01:03:25.348450 15062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:25.358062 15062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:25.360257 15062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:25.360423 15062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:25.360677 15062 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:25.360991 15062 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:25.361043 15062 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:25.361090 15062 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:25.361114 15062 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:25.367051 15062 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:38407
I20260806 01:03:25.367095 15191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:38407 every 8 connection(s)
I20260806 01:03:25.367475 15062 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
Aug 06 01:03:25 dist-test-slave-69rg krb5kdc[14684](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978205, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:25.377561 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 15062
I20260806 01:03:25.377660 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance
I20260806 01:03:25.377909 11617 external_mini_cluster.cc:1428] Setting key b3ed95f5a166aba939c993e7a6b96527
I20260806 01:03:25.378156 14768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:25.368228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:45801 (local address 127.11.88.126:40169)
0806 01:03:25.368325 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:25.368328 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:25.368576 (+ 248us) server_negotiation.cc:407] Connection header received
0806 01:03:25.369187 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:25.369189 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:25.369202 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:25.369251 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:25.370462 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:25.371037 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:25.372173 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:25.372409 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:25.372500 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:25.374978 (+ 2478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:25.374980 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:25.374980 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:25.374988 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:25.376650 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:25.377049 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:25.377050 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:25.377051 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:25.377116 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:25.377352 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:25.377352 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:25.377353 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:25.377468 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:25.377522 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:25.377911 (+ 389us) server_negotiation.cc:299] Negotiation successful
0806 01:03:25.378016 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 01:03:25.378312 15194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:25.368180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:40169 (local address 127.11.88.67:45801)
0806 01:03:25.368393 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:25.368445 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:25.369021 (+ 576us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:25.369324 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:25.369328 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:25.370136 (+ 808us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:25.370346 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:25.370357 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:25.371157 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:25.371158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:25.372062 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:25.372064 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:25.372509 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:25.372510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:25.372657 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:25.373278 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:25.373287 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:25.374882 (+ 1595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:25.376736 (+ 1854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:25.376742 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:25.376744 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:25.376960 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:25.377188 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:25.377189 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:25.377189 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:25.377293 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:25.377537 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:25.377545 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:25.377724 (+ 179us) client_negotiation.cc:769] Sending connection context
0806 01:03:25.377862 (+ 138us) client_negotiation.cc:240] Negotiation successful
0806 01:03:25.378054 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":103,"threads_started":1}
I20260806 01:03:25.378835 15192 heartbeater.cc:347] Connected to a master server at 127.11.88.126:40169
I20260806 01:03:25.378942 15192 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:25.379092 15192 heartbeater.cc:511] Master 127.11.88.126:40169 requested a full tablet report, sending...
I20260806 01:03:25.379426 14729 ts_manager.cc:194] Registered new tserver with Master: bb5f211b378e4513a5fc9ff8d3264f1a (127.11.88.67:38407)
I20260806 01:03:25.379819 14729 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.67@KRBTEST.COM'} at 127.11.88.67:45801
I20260806 01:03:25.389761 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 01:03:25 dist-test-slave-69rg krb5kdc[14684](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978205, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 06 01:03:25 dist-test-slave-69rg krb5kdc[14684](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978205, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:25.414021 14768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:25.406909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55248 (local address 127.11.88.126:40169)
0806 01:03:25.406982 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:25.406984 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:25.407012 (+ 28us) server_negotiation.cc:407] Connection header received
0806 01:03:25.407093 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:25.407094 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:25.407103 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:25.407165 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:25.407823 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:25.408327 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:25.409072 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:25.409257 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:25.409311 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:25.411635 (+ 2324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:25.411637 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:25.411637 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:25.411645 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:25.412912 (+ 1267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:25.413226 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:25.413227 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:25.413227 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:25.413279 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:25.413447 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:25.413447 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:25.413447 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:25.413595 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:25.413667 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:25.413854 (+ 187us) server_negotiation.cc:299] Negotiation successful
0806 01:03:25.413932 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260806 01:03:25.414270 14729 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:55248
I20260806 01:03:25.414881 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 14791
I20260806 01:03:25.421099 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 14927
I20260806 01:03:25.426986 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 15062
I20260806 01:03:25.432382 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 14697
2026-08-06T01:03:25Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1929 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:03:25 dist-test-slave-69rg krb5kdc[15204](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:03:25 dist-test-slave-69rg krb5kdc[15204](info): set up 2 sockets
Aug 06 01:03:25 dist-test-slave-69rg krb5kdc[15204](info): commencing operation
krb5kdc: starting...
W20260806 01:03:26.495000 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.041s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:03:26 dist-test-slave-69rg krb5kdc[15204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978206, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:03:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:03:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:03:26.625281 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:38397
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:38867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:38397
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:26.714093 15217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:26.714383 15217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:26.714427 15217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:26.715756 15217 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:03:26.715847 15217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:26.715873 15217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:26.715896 15217 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:03:26.715929 15217 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:03:26.717662 15217 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:38867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:38397
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:38397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15217
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:26.718003 15217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:26.718303 15217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:26.724324 15225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:26.724370 15223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:26.724704 15222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:26.724823 15217 server_base.cc:1034] running on GCE node
I20260806 01:03:26.725132 15217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:26.725449 15217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:26.726616 15217 hybrid_clock.cc:648] HybridClock initialized: now 1785978206726584 us; error 49 us; skew 500 ppm
Aug 06 01:03:26 dist-test-slave-69rg krb5kdc[15204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978206, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:26.729492 15217 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:03:26.730124 15217 webserver.cc:460] Webserver started at http://127.11.88.126:46661/ using document root <none> and password file <none>
I20260806 01:03:26.730415 15217 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:26.730490 15217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:26.730647 15217 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:26.731834 15217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "a2f5a963ae654dd6b6841009e4e34196"
format_stamp: "Formatted at 2026-08-06 01:03:26 on dist-test-slave-69rg"
server_key: "9a1ab0eafef173db2725c9399bc7b492"
server_key_iv: "028c00713c7bc3dc1e4f554ea54aa1f3"
server_key_version: "encryptionkey@0"
I20260806 01:03:26.732236 15217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "a2f5a963ae654dd6b6841009e4e34196"
format_stamp: "Formatted at 2026-08-06 01:03:26 on dist-test-slave-69rg"
server_key: "9a1ab0eafef173db2725c9399bc7b492"
server_key_iv: "028c00713c7bc3dc1e4f554ea54aa1f3"
server_key_version: "encryptionkey@0"
I20260806 01:03:26.733903 15217 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:03:26.734927 15232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:26.735180 15217 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:03:26.735414 15217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "a2f5a963ae654dd6b6841009e4e34196"
format_stamp: "Formatted at 2026-08-06 01:03:26 on dist-test-slave-69rg"
server_key: "9a1ab0eafef173db2725c9399bc7b492"
server_key_iv: "028c00713c7bc3dc1e4f554ea54aa1f3"
server_key_version: "encryptionkey@0"
I20260806 01:03:26.735561 15217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:26.748633 15217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:26.751442 15217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:26.751643 15217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:26.756682 15217 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:38397
I20260806 01:03:26.756760 15287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:38397 every 8 connection(s)
I20260806 01:03:26.757368 15217 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:03:26.758226 15288 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:26.760850 15288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2f5a963ae654dd6b6841009e4e34196: Bootstrap starting.
I20260806 01:03:26.761343 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 15217
I20260806 01:03:26.761474 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:03:26.761675 11617 external_mini_cluster.cc:1428] Setting key b0309ac0d4db59f10d0fe313b1ed9eb8
I20260806 01:03:26.761734 15288 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a2f5a963ae654dd6b6841009e4e34196: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:26.762122 15288 log.cc:824] T 00000000000000000000000000000000 P a2f5a963ae654dd6b6841009e4e34196: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:26.763098 15288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2f5a963ae654dd6b6841009e4e34196: No bootstrap required, opened a new log
I20260806 01:03:26.765547 15288 raft_consensus.cc:348] T 00000000000000000000000000000000 P a2f5a963ae654dd6b6841009e4e34196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2f5a963ae654dd6b6841009e4e34196" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 38397 } }
I20260806 01:03:26.765739 15288 raft_consensus.cc:374] T 00000000000000000000000000000000 P a2f5a963ae654dd6b6841009e4e34196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:26.765798 15288 raft_consensus.cc:729] T 00000000000000000000000000000000 P a2f5a963ae654dd6b6841009e4e34196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2f5a963ae654dd6b6841009e4e34196, State: Initialized, Role: FOLLOWER
I20260806 01:03:26.765957 15288 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2f5a963ae654dd6b6841009e4e34196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2f5a963ae654dd6b6841009e4e34196" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 38397 } }
I20260806 01:03:26.766041 15288 raft_consensus.cc:388] T 00000000000000000000000000000000 P a2f5a963ae654dd6b6841009e4e34196 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:03:26.766088 15288 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2f5a963ae654dd6b6841009e4e34196 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:03:26.766137 15288 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2f5a963ae654dd6b6841009e4e34196 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:26.766816 15288 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2f5a963ae654dd6b6841009e4e34196 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2f5a963ae654dd6b6841009e4e34196" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 38397 } }
I20260806 01:03:26.766922 15288 leader_election.cc:302] T 00000000000000000000000000000000 P a2f5a963ae654dd6b6841009e4e34196 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a2f5a963ae654dd6b6841009e4e34196; no voters:
I20260806 01:03:26.767089 15288 leader_election.cc:288] T 00000000000000000000000000000000 P a2f5a963ae654dd6b6841009e4e34196 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:03:26.767168 15293 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a2f5a963ae654dd6b6841009e4e34196 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:26.767326 15293 raft_consensus.cc:686] T 00000000000000000000000000000000 P a2f5a963ae654dd6b6841009e4e34196 [term 1 LEADER]: Becoming Leader. State: Replica: a2f5a963ae654dd6b6841009e4e34196, State: Running, Role: LEADER
I20260806 01:03:26.767347 15288 sys_catalog.cc:564] T 00000000000000000000000000000000 P a2f5a963ae654dd6b6841009e4e34196 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:03:26.767431 15293 consensus_queue.cc:237] T 00000000000000000000000000000000 P a2f5a963ae654dd6b6841009e4e34196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2f5a963ae654dd6b6841009e4e34196" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 38397 } }
I20260806 01:03:26.769152 15294 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2f5a963ae654dd6b6841009e4e34196 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a2f5a963ae654dd6b6841009e4e34196" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2f5a963ae654dd6b6841009e4e34196" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 38397 } } }
I20260806 01:03:26.769557 15294 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2f5a963ae654dd6b6841009e4e34196 [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:26.769322 15295 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2f5a963ae654dd6b6841009e4e34196 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a2f5a963ae654dd6b6841009e4e34196. Latest consensus state: current_term: 1 leader_uuid: "a2f5a963ae654dd6b6841009e4e34196" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2f5a963ae654dd6b6841009e4e34196" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 38397 } } }
I20260806 01:03:26.769734 15295 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2f5a963ae654dd6b6841009e4e34196 [sys.catalog]: This master's current role is: LEADER
W20260806 01:03:26.769337 15308 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a2f5a963ae654dd6b6841009e4e34196: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 01:03:26.769776 15308 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 06 01:03:26 dist-test-slave-69rg krb5kdc[15204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978206, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:26.769936 15310 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:03:26.770112 15310 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:03:26.773731 15292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:26.762311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57374 (local address 127.11.88.126:38397)
0806 01:03:26.762572 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:26.762587 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:26.762614 (+ 27us) server_negotiation.cc:407] Connection header received
0806 01:03:26.763263 (+ 649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:26.763274 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:26.763337 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:26.763480 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:26.764138 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:26.765577 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:26.766612 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:26.767259 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:26.767365 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:26.770494 (+ 3129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:26.770497 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:26.770498 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:26.770510 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:26.772177 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:26.772562 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:26.772566 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:26.772566 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:26.772656 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:26.772877 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:26.772878 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:26.772878 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:26.773115 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:26.773292 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:26.773415 (+ 123us) server_negotiation.cc:299] Negotiation successful
0806 01:03:26.773562 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":154,"threads_started":1}
I20260806 01:03:26.776288 15310 catalog_manager.cc:1347] Generated new cluster ID: 9013e5839d6a44e996a8bb5ac4169920
I20260806 01:03:26.776362 15310 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:03:26.802323 15310 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:03:26.802914 15310 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:03:26.808156 15310 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a2f5a963ae654dd6b6841009e4e34196: Generated new TSK 0
I20260806 01:03:26.808383 15310 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.88.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
I20260806 01:03:26.842893 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:0
--local_ip_for_outbound_sockets=127.11.88.65
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:38397
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:38867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:26.928861 15314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:26.929073 15314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:26.929098 15314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:26.930334 15314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:26.930377 15314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:26.930444 15314 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:03:26.932076 15314 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:38867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:38397
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15314
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:26.932358 15314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:26.932605 15314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:26.937722 15319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:26.937665 15322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:26.937675 15320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:26.937927 15314 server_base.cc:1034] running on GCE node
I20260806 01:03:26.938272 15314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:26.938556 15314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:26.939760 15314 hybrid_clock.cc:648] HybridClock initialized: now 1785978206939744 us; error 31 us; skew 500 ppm
Aug 06 01:03:26 dist-test-slave-69rg krb5kdc[15204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978206, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:26.942647 15314 init.cc:377] Logged in from keytab as kudu/127.11.88.65@KRBTEST.COM (short username kudu)
I20260806 01:03:26.943147 15314 webserver.cc:460] Webserver started at http://127.11.88.65:46091/ using document root <none> and password file <none>
I20260806 01:03:26.943415 15314 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:26.943492 15314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:26.943657 15314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:26.944826 15314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-0/data/instance:
uuid: "b64af0ffa81047268afb95cf1dcd3abb"
format_stamp: "Formatted at 2026-08-06 01:03:26 on dist-test-slave-69rg"
server_key: "ba7df6a823ded1a928d0525412f659c2"
server_key_iv: "e7fc5d0f37d080367d5bfe620de5a036"
server_key_version: "encryptionkey@0"
I20260806 01:03:26.945235 15314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance:
uuid: "b64af0ffa81047268afb95cf1dcd3abb"
format_stamp: "Formatted at 2026-08-06 01:03:26 on dist-test-slave-69rg"
server_key: "ba7df6a823ded1a928d0525412f659c2"
server_key_iv: "e7fc5d0f37d080367d5bfe620de5a036"
server_key_version: "encryptionkey@0"
I20260806 01:03:26.946764 15314 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 01:03:26.947558 15329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:26.947733 15314 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 01:03:26.947850 15314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "b64af0ffa81047268afb95cf1dcd3abb"
format_stamp: "Formatted at 2026-08-06 01:03:26 on dist-test-slave-69rg"
server_key: "ba7df6a823ded1a928d0525412f659c2"
server_key_iv: "e7fc5d0f37d080367d5bfe620de5a036"
server_key_version: "encryptionkey@0"
I20260806 01:03:26.947932 15314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:26.963876 15314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:26.966543 15314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:26.966739 15314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:26.967007 15314 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:26.967392 15314 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:26.967451 15314 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:26.967499 15314 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:26.967530 15314 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:26.974144 15314 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:41279
I20260806 01:03:26.974196 15444 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:41279 every 8 connection(s)
I20260806 01:03:26.974545 15314 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
I20260806 01:03:26.978788 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 15314
I20260806 01:03:26.978899 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance
I20260806 01:03:26.979084 11617 external_mini_cluster.cc:1428] Setting key 9057dc8209f4fb8302fa787e38dc73e8
Aug 06 01:03:26 dist-test-slave-69rg krb5kdc[15204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978206, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:26.984972 15292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:26.975426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:56229 (local address 127.11.88.126:38397)
0806 01:03:26.975482 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:26.975484 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:26.975677 (+ 193us) server_negotiation.cc:407] Connection header received
0806 01:03:26.976781 (+ 1104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:26.976783 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:26.976794 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:26.976858 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:26.977503 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:26.978081 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:26.979450 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:26.979691 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:26.979763 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:26.982189 (+ 2426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:26.982190 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:26.982191 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:26.982200 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:26.983558 (+ 1358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:26.983977 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:26.983979 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:26.983979 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:26.984039 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:26.984304 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:26.984305 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:26.984306 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:26.984425 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:26.984500 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:26.984787 (+ 287us) server_negotiation.cc:299] Negotiation successful
0806 01:03:26.984879 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 01:03:26.985205 15448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:26.975328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:38397 (local address 127.11.88.65:56229)
0806 01:03:26.975512 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:26.975558 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:26.976654 (+ 1096us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:26.976912 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:26.976915 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:26.977189 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:26.977398 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:26.977403 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:26.978191 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:26.978192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:26.979379 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:26.979382 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:26.979785 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:26.979786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:26.979929 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:26.980524 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:26.980532 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:26.982088 (+ 1556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:26.983649 (+ 1561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:26.983657 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:26.983659 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:26.983897 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:26.984116 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:26.984117 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:26.984117 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:26.984231 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:26.984504 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:26.984511 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:26.984651 (+ 140us) client_negotiation.cc:769] Sending connection context
0806 01:03:26.984759 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 01:03:26.984922 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":108,"threads_started":1}
I20260806 01:03:26.985737 15445 heartbeater.cc:347] Connected to a master server at 127.11.88.126:38397
I20260806 01:03:26.985877 15445 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:26.986066 15445 heartbeater.cc:511] Master 127.11.88.126:38397 requested a full tablet report, sending...
I20260806 01:03:26.986619 15250 ts_manager.cc:194] Registered new tserver with Master: b64af0ffa81047268afb95cf1dcd3abb (127.11.88.65:41279)
I20260806 01:03:26.987232 15250 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.65@KRBTEST.COM'} at 127.11.88.65:56229
WARNING: no policy specified for kudu/127.11.88.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
I20260806 01:03:27.009799 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:0
--local_ip_for_outbound_sockets=127.11.88.66
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:38397
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:38867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:27.095782 15451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:27.095984 15451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:27.096007 15451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:27.097121 15451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:27.097157 15451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:27.097182 15451 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:03:27.098747 15451 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:38867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:38397
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15451
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:27.098932 15451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:27.099112 15451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:27.104169 15456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:27.104300 15451 server_base.cc:1034] running on GCE node
W20260806 01:03:27.104189 15459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:27.104223 15457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:27.104674 15451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:27.104966 15451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:27.106132 15451 hybrid_clock.cc:648] HybridClock initialized: now 1785978207106174 us; error 91 us; skew 500 ppm
Aug 06 01:03:27 dist-test-slave-69rg krb5kdc[15204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978207, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:27.108850 15451 init.cc:377] Logged in from keytab as kudu/127.11.88.66@KRBTEST.COM (short username kudu)
I20260806 01:03:27.109299 15451 webserver.cc:460] Webserver started at http://127.11.88.66:43809/ using document root <none> and password file <none>
I20260806 01:03:27.109534 15451 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:27.109603 15451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:27.109763 15451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:27.110853 15451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-1/data/instance:
uuid: "3aab6fdbe7614a53a5885a3c99dbe8c2"
format_stamp: "Formatted at 2026-08-06 01:03:27 on dist-test-slave-69rg"
server_key: "e2f7e664ece9c10435cea818c045afc0"
server_key_iv: "ac1af509135a55e5e5af14605909d468"
server_key_version: "encryptionkey@0"
I20260806 01:03:27.111217 15451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance:
uuid: "3aab6fdbe7614a53a5885a3c99dbe8c2"
format_stamp: "Formatted at 2026-08-06 01:03:27 on dist-test-slave-69rg"
server_key: "e2f7e664ece9c10435cea818c045afc0"
server_key_iv: "ac1af509135a55e5e5af14605909d468"
server_key_version: "encryptionkey@0"
I20260806 01:03:27.112622 15451 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 01:03:27.113431 15466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:27.113729 15451 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:27.113888 15451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "3aab6fdbe7614a53a5885a3c99dbe8c2"
format_stamp: "Formatted at 2026-08-06 01:03:27 on dist-test-slave-69rg"
server_key: "e2f7e664ece9c10435cea818c045afc0"
server_key_iv: "ac1af509135a55e5e5af14605909d468"
server_key_version: "encryptionkey@0"
I20260806 01:03:27.113968 15451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:27.127894 15451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:27.130174 15451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:27.130354 15451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:27.130611 15451 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:27.130952 15451 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:27.131009 15451 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:27.131052 15451 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:27.131095 15451 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:27.137123 15451 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:36401
I20260806 01:03:27.137207 15581 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:36401 every 8 connection(s)
I20260806 01:03:27.137534 15451 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
Aug 06 01:03:27 dist-test-slave-69rg krb5kdc[15204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978207, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:27.146023 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 15451
I20260806 01:03:27.146144 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance
I20260806 01:03:27.146363 11617 external_mini_cluster.cc:1428] Setting key c8ddcc4ec6c3eb2e1fe48232ea6f85ea
I20260806 01:03:27.147897 15292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:27.138395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:54989 (local address 127.11.88.126:38397)
0806 01:03:27.138509 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:27.138512 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:27.138702 (+ 190us) server_negotiation.cc:407] Connection header received
0806 01:03:27.139773 (+ 1071us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:27.139774 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:27.139787 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:27.139854 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:27.140486 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:27.140986 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:27.142049 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:27.142250 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:27.142340 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:27.144572 (+ 2232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:27.144574 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:27.144574 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:27.144582 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:27.146235 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:27.146891 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:27.146892 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:27.146892 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:27.146944 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:27.147225 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:27.147226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:27.147226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:27.147341 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:27.147420 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:27.147713 (+ 293us) server_negotiation.cc:299] Negotiation successful
0806 01:03:27.147806 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 01:03:27.148104 15584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:27.138342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:38397 (local address 127.11.88.66:54989)
0806 01:03:27.138566 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:27.138615 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:27.139658 (+ 1043us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:27.139925 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:27.139929 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:27.140197 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:27.140387 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:27.140391 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:27.141093 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:27.141094 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:27.141951 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:27.141954 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:27.142355 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:27.142356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:27.142485 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:27.143042 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:27.143050 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:27.144471 (+ 1421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:27.146314 (+ 1843us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:27.146321 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:27.146322 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:27.146609 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:27.147023 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:27.147024 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:27.147024 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:27.147149 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:27.147412 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:27.147420 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:27.147569 (+ 149us) client_negotiation.cc:769] Sending connection context
0806 01:03:27.147677 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 01:03:27.147851 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":90,"threads_started":1}
I20260806 01:03:27.148711 15582 heartbeater.cc:347] Connected to a master server at 127.11.88.126:38397
I20260806 01:03:27.148840 15582 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:27.149022 15582 heartbeater.cc:511] Master 127.11.88.126:38397 requested a full tablet report, sending...
I20260806 01:03:27.149470 15250 ts_manager.cc:194] Registered new tserver with Master: 3aab6fdbe7614a53a5885a3c99dbe8c2 (127.11.88.66:36401)
I20260806 01:03:27.149915 15250 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.66@KRBTEST.COM'} at 127.11.88.66:54989
WARNING: no policy specified for kudu/127.11.88.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
I20260806 01:03:27.172787 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:0
--local_ip_for_outbound_sockets=127.11.88.67
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:38397
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:38867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:27.260756 15587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:27.261049 15587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:27.261096 15587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:27.262480 15587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:27.262557 15587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:27.262607 15587 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:03:27.264391 15587 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:38867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:38397
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15587
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:27.264767 15587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:27.265043 15587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:27.270880 15595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:27.270866 15592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:27.270901 15593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:27.271485 15587 server_base.cc:1034] running on GCE node
I20260806 01:03:27.271729 15587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:27.271953 15587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:27.273106 15587 hybrid_clock.cc:648] HybridClock initialized: now 1785978207273094 us; error 27 us; skew 500 ppm
Aug 06 01:03:27 dist-test-slave-69rg krb5kdc[15204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978207, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:27.275879 15587 init.cc:377] Logged in from keytab as kudu/127.11.88.67@KRBTEST.COM (short username kudu)
I20260806 01:03:27.276376 15587 webserver.cc:460] Webserver started at http://127.11.88.67:38375/ using document root <none> and password file <none>
I20260806 01:03:27.276643 15587 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:27.276691 15587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:27.276854 15587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:27.278082 15587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-2/data/instance:
uuid: "065242e9d8b64b51929bc7a76155e112"
format_stamp: "Formatted at 2026-08-06 01:03:27 on dist-test-slave-69rg"
server_key: "4d350e3b64352d6c6c8adf40327df391"
server_key_iv: "6d81a3b87f5e34ab34f48853d31f2a8d"
server_key_version: "encryptionkey@0"
I20260806 01:03:27.278450 15587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance:
uuid: "065242e9d8b64b51929bc7a76155e112"
format_stamp: "Formatted at 2026-08-06 01:03:27 on dist-test-slave-69rg"
server_key: "4d350e3b64352d6c6c8adf40327df391"
server_key_iv: "6d81a3b87f5e34ab34f48853d31f2a8d"
server_key_version: "encryptionkey@0"
I20260806 01:03:27.279948 15587 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 01:03:27.280913 15602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:27.281286 15587 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:27.281409 15587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "065242e9d8b64b51929bc7a76155e112"
format_stamp: "Formatted at 2026-08-06 01:03:27 on dist-test-slave-69rg"
server_key: "4d350e3b64352d6c6c8adf40327df391"
server_key_iv: "6d81a3b87f5e34ab34f48853d31f2a8d"
server_key_version: "encryptionkey@0"
I20260806 01:03:27.281492 15587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:27.305469 15587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:27.307785 15587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:27.307955 15587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:27.308288 15587 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:27.308679 15587 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:27.308734 15587 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:27.308770 15587 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:27.308789 15587 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:27.315198 15587 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:38263
I20260806 01:03:27.315245 15717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:38263 every 8 connection(s)
I20260806 01:03:27.315588 15587 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
I20260806 01:03:27.318509 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 15587
I20260806 01:03:27.318636 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance
I20260806 01:03:27.318847 11617 external_mini_cluster.cc:1428] Setting key 671f24114e1f074646a0f56a1857d9bb
Aug 06 01:03:27 dist-test-slave-69rg krb5kdc[15204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978207, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:27.326750 15292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:27.316415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:53973 (local address 127.11.88.126:38397)
0806 01:03:27.316489 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:27.316491 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:27.316766 (+ 275us) server_negotiation.cc:407] Connection header received
0806 01:03:27.317868 (+ 1102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:27.317870 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:27.317882 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:27.317940 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:27.318859 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:27.319614 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:27.320873 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:27.321058 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:27.321114 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:27.323650 (+ 2536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:27.323652 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:27.323652 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:27.323659 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:27.325137 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:27.325564 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:27.325566 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:27.325566 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:27.325623 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:27.326010 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:27.326011 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:27.326011 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:27.326145 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:27.326220 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:27.326588 (+ 368us) server_negotiation.cc:299] Negotiation successful
0806 01:03:27.326674 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 01:03:27.326818 15720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:27.316378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:38397 (local address 127.11.88.67:53973)
0806 01:03:27.316600 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:27.316647 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:27.317671 (+ 1024us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:27.318027 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:27.318030 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:27.318394 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:27.318735 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:27.318742 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:27.319686 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:27.319688 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:27.320794 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:27.320797 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:27.321136 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:27.321137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:27.321253 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:27.321905 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:27.321914 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:27.323500 (+ 1586us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:27.325235 (+ 1735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:27.325243 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:27.325245 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:27.325487 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:27.325722 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:27.325723 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:27.325723 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:27.325942 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:27.326244 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:27.326251 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:27.326389 (+ 138us) client_negotiation.cc:769] Sending connection context
0806 01:03:27.326492 (+ 103us) client_negotiation.cc:240] Negotiation successful
0806 01:03:27.326630 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":121,"threads_started":1}
I20260806 01:03:27.327644 15718 heartbeater.cc:347] Connected to a master server at 127.11.88.126:38397
I20260806 01:03:27.327741 15718 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:27.327898 15718 heartbeater.cc:511] Master 127.11.88.126:38397 requested a full tablet report, sending...
I20260806 01:03:27.328390 15250 ts_manager.cc:194] Registered new tserver with Master: 065242e9d8b64b51929bc7a76155e112 (127.11.88.67:38263)
I20260806 01:03:27.328779 15250 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.67@KRBTEST.COM'} at 127.11.88.67:53973
I20260806 01:03:27.330979 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 01:03:27 dist-test-slave-69rg krb5kdc[15204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978207, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 01:03:27 dist-test-slave-69rg krb5kdc[15204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978207, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.65@KRBTEST.COM
I20260806 01:03:27.356263 15725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:27.347934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57426 (local address 127.11.88.65:41279)
0806 01:03:27.348134 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:27.348139 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:27.348150 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:03:27.348180 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:27.348182 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:27.348196 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:27.348269 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:27.348850 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:27.349639 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:27.350414 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:27.350826 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:27.350887 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:27.353257 (+ 2370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:27.353265 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:27.353266 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:27.353273 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:27.355015 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:27.355405 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:27.355408 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:27.355409 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:27.355481 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:27.355661 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:27.355662 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:27.355662 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:27.355808 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:27.355929 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:27.355992 (+ 63us) server_negotiation.cc:299] Negotiation successful
0806 01:03:27.356071 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":108,"threads_started":1}
Aug 06 01:03:27 dist-test-slave-69rg krb5kdc[15204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978207, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:27.364684 15292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:27.357758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57384 (local address 127.11.88.126:38397)
0806 01:03:27.357887 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:27.357890 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:27.357900 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:03:27.357929 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:27.357929 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:27.357939 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:27.358006 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:27.358555 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:27.359050 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:27.359745 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:27.359935 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:27.360009 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:27.362231 (+ 2222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:27.362233 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:27.362233 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:27.362241 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:27.363466 (+ 1225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:27.363809 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:27.363810 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:27.363811 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:27.363871 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:27.364091 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:27.364092 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:27.364093 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:27.364257 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:27.364367 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:27.364490 (+ 123us) server_negotiation.cc:299] Negotiation successful
0806 01:03:27.364571 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260806 01:03:27.364910 15250 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57384
I20260806 01:03:27.365299 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 15314
I20260806 01:03:27.371240 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 15451
I20260806 01:03:27.376369 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 15587
I20260806 01:03:27.381270 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 15217
2026-08-06T01:03:27Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1947 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:03:27 dist-test-slave-69rg krb5kdc[15730](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:03:27 dist-test-slave-69rg krb5kdc[15730](info): set up 2 sockets
Aug 06 01:03:27 dist-test-slave-69rg krb5kdc[15730](info): commencing operation
krb5kdc: starting...
W20260806 01:03:28.439044 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.037s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:03:28 dist-test-slave-69rg krb5kdc[15730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978208, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:03:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:03:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:03:28.572785 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:40017
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:34835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:40017
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:28.656124 15743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:28.656424 15743 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:28.656466 15743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:28.657657 15743 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:03:28.657744 15743 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:28.657770 15743 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:28.657791 15743 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:03:28.657841 15743 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:03:28.660418 15743 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:34835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:40017
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:40017
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15743
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:28.660735 15743 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:28.661016 15743 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:28.666155 15749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:28.666142 15748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:28.666142 15752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:28.666476 15743 server_base.cc:1034] running on GCE node
I20260806 01:03:28.666750 15743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:28.667096 15743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:28.668308 15743 hybrid_clock.cc:648] HybridClock initialized: now 1785978208668296 us; error 50 us; skew 500 ppm
Aug 06 01:03:28 dist-test-slave-69rg krb5kdc[15730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978208, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:28.675575 15743 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:03:28.675999 15743 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:28.676084 15743 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:28.676247 15743 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:28.677425 15743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "52535672b6264507bb970d2c6707b438"
format_stamp: "Formatted at 2026-08-06 01:03:28 on dist-test-slave-69rg"
server_key: "6582aff4f5cfc6fa24d9767b0778422f"
server_key_iv: "e45a70b5f4c48118cde305d0c8f60124"
server_key_version: "encryptionkey@0"
I20260806 01:03:28.677889 15743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "52535672b6264507bb970d2c6707b438"
format_stamp: "Formatted at 2026-08-06 01:03:28 on dist-test-slave-69rg"
server_key: "6582aff4f5cfc6fa24d9767b0778422f"
server_key_iv: "e45a70b5f4c48118cde305d0c8f60124"
server_key_version: "encryptionkey@0"
I20260806 01:03:28.679461 15743 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:03:28.680363 15758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:28.680662 15743 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:03:28.680784 15743 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "52535672b6264507bb970d2c6707b438"
format_stamp: "Formatted at 2026-08-06 01:03:28 on dist-test-slave-69rg"
server_key: "6582aff4f5cfc6fa24d9767b0778422f"
server_key_iv: "e45a70b5f4c48118cde305d0c8f60124"
server_key_version: "encryptionkey@0"
I20260806 01:03:28.680871 15743 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:28.715041 15743 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:28.717509 15743 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:28.717689 15743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:28.722057 15743 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:40017
I20260806 01:03:28.722091 15810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:40017 every 8 connection(s)
I20260806 01:03:28.722397 15743 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:03:28.723439 15811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:28.725903 15811 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52535672b6264507bb970d2c6707b438: Bootstrap starting.
I20260806 01:03:28.726558 15811 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 52535672b6264507bb970d2c6707b438: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:28.726874 15811 log.cc:824] T 00000000000000000000000000000000 P 52535672b6264507bb970d2c6707b438: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:28.727605 15811 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52535672b6264507bb970d2c6707b438: No bootstrap required, opened a new log
I20260806 01:03:28.729058 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 15743
I20260806 01:03:28.729166 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:03:28.729427 11617 external_mini_cluster.cc:1428] Setting key 4fa885dedfe5ecd00ef35c512d526805
I20260806 01:03:28.729377 15811 raft_consensus.cc:348] T 00000000000000000000000000000000 P 52535672b6264507bb970d2c6707b438 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52535672b6264507bb970d2c6707b438" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40017 } }
I20260806 01:03:28.729581 15811 raft_consensus.cc:374] T 00000000000000000000000000000000 P 52535672b6264507bb970d2c6707b438 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:28.729638 15811 raft_consensus.cc:729] T 00000000000000000000000000000000 P 52535672b6264507bb970d2c6707b438 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52535672b6264507bb970d2c6707b438, State: Initialized, Role: FOLLOWER
I20260806 01:03:28.729786 15811 consensus_queue.cc:260] T 00000000000000000000000000000000 P 52535672b6264507bb970d2c6707b438 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52535672b6264507bb970d2c6707b438" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40017 } }
I20260806 01:03:28.729919 15811 raft_consensus.cc:388] T 00000000000000000000000000000000 P 52535672b6264507bb970d2c6707b438 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:03:28.729960 15811 raft_consensus.cc:482] T 00000000000000000000000000000000 P 52535672b6264507bb970d2c6707b438 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:03:28.730007 15811 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 52535672b6264507bb970d2c6707b438 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:28.731134 15811 raft_consensus.cc:504] T 00000000000000000000000000000000 P 52535672b6264507bb970d2c6707b438 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52535672b6264507bb970d2c6707b438" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40017 } }
I20260806 01:03:28.731271 15811 leader_election.cc:302] T 00000000000000000000000000000000 P 52535672b6264507bb970d2c6707b438 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 52535672b6264507bb970d2c6707b438; no voters:
I20260806 01:03:28.731480 15811 leader_election.cc:288] T 00000000000000000000000000000000 P 52535672b6264507bb970d2c6707b438 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:03:28.731514 15816 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 52535672b6264507bb970d2c6707b438 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:28.731735 15816 raft_consensus.cc:686] T 00000000000000000000000000000000 P 52535672b6264507bb970d2c6707b438 [term 1 LEADER]: Becoming Leader. State: Replica: 52535672b6264507bb970d2c6707b438, State: Running, Role: LEADER
I20260806 01:03:28.731770 15811 sys_catalog.cc:564] T 00000000000000000000000000000000 P 52535672b6264507bb970d2c6707b438 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:03:28.731981 15816 consensus_queue.cc:237] T 00000000000000000000000000000000 P 52535672b6264507bb970d2c6707b438 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52535672b6264507bb970d2c6707b438" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40017 } }
I20260806 01:03:28.732393 15817 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52535672b6264507bb970d2c6707b438 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "52535672b6264507bb970d2c6707b438" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52535672b6264507bb970d2c6707b438" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40017 } } }
I20260806 01:03:28.732499 15817 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52535672b6264507bb970d2c6707b438 [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:28.732651 15818 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52535672b6264507bb970d2c6707b438 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 52535672b6264507bb970d2c6707b438. Latest consensus state: current_term: 1 leader_uuid: "52535672b6264507bb970d2c6707b438" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52535672b6264507bb970d2c6707b438" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40017 } } }
I20260806 01:03:28.732713 15818 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52535672b6264507bb970d2c6707b438 [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:28.732838 15825 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:03:28.733415 15825 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:03:28.735172 15825 catalog_manager.cc:1347] Generated new cluster ID: ba92c9df9e744db59d27eb4463748dc4
I20260806 01:03:28.735230 15825 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 01:03:28 dist-test-slave-69rg krb5kdc[15730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978208, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:28.741235 15815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:28.730000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59656 (local address 127.11.88.126:40017)
0806 01:03:28.730311 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:28.730321 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:28.730359 (+ 38us) server_negotiation.cc:407] Connection header received
0806 01:03:28.730503 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:28.730512 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:28.730597 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:28.730782 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:28.731556 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:28.733044 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:28.734498 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:28.735082 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:28.735321 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:28.737674 (+ 2353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:28.737677 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:28.737678 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:28.737690 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:28.739550 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:28.739947 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:28.739950 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:28.739950 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:28.740068 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:28.740298 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:28.740299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:28.740299 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:28.740563 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:28.740737 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:28.740856 (+ 119us) server_negotiation.cc:299] Negotiation successful
0806 01:03:28.741009 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":183,"threads_started":1}
I20260806 01:03:28.742208 15825 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:03:28.742753 15825 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:03:28.747083 15825 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 52535672b6264507bb970d2c6707b438: Generated new TSK 0
I20260806 01:03:28.747309 15825 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.88.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
I20260806 01:03:28.780794 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:0
--local_ip_for_outbound_sockets=127.11.88.65
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:40017
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:34835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:28.868285 15837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:28.868577 15837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:28.868628 15837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:28.870108 15837 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:28.870189 15837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:28.870249 15837 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:03:28.872279 15837 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:34835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:40017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15837
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:28.872611 15837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:28.872867 15837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:28.878254 15845 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:28.878254 15842 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:28.878288 15843 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:28.878693 15837 server_base.cc:1034] running on GCE node
I20260806 01:03:28.878930 15837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:28.879205 15837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:28.880357 15837 hybrid_clock.cc:648] HybridClock initialized: now 1785978208880329 us; error 39 us; skew 500 ppm
Aug 06 01:03:28 dist-test-slave-69rg krb5kdc[15730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978208, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:28.883092 15837 init.cc:377] Logged in from keytab as kudu/127.11.88.65@KRBTEST.COM (short username kudu)
I20260806 01:03:28.883530 15837 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:28.883585 15837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:28.883728 15837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:28.884899 15837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-0/data/instance:
uuid: "56b91b6bc39f49868b701e57fd6c92c5"
format_stamp: "Formatted at 2026-08-06 01:03:28 on dist-test-slave-69rg"
server_key: "fcd3d9a60c2ce9b2129599fd264c6cab"
server_key_iv: "5754ad4bffa5a4963935d2eabd2e0e5e"
server_key_version: "encryptionkey@0"
I20260806 01:03:28.885229 15837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance:
uuid: "56b91b6bc39f49868b701e57fd6c92c5"
format_stamp: "Formatted at 2026-08-06 01:03:28 on dist-test-slave-69rg"
server_key: "fcd3d9a60c2ce9b2129599fd264c6cab"
server_key_iv: "5754ad4bffa5a4963935d2eabd2e0e5e"
server_key_version: "encryptionkey@0"
I20260806 01:03:28.886686 15837 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:03:28.887589 15851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:28.887878 15837 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:28.888011 15837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "56b91b6bc39f49868b701e57fd6c92c5"
format_stamp: "Formatted at 2026-08-06 01:03:28 on dist-test-slave-69rg"
server_key: "fcd3d9a60c2ce9b2129599fd264c6cab"
server_key_iv: "5754ad4bffa5a4963935d2eabd2e0e5e"
server_key_version: "encryptionkey@0"
I20260806 01:03:28.888096 15837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:28.904886 15837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:28.907375 15837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:28.907549 15837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:28.907835 15837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:28.908187 15837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:28.908242 15837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:28.908288 15837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:28.908311 15837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:28.914741 15837 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:43245
I20260806 01:03:28.914785 15967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:43245 every 8 connection(s)
I20260806 01:03:28.915069 15837 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
I20260806 01:03:28.917234 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 15837
I20260806 01:03:28.917356 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance
I20260806 01:03:28.917557 11617 external_mini_cluster.cc:1428] Setting key d6f9f38c2606c39838bfb3d70c664681
Aug 06 01:03:28 dist-test-slave-69rg krb5kdc[15730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978208, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:28.925875 15815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:28.915855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:34275 (local address 127.11.88.126:40017)
0806 01:03:28.915998 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:28.916001 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:28.916206 (+ 205us) server_negotiation.cc:407] Connection header received
0806 01:03:28.916783 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:28.916784 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:28.916797 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:28.916851 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:28.918100 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:28.918901 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:28.920043 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:28.920349 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:28.920414 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:28.922822 (+ 2408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:28.922824 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:28.922824 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:28.922838 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:28.924367 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:28.924784 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:28.924786 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:28.924786 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:28.924848 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:28.925109 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:28.925110 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:28.925110 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:28.925234 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:28.925309 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:28.925610 (+ 301us) server_negotiation.cc:299] Negotiation successful
0806 01:03:28.925737 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260806 01:03:28.926002 15970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:28.915815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:40017 (local address 127.11.88.65:34275)
0806 01:03:28.916047 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:28.916103 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:28.916664 (+ 561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:28.916942 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:28.916948 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:28.917231 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:28.917991 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:28.917999 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:28.919009 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:28.919010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:28.919930 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:28.919934 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:28.920445 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:28.920446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:28.920623 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:28.921219 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:28.921228 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:28.922699 (+ 1471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:28.924461 (+ 1762us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:28.924469 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:28.924472 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:28.924704 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:28.924919 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:28.924920 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:28.924920 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:28.925039 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:28.925312 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:28.925320 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:28.925467 (+ 147us) client_negotiation.cc:769] Sending connection context
0806 01:03:28.925572 (+ 105us) client_negotiation.cc:240] Negotiation successful
0806 01:03:28.925744 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":92,"threads_started":1}
I20260806 01:03:28.926456 15968 heartbeater.cc:347] Connected to a master server at 127.11.88.126:40017
I20260806 01:03:28.926554 15968 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:28.926735 15968 heartbeater.cc:511] Master 127.11.88.126:40017 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.88.66@KRBTEST.COM; defaulting to no policy
I20260806 01:03:28.927284 15775 ts_manager.cc:194] Registered new tserver with Master: 56b91b6bc39f49868b701e57fd6c92c5 (127.11.88.65:43245)
I20260806 01:03:28.927963 15775 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.65@KRBTEST.COM'} at 127.11.88.65:34275
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
I20260806 01:03:28.948560 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:0
--local_ip_for_outbound_sockets=127.11.88.66
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:40017
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:34835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:29.035336 15973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:29.035542 15973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:29.035566 15973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:29.036738 15973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:29.036780 15973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:29.036808 15973 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:03:29.038376 15973 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:34835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:40017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15973
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:29.038627 15973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:29.038895 15973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:29.044498 15978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:29.044672 15981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:29.044498 15979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:29.045018 15973 server_base.cc:1034] running on GCE node
I20260806 01:03:29.045307 15973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:29.045616 15973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:29.046794 15973 hybrid_clock.cc:648] HybridClock initialized: now 1785978209046766 us; error 50 us; skew 500 ppm
Aug 06 01:03:29 dist-test-slave-69rg krb5kdc[15730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978209, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:29.049782 15973 init.cc:377] Logged in from keytab as kudu/127.11.88.66@KRBTEST.COM (short username kudu)
I20260806 01:03:29.050261 15973 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:29.050313 15973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:29.050463 15973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:29.051599 15973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-1/data/instance:
uuid: "872fae5e26f44f7c992622c08f7bf305"
format_stamp: "Formatted at 2026-08-06 01:03:29 on dist-test-slave-69rg"
server_key: "b988e147287a08fd93159a942f53d723"
server_key_iv: "d91cd60273298de3db1c19fbf4f4eecf"
server_key_version: "encryptionkey@0"
I20260806 01:03:29.051946 15973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance:
uuid: "872fae5e26f44f7c992622c08f7bf305"
format_stamp: "Formatted at 2026-08-06 01:03:29 on dist-test-slave-69rg"
server_key: "b988e147287a08fd93159a942f53d723"
server_key_iv: "d91cd60273298de3db1c19fbf4f4eecf"
server_key_version: "encryptionkey@0"
I20260806 01:03:29.053479 15973 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:03:29.054481 15987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:29.054721 15973 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:29.054836 15973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "872fae5e26f44f7c992622c08f7bf305"
format_stamp: "Formatted at 2026-08-06 01:03:29 on dist-test-slave-69rg"
server_key: "b988e147287a08fd93159a942f53d723"
server_key_iv: "d91cd60273298de3db1c19fbf4f4eecf"
server_key_version: "encryptionkey@0"
I20260806 01:03:29.054931 15973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:29.067128 15973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:29.069608 15973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:29.069788 15973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:29.070080 15973 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:29.070417 15973 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:29.070472 15973 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:29.070516 15973 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:29.070546 15973 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:29.077037 15973 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:42755
I20260806 01:03:29.077076 16102 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:42755 every 8 connection(s)
I20260806 01:03:29.077378 15973 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
I20260806 01:03:29.084578 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 15973
Aug 06 01:03:29 dist-test-slave-69rg krb5kdc[15730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978209, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:29.084718 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance
I20260806 01:03:29.084998 11617 external_mini_cluster.cc:1428] Setting key 93a2cb6d025022d7b93fb0be0579fd09
I20260806 01:03:29.089574 15815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.078205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:40533 (local address 127.11.88.126:40017)
0806 01:03:29.078284 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:29.078286 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:29.078529 (+ 243us) server_negotiation.cc:407] Connection header received
0806 01:03:29.079074 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:29.079075 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:29.079088 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:29.079147 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:29.080128 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.080652 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.081982 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.082210 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.082316 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:29.085636 (+ 3320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:29.085637 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:29.085638 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:29.085647 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:29.087476 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:29.088238 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:29.088239 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:29.088240 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:29.088329 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:29.088660 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:29.088661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:29.088661 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:29.088865 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:29.088946 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:29.089280 (+ 334us) server_negotiation.cc:299] Negotiation successful
0806 01:03:29.089418 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 01:03:29.089607 16105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.078215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:40017 (local address 127.11.88.66:40533)
0806 01:03:29.078398 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:29.078436 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:29.078960 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:29.079223 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:29.079227 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:29.079499 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:29.080020 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:29.080025 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.080783 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.080784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:29.081713 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:29.081716 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.082332 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.082333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:29.082497 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:29.083288 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:29.083297 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:29.085505 (+ 2208us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:29.087604 (+ 2099us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:29.087618 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:29.087621 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:29.088034 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:29.088435 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:29.088436 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:29.088436 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:29.088577 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:29.088947 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:29.088955 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:29.089118 (+ 163us) client_negotiation.cc:769] Sending connection context
0806 01:03:29.089219 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 01:03:29.089403 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":96,"threads_started":1}
I20260806 01:03:29.090212 16103 heartbeater.cc:347] Connected to a master server at 127.11.88.126:40017
I20260806 01:03:29.090363 16103 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:29.090546 16103 heartbeater.cc:511] Master 127.11.88.126:40017 requested a full tablet report, sending...
I20260806 01:03:29.091089 15775 ts_manager.cc:194] Registered new tserver with Master: 872fae5e26f44f7c992622c08f7bf305 (127.11.88.66:42755)
I20260806 01:03:29.091703 15775 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.66@KRBTEST.COM'} at 127.11.88.66:40533
WARNING: no policy specified for kudu/127.11.88.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
I20260806 01:03:29.117661 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:0
--local_ip_for_outbound_sockets=127.11.88.67
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:40017
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:34835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:29.203972 16108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:29.204238 16108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:29.204280 16108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:29.205498 16108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:29.205587 16108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:29.205639 16108 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:03:29.207307 16108 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:34835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:40017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16108
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:29.207617 16108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:29.207868 16108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:29.213047 16113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:29.213091 16114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:29.213184 16108 server_base.cc:1034] running on GCE node
W20260806 01:03:29.213099 16116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:29.213482 16108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:29.213743 16108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:29.214982 16108 hybrid_clock.cc:648] HybridClock initialized: now 1785978209214984 us; error 47 us; skew 500 ppm
Aug 06 01:03:29 dist-test-slave-69rg krb5kdc[15730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978209, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:29.217684 16108 init.cc:377] Logged in from keytab as kudu/127.11.88.67@KRBTEST.COM (short username kudu)
I20260806 01:03:29.218108 16108 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:29.218182 16108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:29.218358 16108 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:29.219419 16108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-2/data/instance:
uuid: "0c2f40c3c0ca41b38e8cf2ea3638c8a9"
format_stamp: "Formatted at 2026-08-06 01:03:29 on dist-test-slave-69rg"
server_key: "f3f531116ecae7ea1504ef6df0d058eb"
server_key_iv: "58411739c0ae283a2751b0c970d01932"
server_key_version: "encryptionkey@0"
I20260806 01:03:29.219805 16108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance:
uuid: "0c2f40c3c0ca41b38e8cf2ea3638c8a9"
format_stamp: "Formatted at 2026-08-06 01:03:29 on dist-test-slave-69rg"
server_key: "f3f531116ecae7ea1504ef6df0d058eb"
server_key_iv: "58411739c0ae283a2751b0c970d01932"
server_key_version: "encryptionkey@0"
I20260806 01:03:29.221237 16108 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 01:03:29.222201 16122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:29.222477 16108 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:29.222589 16108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "0c2f40c3c0ca41b38e8cf2ea3638c8a9"
format_stamp: "Formatted at 2026-08-06 01:03:29 on dist-test-slave-69rg"
server_key: "f3f531116ecae7ea1504ef6df0d058eb"
server_key_iv: "58411739c0ae283a2751b0c970d01932"
server_key_version: "encryptionkey@0"
I20260806 01:03:29.222671 16108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:29.260913 16108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:29.263350 16108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:29.263512 16108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:29.263768 16108 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:29.264092 16108 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:29.264146 16108 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:29.264194 16108 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:29.264225 16108 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:29.270380 16108 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:44679
I20260806 01:03:29.270426 16238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:44679 every 8 connection(s)
I20260806 01:03:29.270736 16108 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
I20260806 01:03:29.273667 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 16108
I20260806 01:03:29.273790 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance
I20260806 01:03:29.274029 11617 external_mini_cluster.cc:1428] Setting key d9df1b3b44e0cdc03f2ec547dafa72c1
Aug 06 01:03:29 dist-test-slave-69rg krb5kdc[15730](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978209, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:29.280880 15815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.271473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:47819 (local address 127.11.88.126:40017)
0806 01:03:29.271538 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:29.271541 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:29.271789 (+ 248us) server_negotiation.cc:407] Connection header received
0806 01:03:29.272302 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:29.272303 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:29.272315 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:29.272385 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:29.273358 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.274321 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.275609 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.275823 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.275885 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:29.278261 (+ 2376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:29.278262 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:29.278263 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:29.278270 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:29.279611 (+ 1341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:29.279998 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:29.279999 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:29.279999 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:29.280062 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:29.280302 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:29.280303 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:29.280303 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:29.280435 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:29.280500 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:29.280742 (+ 242us) server_negotiation.cc:299] Negotiation successful
0806 01:03:29.280811 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 01:03:29.281111 16241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.271452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:40017 (local address 127.11.88.67:47819)
0806 01:03:29.271632 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:29.271676 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:29.272211 (+ 535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:29.272439 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:29.272442 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:29.272719 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:29.273223 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:29.273228 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.274436 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.274436 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:29.275520 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:29.275524 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.275912 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.275913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:29.276028 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:29.276688 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:29.276696 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:29.278167 (+ 1471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:29.279702 (+ 1535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:29.279708 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:29.279710 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:29.279927 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:29.280125 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:29.280126 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:29.280126 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:29.280222 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:29.280502 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:29.280507 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:29.280623 (+ 116us) client_negotiation.cc:769] Sending connection context
0806 01:03:29.280706 (+ 83us) client_negotiation.cc:240] Negotiation successful
0806 01:03:29.280846 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":87,"threads_started":1}
I20260806 01:03:29.281623 16239 heartbeater.cc:347] Connected to a master server at 127.11.88.126:40017
I20260806 01:03:29.281728 16239 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:29.281915 16239 heartbeater.cc:511] Master 127.11.88.126:40017 requested a full tablet report, sending...
I20260806 01:03:29.282438 15775 ts_manager.cc:194] Registered new tserver with Master: 0c2f40c3c0ca41b38e8cf2ea3638c8a9 (127.11.88.67:44679)
I20260806 01:03:29.282976 15775 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.67@KRBTEST.COM'} at 127.11.88.67:47819
I20260806 01:03:29.286290 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 01:03:29.293874 15815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.287605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59716 (local address 127.11.88.126:40017)
0806 01:03:29.287664 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:29.287666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:29.287783 (+ 117us) server_negotiation.cc:407] Connection header received
0806 01:03:29.287818 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:29.287819 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:29.287828 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:29.287876 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:29.288444 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.288914 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.290113 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.290365 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.290424 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:29.291598 (+ 1174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:29.291599 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:29.291599 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:29.291605 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:29.292833 (+ 1228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:29.293165 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:29.293166 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:29.293166 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:29.293217 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:29.293388 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:29.293389 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:29.293389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:29.293527 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:29.293602 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:29.293694 (+ 92us) server_negotiation.cc:299] Negotiation successful
0806 01:03:29.293752 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260806 01:03:29.295532 15775 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59716:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 01:03:29.297151 15775 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:03:29.304364 16255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.300337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46610 (local address 127.11.88.66:42755)
0806 01:03:29.300570 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:29.300574 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:29.300585 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:03:29.300622 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:29.300625 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:29.300638 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:29.300708 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:29.300921 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.302019 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.303159 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.303907 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.303991 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:29.304061 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:29.304229 (+ 168us) server_negotiation.cc:299] Negotiation successful
0806 01:03:29.304275 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":93,"threads_started":1}
I20260806 01:03:29.304382 16251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.299756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:44679 (local address 127.0.0.1:50142)
0806 01:03:29.299925 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:29.299969 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:29.300038 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:29.300739 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:29.300740 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:29.300742 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:29.300814 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:29.300816 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.301812 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.301813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:29.303190 (+ 1377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:29.303191 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.304046 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.304046 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:29.304106 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:29.304123 (+ 17us) client_negotiation.cc:769] Sending connection context
0806 01:03:29.304202 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 01:03:29.304270 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":9,"thread_start_us":66,"threads_started":1}
I20260806 01:03:29.304382 16250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.299971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:42755 (local address 127.0.0.1:46610)
0806 01:03:29.300099 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:29.300111 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:29.300195 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:29.300804 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:29.300805 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:29.300807 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:29.300837 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:29.300838 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.302135 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.302136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:29.303062 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:29.303065 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.303994 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.303995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:29.304110 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:29.304123 (+ 13us) client_negotiation.cc:769] Sending connection context
0806 01:03:29.304202 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 01:03:29.304270 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":23,"thread_start_us":84,"threads_started":1}
I20260806 01:03:29.304728 16252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.299945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50142 (local address 127.11.88.67:44679)
0806 01:03:29.300554 (+ 609us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:29.300559 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:29.300570 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:03:29.300612 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:29.300614 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:29.300630 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:29.300899 (+ 269us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:29.300994 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.301706 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.303279 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.303971 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.304037 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:29.304087 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:29.304554 (+ 467us) server_negotiation.cc:299] Negotiation successful
0806 01:03:29.304607 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":86,"threads_started":1}
I20260806 01:03:29.305246 16036 tablet_service.cc:1467] Processing CreateTablet for tablet 8e2df40ddf424057ae4032e950063863 (DEFAULT_TABLE table=test-table [id=fa7267add1c441cdb907142e7bd36991]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:29.305415 16171 tablet_service.cc:1467] Processing CreateTablet for tablet 8e2df40ddf424057ae4032e950063863 (DEFAULT_TABLE table=test-table [id=fa7267add1c441cdb907142e7bd36991]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:29.305639 16036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e2df40ddf424057ae4032e950063863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:29.305701 16171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e2df40ddf424057ae4032e950063863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:29.306517 16253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.299780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:43245 (local address 127.0.0.1:43082)
0806 01:03:29.300100 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:29.300111 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:29.300163 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:29.300517 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:29.300520 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:29.300522 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:29.300599 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:29.300602 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.302063 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.302064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:29.303188 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:29.303191 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.306271 (+ 3080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.306272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:29.306339 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:29.306342 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:03:29.306400 (+ 58us) client_negotiation.cc:240] Negotiation successful
0806 01:03:29.306445 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":90,"threads_started":1}
I20260806 01:03:29.306531 16254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.300158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43082 (local address 127.11.88.65:43245)
0806 01:03:29.300329 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:29.300333 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:29.300342 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:03:29.300374 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:29.300376 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:29.300388 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:29.300692 (+ 304us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:29.300785 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.301962 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.304133 (+ 2171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.306170 (+ 2037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.306262 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:29.306316 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:29.306415 (+ 99us) server_negotiation.cc:299] Negotiation successful
0806 01:03:29.306452 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":86,"threads_started":1}
I20260806 01:03:29.307368 15900 tablet_service.cc:1467] Processing CreateTablet for tablet 8e2df40ddf424057ae4032e950063863 (DEFAULT_TABLE table=test-table [id=fa7267add1c441cdb907142e7bd36991]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:29.307714 15900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e2df40ddf424057ae4032e950063863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:29.309214 16257 tablet_bootstrap.cc:492] T 8e2df40ddf424057ae4032e950063863 P 0c2f40c3c0ca41b38e8cf2ea3638c8a9: Bootstrap starting.
I20260806 01:03:29.309950 16257 tablet_bootstrap.cc:654] T 8e2df40ddf424057ae4032e950063863 P 0c2f40c3c0ca41b38e8cf2ea3638c8a9: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:29.309950 16256 tablet_bootstrap.cc:492] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305: Bootstrap starting.
I20260806 01:03:29.310529 16256 tablet_bootstrap.cc:654] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:29.310578 16257 log.cc:824] T 8e2df40ddf424057ae4032e950063863 P 0c2f40c3c0ca41b38e8cf2ea3638c8a9: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:29.311203 16256 log.cc:824] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:29.311370 16257 tablet_bootstrap.cc:492] T 8e2df40ddf424057ae4032e950063863 P 0c2f40c3c0ca41b38e8cf2ea3638c8a9: No bootstrap required, opened a new log
I20260806 01:03:29.311456 16257 ts_tablet_manager.cc:1397] T 8e2df40ddf424057ae4032e950063863 P 0c2f40c3c0ca41b38e8cf2ea3638c8a9: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260806 01:03:29.311602 16258 tablet_bootstrap.cc:492] T 8e2df40ddf424057ae4032e950063863 P 56b91b6bc39f49868b701e57fd6c92c5: Bootstrap starting.
I20260806 01:03:29.312005 16256 tablet_bootstrap.cc:492] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305: No bootstrap required, opened a new log
I20260806 01:03:29.312059 16256 ts_tablet_manager.cc:1397] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 01:03:29.313180 16257 raft_consensus.cc:348] T 8e2df40ddf424057ae4032e950063863 P 0c2f40c3c0ca41b38e8cf2ea3638c8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2f40c3c0ca41b38e8cf2ea3638c8a9" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 44679 } } peers { permanent_uuid: "872fae5e26f44f7c992622c08f7bf305" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42755 } } peers { permanent_uuid: "56b91b6bc39f49868b701e57fd6c92c5" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43245 } }
I20260806 01:03:29.313346 16257 raft_consensus.cc:374] T 8e2df40ddf424057ae4032e950063863 P 0c2f40c3c0ca41b38e8cf2ea3638c8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:29.313397 16257 raft_consensus.cc:729] T 8e2df40ddf424057ae4032e950063863 P 0c2f40c3c0ca41b38e8cf2ea3638c8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c2f40c3c0ca41b38e8cf2ea3638c8a9, State: Initialized, Role: FOLLOWER
I20260806 01:03:29.313439 16256 raft_consensus.cc:348] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2f40c3c0ca41b38e8cf2ea3638c8a9" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 44679 } } peers { permanent_uuid: "872fae5e26f44f7c992622c08f7bf305" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42755 } } peers { permanent_uuid: "56b91b6bc39f49868b701e57fd6c92c5" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43245 } }
I20260806 01:03:29.313517 16257 consensus_queue.cc:260] T 8e2df40ddf424057ae4032e950063863 P 0c2f40c3c0ca41b38e8cf2ea3638c8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2f40c3c0ca41b38e8cf2ea3638c8a9" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 44679 } } peers { permanent_uuid: "872fae5e26f44f7c992622c08f7bf305" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42755 } } peers { permanent_uuid: "56b91b6bc39f49868b701e57fd6c92c5" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43245 } }
I20260806 01:03:29.313616 16256 raft_consensus.cc:374] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:29.313665 16256 raft_consensus.cc:729] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 872fae5e26f44f7c992622c08f7bf305, State: Initialized, Role: FOLLOWER
I20260806 01:03:29.313781 16256 consensus_queue.cc:260] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2f40c3c0ca41b38e8cf2ea3638c8a9" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 44679 } } peers { permanent_uuid: "872fae5e26f44f7c992622c08f7bf305" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42755 } } peers { permanent_uuid: "56b91b6bc39f49868b701e57fd6c92c5" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43245 } }
I20260806 01:03:29.313891 16239 heartbeater.cc:503] Master 127.11.88.126:40017 was elected leader, sending a full tablet report...
I20260806 01:03:29.313902 16257 ts_tablet_manager.cc:1428] T 8e2df40ddf424057ae4032e950063863 P 0c2f40c3c0ca41b38e8cf2ea3638c8a9: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260806 01:03:29.314092 16256 ts_tablet_manager.cc:1428] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 01:03:29.314343 16103 heartbeater.cc:503] Master 127.11.88.126:40017 was elected leader, sending a full tablet report...
I20260806 01:03:29.314901 16258 tablet_bootstrap.cc:654] T 8e2df40ddf424057ae4032e950063863 P 56b91b6bc39f49868b701e57fd6c92c5: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:29.315465 16258 log.cc:824] T 8e2df40ddf424057ae4032e950063863 P 56b91b6bc39f49868b701e57fd6c92c5: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:29.316319 16258 tablet_bootstrap.cc:492] T 8e2df40ddf424057ae4032e950063863 P 56b91b6bc39f49868b701e57fd6c92c5: No bootstrap required, opened a new log
I20260806 01:03:29.316380 16258 ts_tablet_manager.cc:1397] T 8e2df40ddf424057ae4032e950063863 P 56b91b6bc39f49868b701e57fd6c92c5: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260806 01:03:29.317790 16258 raft_consensus.cc:348] T 8e2df40ddf424057ae4032e950063863 P 56b91b6bc39f49868b701e57fd6c92c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2f40c3c0ca41b38e8cf2ea3638c8a9" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 44679 } } peers { permanent_uuid: "872fae5e26f44f7c992622c08f7bf305" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42755 } } peers { permanent_uuid: "56b91b6bc39f49868b701e57fd6c92c5" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43245 } }
I20260806 01:03:29.318019 16258 raft_consensus.cc:374] T 8e2df40ddf424057ae4032e950063863 P 56b91b6bc39f49868b701e57fd6c92c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:29.318060 16258 raft_consensus.cc:729] T 8e2df40ddf424057ae4032e950063863 P 56b91b6bc39f49868b701e57fd6c92c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b91b6bc39f49868b701e57fd6c92c5, State: Initialized, Role: FOLLOWER
I20260806 01:03:29.318179 16258 consensus_queue.cc:260] T 8e2df40ddf424057ae4032e950063863 P 56b91b6bc39f49868b701e57fd6c92c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2f40c3c0ca41b38e8cf2ea3638c8a9" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 44679 } } peers { permanent_uuid: "872fae5e26f44f7c992622c08f7bf305" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42755 } } peers { permanent_uuid: "56b91b6bc39f49868b701e57fd6c92c5" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43245 } }
I20260806 01:03:29.318614 16258 ts_tablet_manager.cc:1428] T 8e2df40ddf424057ae4032e950063863 P 56b91b6bc39f49868b701e57fd6c92c5: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 01:03:29.318631 15968 heartbeater.cc:503] Master 127.11.88.126:40017 was elected leader, sending a full tablet report...
I20260806 01:03:29.319533 16262 raft_consensus.cc:482] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:03:29.319664 16262 raft_consensus.cc:504] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2f40c3c0ca41b38e8cf2ea3638c8a9" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 44679 } } peers { permanent_uuid: "872fae5e26f44f7c992622c08f7bf305" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42755 } } peers { permanent_uuid: "56b91b6bc39f49868b701e57fd6c92c5" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43245 } }
I20260806 01:03:29.320112 16262 leader_election.cc:288] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c2f40c3c0ca41b38e8cf2ea3638c8a9 (127.11.88.67:44679), 56b91b6bc39f49868b701e57fd6c92c5 (127.11.88.65:43245)
I20260806 01:03:29.323320 16252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.320439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:33627 (local address 127.11.88.67:44679)
0806 01:03:29.320507 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:29.320509 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:29.320521 (+ 12us) server_negotiation.cc:407] Connection header received
0806 01:03:29.320551 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:29.320553 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:29.320566 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:29.320649 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:29.320846 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.321433 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.322509 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.322917 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.323007 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:29.323018 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:29.323203 (+ 185us) server_negotiation.cc:299] Negotiation successful
0806 01:03:29.323255 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 01:03:29.323320 16105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.320182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:44679 (local address 127.11.88.66:33627)
0806 01:03:29.320238 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:29.320249 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:29.320289 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:29.320677 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:29.320678 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:29.320680 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:29.320756 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:29.320758 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.321537 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.321538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:29.322413 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:29.322415 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.323006 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.323007 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:29.323096 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:29.323099 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:03:29.323192 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 01:03:29.323239 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":1}
I20260806 01:03:29.323515 16254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.320312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:50235 (local address 127.11.88.65:43245)
0806 01:03:29.320378 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:29.320380 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:29.320632 (+ 252us) server_negotiation.cc:407] Connection header received
0806 01:03:29.320676 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:29.320677 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:29.320688 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:29.320739 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:29.320890 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.321478 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.322640 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.323094 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.323208 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:29.323217 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:29.323402 (+ 185us) server_negotiation.cc:299] Negotiation successful
0806 01:03:29.323447 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 01:03:29.323524 16265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.320252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:43245 (local address 127.11.88.66:50235)
0806 01:03:29.320522 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:29.320546 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:29.320616 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:29.320744 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:29.320745 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:29.320747 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:29.320824 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:29.320826 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.321574 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.321576 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:29.322527 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:29.322530 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.323199 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.323200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:29.323300 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:29.323305 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 01:03:29.323391 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 01:03:29.323435 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":104,"threads_started":1}
I20260806 01:03:29.323868 15920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2df40ddf424057ae4032e950063863" candidate_uuid: "872fae5e26f44f7c992622c08f7bf305" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b91b6bc39f49868b701e57fd6c92c5" is_pre_election: true
I20260806 01:03:29.323968 16193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2df40ddf424057ae4032e950063863" candidate_uuid: "872fae5e26f44f7c992622c08f7bf305" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c2f40c3c0ca41b38e8cf2ea3638c8a9" is_pre_election: true
I20260806 01:03:29.324062 15920 raft_consensus.cc:2454] T 8e2df40ddf424057ae4032e950063863 P 56b91b6bc39f49868b701e57fd6c92c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 872fae5e26f44f7c992622c08f7bf305 in term 0.
I20260806 01:03:29.324149 16193 raft_consensus.cc:2454] T 8e2df40ddf424057ae4032e950063863 P 0c2f40c3c0ca41b38e8cf2ea3638c8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 872fae5e26f44f7c992622c08f7bf305 in term 0.
I20260806 01:03:29.324296 15991 leader_election.cc:302] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b91b6bc39f49868b701e57fd6c92c5, 872fae5e26f44f7c992622c08f7bf305; no voters:
I20260806 01:03:29.324437 16262 raft_consensus.cc:2781] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:03:29.324501 16262 raft_consensus.cc:482] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:03:29.324527 16262 raft_consensus.cc:3037] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:29.325325 16262 raft_consensus.cc:504] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2f40c3c0ca41b38e8cf2ea3638c8a9" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 44679 } } peers { permanent_uuid: "872fae5e26f44f7c992622c08f7bf305" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42755 } } peers { permanent_uuid: "56b91b6bc39f49868b701e57fd6c92c5" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43245 } }
I20260806 01:03:29.325536 16262 leader_election.cc:288] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305 [CANDIDATE]: Term 1 election: Requested vote from peers 0c2f40c3c0ca41b38e8cf2ea3638c8a9 (127.11.88.67:44679), 56b91b6bc39f49868b701e57fd6c92c5 (127.11.88.65:43245)
I20260806 01:03:29.325794 16193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2df40ddf424057ae4032e950063863" candidate_uuid: "872fae5e26f44f7c992622c08f7bf305" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c2f40c3c0ca41b38e8cf2ea3638c8a9"
I20260806 01:03:29.325850 15920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2df40ddf424057ae4032e950063863" candidate_uuid: "872fae5e26f44f7c992622c08f7bf305" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b91b6bc39f49868b701e57fd6c92c5"
I20260806 01:03:29.325915 16193 raft_consensus.cc:3037] T 8e2df40ddf424057ae4032e950063863 P 0c2f40c3c0ca41b38e8cf2ea3638c8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:29.325924 15920 raft_consensus.cc:3037] T 8e2df40ddf424057ae4032e950063863 P 56b91b6bc39f49868b701e57fd6c92c5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:29.326960 16193 raft_consensus.cc:2454] T 8e2df40ddf424057ae4032e950063863 P 0c2f40c3c0ca41b38e8cf2ea3638c8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 872fae5e26f44f7c992622c08f7bf305 in term 1.
I20260806 01:03:29.326960 15920 raft_consensus.cc:2454] T 8e2df40ddf424057ae4032e950063863 P 56b91b6bc39f49868b701e57fd6c92c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 872fae5e26f44f7c992622c08f7bf305 in term 1.
I20260806 01:03:29.327278 15989 leader_election.cc:302] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c2f40c3c0ca41b38e8cf2ea3638c8a9, 872fae5e26f44f7c992622c08f7bf305; no voters:
I20260806 01:03:29.327486 16262 raft_consensus.cc:2781] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:29.327718 16262 raft_consensus.cc:686] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305 [term 1 LEADER]: Becoming Leader. State: Replica: 872fae5e26f44f7c992622c08f7bf305, State: Running, Role: LEADER
I20260806 01:03:29.327838 16262 consensus_queue.cc:237] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2f40c3c0ca41b38e8cf2ea3638c8a9" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 44679 } } peers { permanent_uuid: "872fae5e26f44f7c992622c08f7bf305" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42755 } } peers { permanent_uuid: "56b91b6bc39f49868b701e57fd6c92c5" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43245 } }
W20260806 01:03:29.327946 16104 tablet.cc:2369] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 01:03:29.328794 15775 catalog_manager.cc:5495] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305 reported cstate change: term changed from 0 to 1, leader changed from <none> to 872fae5e26f44f7c992622c08f7bf305 (127.11.88.66). New cstate: current_term: 1 leader_uuid: "872fae5e26f44f7c992622c08f7bf305" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2f40c3c0ca41b38e8cf2ea3638c8a9" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 44679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "872fae5e26f44f7c992622c08f7bf305" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56b91b6bc39f49868b701e57fd6c92c5" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43245 } health_report { overall_health: UNKNOWN } } }
I20260806 01:03:29.340309 16255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.338001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46626 (local address 127.11.88.66:42755)
0806 01:03:29.338076 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:29.338078 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:29.338094 (+ 16us) server_negotiation.cc:407] Connection header received
0806 01:03:29.338134 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:29.338135 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:29.338156 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:29.338234 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:03:29.338382 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.338867 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.339592 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:29.339788 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:29.339839 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:29.340002 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:03:29.340109 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:03:29.340188 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:29.340208 (+ 20us) server_negotiation.cc:299] Negotiation successful
0806 01:03:29.340228 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 01:03:29.342276 15920 raft_consensus.cc:1261] T 8e2df40ddf424057ae4032e950063863 P 56b91b6bc39f49868b701e57fd6c92c5 [term 1 FOLLOWER]: Refusing update from remote peer 872fae5e26f44f7c992622c08f7bf305: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:29.342298 16193 raft_consensus.cc:1261] T 8e2df40ddf424057ae4032e950063863 P 0c2f40c3c0ca41b38e8cf2ea3638c8a9 [term 1 FOLLOWER]: Refusing update from remote peer 872fae5e26f44f7c992622c08f7bf305: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:29.342671 16262 consensus_queue.cc:1035] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c2f40c3c0ca41b38e8cf2ea3638c8a9" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 44679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:29.342815 16266 consensus_queue.cc:1035] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b91b6bc39f49868b701e57fd6c92c5" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:29.346123 16271 mvcc.cc:205] Tried to move back new op lower bound from 7315366745462865920 to 7315366745407512576. Current Snapshot: MvccSnapshot[applied={T|T < 7315366745462865920 or (T in {7315366745462865920})}]
I20260806 01:03:29.348346 15775 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:29.348438 15775 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:29.349184 15775 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 52535672b6264507bb970d2c6707b438: Sending DeleteTablet for 3 replicas of tablet 8e2df40ddf424057ae4032e950063863
I20260806 01:03:29.349509 16171 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e2df40ddf424057ae4032e950063863 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:29 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:50142
I20260806 01:03:29.349532 16036 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e2df40ddf424057ae4032e950063863 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:29 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:46610
I20260806 01:03:29.349545 15900 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e2df40ddf424057ae4032e950063863 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:29 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:43082
I20260806 01:03:29.349752 16278 tablet_replica.cc:330] T 8e2df40ddf424057ae4032e950063863 P 0c2f40c3c0ca41b38e8cf2ea3638c8a9: stopping tablet replica
I20260806 01:03:29.350044 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 15837
I20260806 01:03:29.353048 16278 raft_consensus.cc:2229] T 8e2df40ddf424057ae4032e950063863 P 0c2f40c3c0ca41b38e8cf2ea3638c8a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:03:29.353193 16278 raft_consensus.cc:2258] T 8e2df40ddf424057ae4032e950063863 P 0c2f40c3c0ca41b38e8cf2ea3638c8a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:29.353395 16280 tablet_replica.cc:330] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305: stopping tablet replica
I20260806 01:03:29.353500 16280 raft_consensus.cc:2229] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305 [term 1 LEADER]: Raft consensus shutting down.
I20260806 01:03:29.353628 16280 raft_consensus.cc:2258] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:29.353763 16278 ts_tablet_manager.cc:1905] T 8e2df40ddf424057ae4032e950063863 P 0c2f40c3c0ca41b38e8cf2ea3638c8a9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:29.354100 16280 ts_tablet_manager.cc:1905] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:29.355958 16278 ts_tablet_manager.cc:1918] T 8e2df40ddf424057ae4032e950063863 P 0c2f40c3c0ca41b38e8cf2ea3638c8a9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:03:29.356041 16278 log.cc:1196] T 8e2df40ddf424057ae4032e950063863 P 0c2f40c3c0ca41b38e8cf2ea3638c8a9: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-2/wal/wals/8e2df40ddf424057ae4032e950063863
I20260806 01:03:29.356356 16278 ts_tablet_manager.cc:1939] T 8e2df40ddf424057ae4032e950063863 P 0c2f40c3c0ca41b38e8cf2ea3638c8a9: Deleting consensus metadata
I20260806 01:03:29.356846 15760 catalog_manager.cc:4841] TS 0c2f40c3c0ca41b38e8cf2ea3638c8a9 (127.11.88.67:44679): tablet 8e2df40ddf424057ae4032e950063863 (table test-table [id=fa7267add1c441cdb907142e7bd36991]) successfully deleted
I20260806 01:03:29.356890 16280 ts_tablet_manager.cc:1918] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:03:29.356959 16280 log.cc:1196] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785978186227899-11617-0/minicluster-data/ts-1/wal/wals/8e2df40ddf424057ae4032e950063863
I20260806 01:03:29.357226 16280 ts_tablet_manager.cc:1939] T 8e2df40ddf424057ae4032e950063863 P 872fae5e26f44f7c992622c08f7bf305: Deleting consensus metadata
I20260806 01:03:29.357651 15760 catalog_manager.cc:4841] TS 872fae5e26f44f7c992622c08f7bf305 (127.11.88.66:42755): tablet 8e2df40ddf424057ae4032e950063863 (table test-table [id=fa7267add1c441cdb907142e7bd36991]) successfully deleted
W20260806 01:03:29.359009 15762 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.88.65:43245 (error 108)
I20260806 01:03:29.359181 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 15973
I20260806 01:03:29.361645 16253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.361494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:43245 (local address 127.0.0.1:43098)
0806 01:03:29.361565 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:29.361607 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.65:43245: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260806 01:03:29.361802 15762 catalog_manager.cc:4584] TS 56b91b6bc39f49868b701e57fd6c92c5 (127.11.88.65:43245): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8e2df40ddf424057ae4032e950063863: Network error: Client connection negotiation failed: client connection to 127.11.88.65:43245: connect: Connection refused (error 111)
I20260806 01:03:29.365525 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 16108
I20260806 01:03:29.371346 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 15743
2026-08-06T01:03:29Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (1991 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-06T01:03:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:03:29Z Disabled control of system clock
I20260806 01:03:29.401883 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:39147
--webserver_interface=127.11.88.126
--webserver_port=0
--builtin_ntp_servers=127.11.88.84:38687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:39147
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 01:03:29.483860 16285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:29.484077 16285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:29.484099 16285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:29.485181 16285 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:03:29.485215 16285 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:29.485229 16285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:29.485241 16285 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:03:29.485253 16285 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:03:29.486558 16285 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:38687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:39147
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:39147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16285
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:29.486768 16285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:29.487002 16285 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:29.491963 16291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:29.491973 16290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:29.491979 16293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:29.492436 16285 server_base.cc:1034] running on GCE node
I20260806 01:03:29.492704 16285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:29.493037 16285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:29.494217 16285 hybrid_clock.cc:648] HybridClock initialized: now 1785978209494210 us; error 34 us; skew 500 ppm
I20260806 01:03:29.495499 16285 webserver.cc:460] Webserver started at http://127.11.88.126:45421/ using document root <none> and password file <none>
I20260806 01:03:29.495803 16285 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:29.495889 16285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:29.496079 16285 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:29.497254 16285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "69b29e9a3d0f4ad199c92b321b687509"
format_stamp: "Formatted at 2026-08-06 01:03:29 on dist-test-slave-69rg"
server_key: "60ed1ac3fd6a57d9539672ee3e762839"
server_key_iv: "f0ae4cf0abb694a64ea59a52ab37b127"
server_key_version: "encryptionkey@0"
I20260806 01:03:29.497658 16285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "69b29e9a3d0f4ad199c92b321b687509"
format_stamp: "Formatted at 2026-08-06 01:03:29 on dist-test-slave-69rg"
server_key: "60ed1ac3fd6a57d9539672ee3e762839"
server_key_iv: "f0ae4cf0abb694a64ea59a52ab37b127"
server_key_version: "encryptionkey@0"
I20260806 01:03:29.499202 16285 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:03:29.500077 16299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:29.500278 16285 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:03:29.500399 16285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "69b29e9a3d0f4ad199c92b321b687509"
format_stamp: "Formatted at 2026-08-06 01:03:29 on dist-test-slave-69rg"
server_key: "60ed1ac3fd6a57d9539672ee3e762839"
server_key_iv: "f0ae4cf0abb694a64ea59a52ab37b127"
server_key_version: "encryptionkey@0"
I20260806 01:03:29.500494 16285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:29.504194 16285 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:29.504483 16285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:29.504640 16285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:29.509016 16285 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:39147
I20260806 01:03:29.509045 16353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:39147 every 8 connection(s)
I20260806 01:03:29.509409 16285 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:03:29.510149 16354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:29.512868 16354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69b29e9a3d0f4ad199c92b321b687509: Bootstrap starting.
I20260806 01:03:29.513490 16354 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 69b29e9a3d0f4ad199c92b321b687509: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:29.513743 16354 log.cc:824] T 00000000000000000000000000000000 P 69b29e9a3d0f4ad199c92b321b687509: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:29.514492 16354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69b29e9a3d0f4ad199c92b321b687509: No bootstrap required, opened a new log
I20260806 01:03:29.516026 16354 raft_consensus.cc:348] T 00000000000000000000000000000000 P 69b29e9a3d0f4ad199c92b321b687509 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69b29e9a3d0f4ad199c92b321b687509" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39147 } }
I20260806 01:03:29.516158 16354 raft_consensus.cc:374] T 00000000000000000000000000000000 P 69b29e9a3d0f4ad199c92b321b687509 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:29.516180 16354 raft_consensus.cc:729] T 00000000000000000000000000000000 P 69b29e9a3d0f4ad199c92b321b687509 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69b29e9a3d0f4ad199c92b321b687509, State: Initialized, Role: FOLLOWER
I20260806 01:03:29.516323 16354 consensus_queue.cc:260] T 00000000000000000000000000000000 P 69b29e9a3d0f4ad199c92b321b687509 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69b29e9a3d0f4ad199c92b321b687509" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39147 } }
I20260806 01:03:29.516417 16354 raft_consensus.cc:388] T 00000000000000000000000000000000 P 69b29e9a3d0f4ad199c92b321b687509 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:03:29.516440 16354 raft_consensus.cc:482] T 00000000000000000000000000000000 P 69b29e9a3d0f4ad199c92b321b687509 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:03:29.516492 16354 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 69b29e9a3d0f4ad199c92b321b687509 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:29.516588 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 16285
I20260806 01:03:29.516780 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:03:29.516981 11617 external_mini_cluster.cc:1428] Setting key 4ac730e9d7407df379bc58c4145c0213
I20260806 01:03:29.517192 16354 raft_consensus.cc:504] T 00000000000000000000000000000000 P 69b29e9a3d0f4ad199c92b321b687509 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69b29e9a3d0f4ad199c92b321b687509" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39147 } }
I20260806 01:03:29.517313 16354 leader_election.cc:302] T 00000000000000000000000000000000 P 69b29e9a3d0f4ad199c92b321b687509 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 69b29e9a3d0f4ad199c92b321b687509; no voters:
I20260806 01:03:29.517491 16354 leader_election.cc:288] T 00000000000000000000000000000000 P 69b29e9a3d0f4ad199c92b321b687509 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:03:29.517575 16357 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 69b29e9a3d0f4ad199c92b321b687509 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:29.517772 16354 sys_catalog.cc:564] T 00000000000000000000000000000000 P 69b29e9a3d0f4ad199c92b321b687509 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:03:29.517797 16357 raft_consensus.cc:686] T 00000000000000000000000000000000 P 69b29e9a3d0f4ad199c92b321b687509 [term 1 LEADER]: Becoming Leader. State: Replica: 69b29e9a3d0f4ad199c92b321b687509, State: Running, Role: LEADER
I20260806 01:03:29.518005 16357 consensus_queue.cc:237] T 00000000000000000000000000000000 P 69b29e9a3d0f4ad199c92b321b687509 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69b29e9a3d0f4ad199c92b321b687509" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39147 } }
I20260806 01:03:29.518496 16361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69b29e9a3d0f4ad199c92b321b687509 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 69b29e9a3d0f4ad199c92b321b687509. Latest consensus state: current_term: 1 leader_uuid: "69b29e9a3d0f4ad199c92b321b687509" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69b29e9a3d0f4ad199c92b321b687509" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39147 } } }
I20260806 01:03:29.518595 16361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69b29e9a3d0f4ad199c92b321b687509 [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:29.518739 16360 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69b29e9a3d0f4ad199c92b321b687509 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "69b29e9a3d0f4ad199c92b321b687509" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69b29e9a3d0f4ad199c92b321b687509" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39147 } } }
I20260806 01:03:29.518810 16360 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69b29e9a3d0f4ad199c92b321b687509 [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:29.519405 16368 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:03:29.520550 16368 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:03:29.521199 16359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.517506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41530 (local address 127.11.88.126:39147)
0806 01:03:29.517874 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:29.517883 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:29.519637 (+ 1754us) server_negotiation.cc:407] Connection header received
0806 01:03:29.519781 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:29.519789 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:29.519837 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:29.519974 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:29.520702 (+ 728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:29.520705 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:29.520706 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:03:29.520710 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:29.520760 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:03:29.520775 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:29.520863 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:29.520935 (+ 72us) server_negotiation.cc:299] Negotiation successful
0806 01:03:29.520994 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":107,"threads_started":1}
I20260806 01:03:29.522221 16368 catalog_manager.cc:1347] Generated new cluster ID: 454b794bfb1c4c7eb6a50d707a26de28
I20260806 01:03:29.522293 16368 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:03:29.538026 16368 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:03:29.538275 16368 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:03:29.547679 16368 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 69b29e9a3d0f4ad199c92b321b687509: Generated new TSK 0
I20260806 01:03:29.547971 16368 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:03:29.554232 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:0
--local_ip_for_outbound_sockets=127.11.88.65
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:39147
--builtin_ntp_servers=127.11.88.84:38687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 01:03:29.653664 16378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:29.653973 16378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:29.654006 16378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:29.655268 16378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:29.655306 16378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:29.655332 16378 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:03:29.656718 16378 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:38687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:39147
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16378
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:29.656977 16378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:29.657311 16378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:29.663476 16386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:29.663587 16384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:29.663789 16383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:29.663941 16378 server_base.cc:1034] running on GCE node
I20260806 01:03:29.664234 16378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:29.664582 16378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:29.665745 16378 hybrid_clock.cc:648] HybridClock initialized: now 1785978209665708 us; error 57 us; skew 500 ppm
I20260806 01:03:29.667177 16378 webserver.cc:460] Webserver started at http://127.11.88.65:42317/ using document root <none> and password file <none>
I20260806 01:03:29.667455 16378 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:29.667502 16378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:29.667651 16378 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:29.668769 16378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-0/data/instance:
uuid: "25fb56633d5240809c3f2cdda1e03513"
format_stamp: "Formatted at 2026-08-06 01:03:29 on dist-test-slave-69rg"
server_key: "6a548b9185b2695876548dc0d6036b77"
server_key_iv: "cad132facc15b85ae9c9cfa1c5a4c58c"
server_key_version: "encryptionkey@0"
I20260806 01:03:29.669145 16378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance:
uuid: "25fb56633d5240809c3f2cdda1e03513"
format_stamp: "Formatted at 2026-08-06 01:03:29 on dist-test-slave-69rg"
server_key: "6a548b9185b2695876548dc0d6036b77"
server_key_iv: "cad132facc15b85ae9c9cfa1c5a4c58c"
server_key_version: "encryptionkey@0"
I20260806 01:03:29.670763 16378 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 01:03:29.671677 16392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:29.671869 16378 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:29.671996 16378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "25fb56633d5240809c3f2cdda1e03513"
format_stamp: "Formatted at 2026-08-06 01:03:29 on dist-test-slave-69rg"
server_key: "6a548b9185b2695876548dc0d6036b77"
server_key_iv: "cad132facc15b85ae9c9cfa1c5a4c58c"
server_key_version: "encryptionkey@0"
I20260806 01:03:29.672071 16378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:29.675983 16378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:29.676293 16378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:29.676452 16378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:29.676699 16378 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:29.677032 16378 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:29.677095 16378 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:29.677141 16378 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:29.677167 16378 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:29.684077 16378 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:46487
I20260806 01:03:29.684127 16506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:46487 every 8 connection(s)
I20260806 01:03:29.684470 16378 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
I20260806 01:03:29.687743 16359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.685210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:38615 (local address 127.11.88.126:39147)
0806 01:03:29.685260 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:29.685262 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:29.685500 (+ 238us) server_negotiation.cc:407] Connection header received
0806 01:03:29.686176 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:29.686178 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:29.686194 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:29.686265 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:29.687426 (+ 1161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:29.687428 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:29.687428 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:03:29.687433 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:29.687450 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:03:29.687455 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:29.687531 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:29.687650 (+ 119us) server_negotiation.cc:299] Negotiation successful
0806 01:03:29.687668 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260806 01:03:29.687949 16510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.685171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:39147 (local address 127.11.88.65:38615)
0806 01:03:29.685374 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:29.685409 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:29.686008 (+ 599us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:29.686350 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:29.686354 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:29.686364 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:29.687272 (+ 908us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 01:03:29.687273 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:29.687302 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 01:03:29.687330 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:29.687531 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:29.687538 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:29.687541 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:03:29.687662 (+ 121us) client_negotiation.cc:240] Negotiation successful
0806 01:03:29.687725 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":87,"threads_started":1}
I20260806 01:03:29.688526 16508 heartbeater.cc:347] Connected to a master server at 127.11.88.126:39147
I20260806 01:03:29.688618 16508 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:29.688733 16508 heartbeater.cc:511] Master 127.11.88.126:39147 requested a full tablet report, sending...
I20260806 01:03:29.689262 16318 ts_manager.cc:194] Registered new tserver with Master: 25fb56633d5240809c3f2cdda1e03513 (127.11.88.65:46487)
I20260806 01:03:29.690567 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 16378
I20260806 01:03:29.690652 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance
I20260806 01:03:29.690797 11617 external_mini_cluster.cc:1428] Setting key 407ea1bbaf9843725c7ea7eafc29415d
I20260806 01:03:29.691648 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:0
--local_ip_for_outbound_sockets=127.11.88.66
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:39147
--builtin_ntp_servers=127.11.88.84:38687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 01:03:29.773937 16511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:29.774142 16511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:29.774165 16511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:29.775408 16511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:29.775456 16511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:29.775482 16511 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:03:29.776993 16511 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:38687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:39147
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16511
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:29.777210 16511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:29.777473 16511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:29.782639 16516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:29.782639 16519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:29.782660 16517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:29.782828 16511 server_base.cc:1034] running on GCE node
I20260806 01:03:29.783176 16511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:29.783442 16511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:29.784621 16511 hybrid_clock.cc:648] HybridClock initialized: now 1785978209784611 us; error 43 us; skew 500 ppm
I20260806 01:03:29.790689 16511 webserver.cc:460] Webserver started at http://127.11.88.66:33107/ using document root <none> and password file <none>
I20260806 01:03:29.790982 16511 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:29.791057 16511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:29.791220 16511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:29.792375 16511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-1/data/instance:
uuid: "5f7c06650fe14ce18951e5c54e0ce13a"
format_stamp: "Formatted at 2026-08-06 01:03:29 on dist-test-slave-69rg"
server_key: "f428ea551c4a36c94fd6136d2d19dba6"
server_key_iv: "1ae80ed9e155dca5b2f4e4ce61aa5aba"
server_key_version: "encryptionkey@0"
I20260806 01:03:29.792739 16511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance:
uuid: "5f7c06650fe14ce18951e5c54e0ce13a"
format_stamp: "Formatted at 2026-08-06 01:03:29 on dist-test-slave-69rg"
server_key: "f428ea551c4a36c94fd6136d2d19dba6"
server_key_iv: "1ae80ed9e155dca5b2f4e4ce61aa5aba"
server_key_version: "encryptionkey@0"
I20260806 01:03:29.794158 16511 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260806 01:03:29.794907 16525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:29.795082 16511 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 01:03:29.795219 16511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "5f7c06650fe14ce18951e5c54e0ce13a"
format_stamp: "Formatted at 2026-08-06 01:03:29 on dist-test-slave-69rg"
server_key: "f428ea551c4a36c94fd6136d2d19dba6"
server_key_iv: "1ae80ed9e155dca5b2f4e4ce61aa5aba"
server_key_version: "encryptionkey@0"
I20260806 01:03:29.795296 16511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:29.798668 16511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:29.798923 16511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:29.799068 16511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:29.799280 16511 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:29.799582 16511 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:29.799638 16511 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:29.799678 16511 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:29.799705 16511 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:29.805598 16511 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:34253
I20260806 01:03:29.805652 16638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:34253 every 8 connection(s)
I20260806 01:03:29.806021 16511 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
I20260806 01:03:29.806685 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 16511
I20260806 01:03:29.806813 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance
I20260806 01:03:29.807005 11617 external_mini_cluster.cc:1428] Setting key de02c07f36601ce365fc39470733f18c
I20260806 01:03:29.808013 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:0
--local_ip_for_outbound_sockets=127.11.88.67
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:39147
--builtin_ntp_servers=127.11.88.84:38687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260806 01:03:29.809265 16359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.806798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:44021 (local address 127.11.88.126:39147)
0806 01:03:29.806865 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:29.806868 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:29.807136 (+ 268us) server_negotiation.cc:407] Connection header received
0806 01:03:29.807702 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:29.807705 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:29.807713 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:29.807792 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:29.808989 (+ 1197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:29.808991 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:29.808991 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:03:29.808996 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:29.809015 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:03:29.809021 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:29.809091 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:29.809144 (+ 53us) server_negotiation.cc:299] Negotiation successful
0806 01:03:29.809159 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260806 01:03:29.809377 16641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.806762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:39147 (local address 127.11.88.66:44021)
0806 01:03:29.807010 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:29.807039 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:29.807582 (+ 543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:29.807853 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:29.807857 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:29.807865 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:29.808834 (+ 969us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 01:03:29.808835 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:29.808863 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 01:03:29.808890 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:29.809087 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:29.809089 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:29.809091 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 01:03:29.809143 (+ 52us) client_negotiation.cc:240] Negotiation successful
0806 01:03:29.809188 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":79,"threads_started":1}
I20260806 01:03:29.809854 16639 heartbeater.cc:347] Connected to a master server at 127.11.88.126:39147
I20260806 01:03:29.809958 16639 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:29.810114 16639 heartbeater.cc:511] Master 127.11.88.126:39147 requested a full tablet report, sending...
I20260806 01:03:29.810513 16318 ts_manager.cc:194] Registered new tserver with Master: 5f7c06650fe14ce18951e5c54e0ce13a (127.11.88.66:34253)
W20260806 01:03:29.893832 16642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:29.894039 16642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:29.894063 16642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:29.895668 16642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:29.895728 16642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:29.895758 16642 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:03:29.897959 16642 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:38687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:39147
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16642
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:29.898316 16642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:29.898741 16642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:29.905885 16651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:29.905946 16649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:29.906086 16648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:29.906131 16642 server_base.cc:1034] running on GCE node
I20260806 01:03:29.906404 16642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:29.906741 16642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:29.907902 16642 hybrid_clock.cc:648] HybridClock initialized: now 1785978209907867 us; error 47 us; skew 500 ppm
I20260806 01:03:29.909598 16642 webserver.cc:460] Webserver started at http://127.11.88.67:45903/ using document root <none> and password file <none>
I20260806 01:03:29.909945 16642 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:29.910014 16642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:29.910203 16642 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:29.911831 16642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-2/data/instance:
uuid: "92080e729e644b9b908878990d4bee17"
format_stamp: "Formatted at 2026-08-06 01:03:29 on dist-test-slave-69rg"
server_key: "aed7849e8ab6bee39ece32c3963525d3"
server_key_iv: "cbb9f718cff7daaea3313fd4ced6820f"
server_key_version: "encryptionkey@0"
I20260806 01:03:29.912287 16642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance:
uuid: "92080e729e644b9b908878990d4bee17"
format_stamp: "Formatted at 2026-08-06 01:03:29 on dist-test-slave-69rg"
server_key: "aed7849e8ab6bee39ece32c3963525d3"
server_key_iv: "cbb9f718cff7daaea3313fd4ced6820f"
server_key_version: "encryptionkey@0"
I20260806 01:03:29.914410 16642 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260806 01:03:29.915572 16657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:29.915851 16642 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:03:29.915964 16642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "92080e729e644b9b908878990d4bee17"
format_stamp: "Formatted at 2026-08-06 01:03:29 on dist-test-slave-69rg"
server_key: "aed7849e8ab6bee39ece32c3963525d3"
server_key_iv: "cbb9f718cff7daaea3313fd4ced6820f"
server_key_version: "encryptionkey@0"
I20260806 01:03:29.916055 16642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:29.921940 16642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:29.922286 16642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:29.922432 16642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:29.922693 16642 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:29.923149 16642 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:29.923187 16642 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:29.923209 16642 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:29.923223 16642 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:29.931591 16773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:38345 every 8 connection(s)
I20260806 01:03:29.931636 16642 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:38345
I20260806 01:03:29.932263 16642 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
I20260806 01:03:29.934254 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 16642
I20260806 01:03:29.934434 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance
I20260806 01:03:29.934739 11617 external_mini_cluster.cc:1428] Setting key 84fdaeb4a09c94c9b4e418e9bc1f0ff9
I20260806 01:03:29.941511 16359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.933421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:58669 (local address 127.11.88.126:39147)
0806 01:03:29.933473 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:29.933475 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:29.938490 (+ 5015us) server_negotiation.cc:407] Connection header received
0806 01:03:29.939363 (+ 873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:29.939365 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:29.939372 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:29.939407 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:29.941167 (+ 1760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:29.941169 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:29.941170 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:03:29.941176 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:29.941194 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:03:29.941199 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:29.941237 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:29.941382 (+ 145us) server_negotiation.cc:299] Negotiation successful
0806 01:03:29.941402 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 01:03:29.942044 16776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.933107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:39147 (local address 127.11.88.67:58669)
0806 01:03:29.938306 (+ 5199us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:29.938362 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:29.939226 (+ 864us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:29.939673 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:29.939679 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:29.939690 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:29.940949 (+ 1259us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 01:03:29.940950 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:29.940995 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 01:03:29.941034 (+ 39us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:29.941285 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:29.941291 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:29.941295 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:03:29.941675 (+ 380us) client_negotiation.cc:240] Negotiation successful
0806 01:03:29.941754 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5109,"thread_start_us":93,"threads_started":1}
I20260806 01:03:29.942516 16774 heartbeater.cc:347] Connected to a master server at 127.11.88.126:39147
I20260806 01:03:29.942633 16774 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:29.942799 16774 heartbeater.cc:511] Master 127.11.88.126:39147 requested a full tablet report, sending...
I20260806 01:03:29.946125 16318 ts_manager.cc:194] Registered new tserver with Master: 92080e729e644b9b908878990d4bee17 (127.11.88.67:38345)
I20260806 01:03:29.949479 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 01:03:29.952044 16359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.951093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41532 (local address 127.11.88.126:39147)
0806 01:03:29.951139 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:29.951141 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:29.951231 (+ 90us) server_negotiation.cc:407] Connection header received
0806 01:03:29.951284 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:29.951285 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:29.951290 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:29.951334 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:29.951816 (+ 482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:29.951817 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:29.951817 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:03:29.951820 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:29.951833 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:03:29.951837 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:29.951881 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:29.951915 (+ 34us) server_negotiation.cc:299] Negotiation successful
0806 01:03:29.951927 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 01:03:29.953392 16318 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41532:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 01:03:29.955017 16318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:03:29.959374 16783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.957413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:34253 (local address 127.0.0.1:39312)
0806 01:03:29.957843 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:29.957891 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:29.957961 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:29.958286 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:29.958293 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:29.958299 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:29.958921 (+ 622us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 01:03:29.958921 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:29.958935 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 01:03:29.958953 (+ 18us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:29.959218 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:29.959224 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:29.959227 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:03:29.959290 (+ 63us) client_negotiation.cc:240] Negotiation successful
0806 01:03:29.959304 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":61,"threads_started":1}
I20260806 01:03:29.959403 16785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.957603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39312 (local address 127.11.88.66:34253)
0806 01:03:29.958134 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:29.958138 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:29.958148 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:03:29.958173 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:29.958175 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:29.958183 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:29.958510 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:29.959035 (+ 525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:29.959042 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:29.959042 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:03:29.959047 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:29.959084 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:03:29.959116 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:29.959224 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:29.959307 (+ 83us) server_negotiation.cc:299] Negotiation successful
0806 01:03:29.959323 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":489,"thread_start_us":127,"threads_started":1}
I20260806 01:03:29.959558 16786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.957631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:38345 (local address 127.0.0.1:32932)
0806 01:03:29.958083 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:29.958091 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:29.958127 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:29.958388 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:29.958389 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:29.958392 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:29.959088 (+ 696us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 01:03:29.959089 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:29.959098 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 01:03:29.959111 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:29.959392 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:29.959393 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:29.959393 (+ 0us) client_negotiation.cc:769] Sending connection context
0806 01:03:29.959449 (+ 56us) client_negotiation.cc:240] Negotiation successful
0806 01:03:29.959465 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":103,"threads_started":1}
I20260806 01:03:29.960088 16784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.957567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49272 (local address 127.11.88.65:46487)
0806 01:03:29.957799 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:29.957804 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:29.957968 (+ 164us) server_negotiation.cc:407] Connection header received
0806 01:03:29.958143 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:29.958150 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:29.958164 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:29.958261 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:29.959727 (+ 1466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:29.959741 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:29.959741 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:03:29.959745 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:29.959800 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:03:29.959827 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:29.959886 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:29.959985 (+ 99us) server_negotiation.cc:299] Negotiation successful
0806 01:03:29.960000 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":103,"threads_started":1}
I20260806 01:03:29.960273 16787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.957741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32932 (local address 127.11.88.67:38345)
0806 01:03:29.958256 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:29.958260 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:29.958279 (+ 19us) server_negotiation.cc:407] Connection header received
0806 01:03:29.958305 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:29.958307 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:29.958316 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:29.958386 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:29.959204 (+ 818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:29.959213 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:29.959214 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:03:29.959218 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:29.959251 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:03:29.959276 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:29.959395 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:29.959992 (+ 597us) server_negotiation.cc:299] Negotiation successful
0806 01:03:29.960010 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":109,"threads_started":1}
I20260806 01:03:29.960242 16573 tablet_service.cc:1467] Processing CreateTablet for tablet 78b03ad2a9e44b9db057764a02c7d8cc (DEFAULT_TABLE table=test-table [id=14ccbe727e6b4a89b5c1f468f1257816]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:29.960455 16782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:29.957414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:46487 (local address 127.0.0.1:49272)
0806 01:03:29.957878 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:29.957891 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:29.957992 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:29.958585 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:29.958586 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:29.958590 (+ 4us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:29.959571 (+ 981us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 01:03:29.959571 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:29.959576 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 01:03:29.959587 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:29.959912 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:29.959913 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:29.959914 (+ 1us) client_negotiation.cc:769] Sending connection context
0806 01:03:29.960272 (+ 358us) client_negotiation.cc:240] Negotiation successful
0806 01:03:29.960287 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"mutex_wait_us":2,"thread_start_us":95,"threads_started":1}
I20260806 01:03:29.960640 16573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78b03ad2a9e44b9db057764a02c7d8cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:29.960930 16706 tablet_service.cc:1467] Processing CreateTablet for tablet 78b03ad2a9e44b9db057764a02c7d8cc (DEFAULT_TABLE table=test-table [id=14ccbe727e6b4a89b5c1f468f1257816]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:29.961261 16706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78b03ad2a9e44b9db057764a02c7d8cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:29.962430 16440 tablet_service.cc:1467] Processing CreateTablet for tablet 78b03ad2a9e44b9db057764a02c7d8cc (DEFAULT_TABLE table=test-table [id=14ccbe727e6b4a89b5c1f468f1257816]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:29.962786 16440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78b03ad2a9e44b9db057764a02c7d8cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:29.963377 16788 tablet_bootstrap.cc:492] T 78b03ad2a9e44b9db057764a02c7d8cc P 5f7c06650fe14ce18951e5c54e0ce13a: Bootstrap starting.
I20260806 01:03:29.963996 16788 tablet_bootstrap.cc:654] T 78b03ad2a9e44b9db057764a02c7d8cc P 5f7c06650fe14ce18951e5c54e0ce13a: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:29.964349 16788 log.cc:824] T 78b03ad2a9e44b9db057764a02c7d8cc P 5f7c06650fe14ce18951e5c54e0ce13a: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:29.964511 16789 tablet_bootstrap.cc:492] T 78b03ad2a9e44b9db057764a02c7d8cc P 92080e729e644b9b908878990d4bee17: Bootstrap starting.
I20260806 01:03:29.965220 16789 tablet_bootstrap.cc:654] T 78b03ad2a9e44b9db057764a02c7d8cc P 92080e729e644b9b908878990d4bee17: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:29.965342 16788 tablet_bootstrap.cc:492] T 78b03ad2a9e44b9db057764a02c7d8cc P 5f7c06650fe14ce18951e5c54e0ce13a: No bootstrap required, opened a new log
I20260806 01:03:29.965418 16788 ts_tablet_manager.cc:1397] T 78b03ad2a9e44b9db057764a02c7d8cc P 5f7c06650fe14ce18951e5c54e0ce13a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 01:03:29.965543 16789 log.cc:824] T 78b03ad2a9e44b9db057764a02c7d8cc P 92080e729e644b9b908878990d4bee17: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:29.966250 16792 tablet_bootstrap.cc:492] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513: Bootstrap starting.
I20260806 01:03:29.966346 16789 tablet_bootstrap.cc:492] T 78b03ad2a9e44b9db057764a02c7d8cc P 92080e729e644b9b908878990d4bee17: No bootstrap required, opened a new log
I20260806 01:03:29.966418 16789 ts_tablet_manager.cc:1397] T 78b03ad2a9e44b9db057764a02c7d8cc P 92080e729e644b9b908878990d4bee17: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 01:03:29.966809 16792 tablet_bootstrap.cc:654] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:29.967094 16792 log.cc:824] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:29.967819 16792 tablet_bootstrap.cc:492] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513: No bootstrap required, opened a new log
I20260806 01:03:29.967908 16792 ts_tablet_manager.cc:1397] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 01:03:29.968261 16788 raft_consensus.cc:348] T 78b03ad2a9e44b9db057764a02c7d8cc P 5f7c06650fe14ce18951e5c54e0ce13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f7c06650fe14ce18951e5c54e0ce13a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34253 } } peers { permanent_uuid: "92080e729e644b9b908878990d4bee17" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38345 } } peers { permanent_uuid: "25fb56633d5240809c3f2cdda1e03513" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 46487 } }
I20260806 01:03:29.968465 16788 raft_consensus.cc:374] T 78b03ad2a9e44b9db057764a02c7d8cc P 5f7c06650fe14ce18951e5c54e0ce13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:29.968503 16788 raft_consensus.cc:729] T 78b03ad2a9e44b9db057764a02c7d8cc P 5f7c06650fe14ce18951e5c54e0ce13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f7c06650fe14ce18951e5c54e0ce13a, State: Initialized, Role: FOLLOWER
I20260806 01:03:29.968664 16788 consensus_queue.cc:260] T 78b03ad2a9e44b9db057764a02c7d8cc P 5f7c06650fe14ce18951e5c54e0ce13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f7c06650fe14ce18951e5c54e0ce13a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34253 } } peers { permanent_uuid: "92080e729e644b9b908878990d4bee17" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38345 } } peers { permanent_uuid: "25fb56633d5240809c3f2cdda1e03513" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 46487 } }
I20260806 01:03:29.968931 16788 ts_tablet_manager.cc:1428] T 78b03ad2a9e44b9db057764a02c7d8cc P 5f7c06650fe14ce18951e5c54e0ce13a: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260806 01:03:29.969090 16639 heartbeater.cc:503] Master 127.11.88.126:39147 was elected leader, sending a full tablet report...
I20260806 01:03:29.969029 16789 raft_consensus.cc:348] T 78b03ad2a9e44b9db057764a02c7d8cc P 92080e729e644b9b908878990d4bee17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f7c06650fe14ce18951e5c54e0ce13a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34253 } } peers { permanent_uuid: "92080e729e644b9b908878990d4bee17" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38345 } } peers { permanent_uuid: "25fb56633d5240809c3f2cdda1e03513" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 46487 } }
I20260806 01:03:29.969165 16789 raft_consensus.cc:374] T 78b03ad2a9e44b9db057764a02c7d8cc P 92080e729e644b9b908878990d4bee17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:29.969187 16789 raft_consensus.cc:729] T 78b03ad2a9e44b9db057764a02c7d8cc P 92080e729e644b9b908878990d4bee17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92080e729e644b9b908878990d4bee17, State: Initialized, Role: FOLLOWER
I20260806 01:03:29.969295 16789 consensus_queue.cc:260] T 78b03ad2a9e44b9db057764a02c7d8cc P 92080e729e644b9b908878990d4bee17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f7c06650fe14ce18951e5c54e0ce13a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34253 } } peers { permanent_uuid: "92080e729e644b9b908878990d4bee17" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38345 } } peers { permanent_uuid: "25fb56633d5240809c3f2cdda1e03513" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 46487 } }
I20260806 01:03:29.969544 16789 ts_tablet_manager.cc:1428] T 78b03ad2a9e44b9db057764a02c7d8cc P 92080e729e644b9b908878990d4bee17: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 01:03:29.969856 16774 heartbeater.cc:503] Master 127.11.88.126:39147 was elected leader, sending a full tablet report...
I20260806 01:03:29.970336 16792 raft_consensus.cc:348] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f7c06650fe14ce18951e5c54e0ce13a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34253 } } peers { permanent_uuid: "92080e729e644b9b908878990d4bee17" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38345 } } peers { permanent_uuid: "25fb56633d5240809c3f2cdda1e03513" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 46487 } }
I20260806 01:03:29.970484 16792 raft_consensus.cc:374] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:29.970520 16792 raft_consensus.cc:729] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25fb56633d5240809c3f2cdda1e03513, State: Initialized, Role: FOLLOWER
I20260806 01:03:29.970639 16792 consensus_queue.cc:260] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f7c06650fe14ce18951e5c54e0ce13a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34253 } } peers { permanent_uuid: "92080e729e644b9b908878990d4bee17" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38345 } } peers { permanent_uuid: "25fb56633d5240809c3f2cdda1e03513" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 46487 } }
I20260806 01:03:29.970889 16792 ts_tablet_manager.cc:1428] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 01:03:29.970916 16508 heartbeater.cc:503] Master 127.11.88.126:39147 was elected leader, sending a full tablet report...
W20260806 01:03:30.056638 16640 tablet.cc:2369] T 78b03ad2a9e44b9db057764a02c7d8cc P 5f7c06650fe14ce18951e5c54e0ce13a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 01:03:30.182958 16775 tablet.cc:2369] T 78b03ad2a9e44b9db057764a02c7d8cc P 92080e729e644b9b908878990d4bee17: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 01:03:30.185153 16509 tablet.cc:2369] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 01:03:30.224696 16796 raft_consensus.cc:482] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:03:30.224843 16796 raft_consensus.cc:504] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f7c06650fe14ce18951e5c54e0ce13a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34253 } } peers { permanent_uuid: "92080e729e644b9b908878990d4bee17" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38345 } } peers { permanent_uuid: "25fb56633d5240809c3f2cdda1e03513" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 46487 } }
I20260806 01:03:30.225308 16796 leader_election.cc:288] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f7c06650fe14ce18951e5c54e0ce13a (127.11.88.66:34253), 92080e729e644b9b908878990d4bee17 (127.11.88.67:38345)
I20260806 01:03:30.226938 16785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:30.225677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:34407 (local address 127.11.88.66:34253)
0806 01:03:30.225744 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:30.225745 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:30.225801 (+ 56us) server_negotiation.cc:407] Connection header received
0806 01:03:30.225900 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:30.225901 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:30.225908 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:30.225994 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:30.226659 (+ 665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:30.226660 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:30.226660 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:03:30.226665 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:30.226688 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:03:30.226693 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:30.226756 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:30.226850 (+ 94us) server_negotiation.cc:299] Negotiation successful
0806 01:03:30.226866 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260806 01:03:30.226953 16797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:30.225580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:34253 (local address 127.11.88.65:34407)
0806 01:03:30.225729 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:30.225742 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:30.225809 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:30.226052 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:30.226053 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:30.226056 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:30.226540 (+ 484us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 01:03:30.226541 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:30.226549 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 01:03:30.226562 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:30.226778 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:30.226779 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:30.226780 (+ 1us) client_negotiation.cc:769] Sending connection context
0806 01:03:30.226849 (+ 69us) client_negotiation.cc:240] Negotiation successful
0806 01:03:30.226866 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":91,"threads_started":1}
I20260806 01:03:30.227052 16787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:30.225927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:36493 (local address 127.11.88.67:38345)
0806 01:03:30.226006 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:30.226008 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:30.226018 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:03:30.226050 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:30.226051 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:30.226055 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:30.226112 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:30.226817 (+ 705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:30.226819 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:30.226819 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:03:30.226824 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:30.226849 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:03:30.226853 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:30.226917 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:30.226965 (+ 48us) server_negotiation.cc:299] Negotiation successful
0806 01:03:30.226980 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 01:03:30.227068 16798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:30.225795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:38345 (local address 127.11.88.65:36493)
0806 01:03:30.225927 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:30.225936 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:30.225994 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:30.226168 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:30.226169 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:30.226191 (+ 22us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:30.226710 (+ 519us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 01:03:30.226710 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:30.226717 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 01:03:30.226729 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:30.226915 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:30.226916 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:30.226916 (+ 0us) client_negotiation.cc:769] Sending connection context
0806 01:03:30.226969 (+ 53us) client_negotiation.cc:240] Negotiation successful
0806 01:03:30.226982 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":65,"threads_started":1}
I20260806 01:03:30.227293 16593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78b03ad2a9e44b9db057764a02c7d8cc" candidate_uuid: "25fb56633d5240809c3f2cdda1e03513" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7c06650fe14ce18951e5c54e0ce13a" is_pre_election: true
I20260806 01:03:30.227433 16593 raft_consensus.cc:2454] T 78b03ad2a9e44b9db057764a02c7d8cc P 5f7c06650fe14ce18951e5c54e0ce13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25fb56633d5240809c3f2cdda1e03513 in term 0.
I20260806 01:03:30.227671 16396 leader_election.cc:302] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25fb56633d5240809c3f2cdda1e03513, 5f7c06650fe14ce18951e5c54e0ce13a; no voters:
I20260806 01:03:30.227665 16726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78b03ad2a9e44b9db057764a02c7d8cc" candidate_uuid: "25fb56633d5240809c3f2cdda1e03513" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92080e729e644b9b908878990d4bee17" is_pre_election: true
I20260806 01:03:30.227802 16726 raft_consensus.cc:2454] T 78b03ad2a9e44b9db057764a02c7d8cc P 92080e729e644b9b908878990d4bee17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25fb56633d5240809c3f2cdda1e03513 in term 0.
I20260806 01:03:30.227943 16796 raft_consensus.cc:2781] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:03:30.228019 16796 raft_consensus.cc:482] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:03:30.228047 16796 raft_consensus.cc:3037] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:30.228825 16796 raft_consensus.cc:504] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f7c06650fe14ce18951e5c54e0ce13a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34253 } } peers { permanent_uuid: "92080e729e644b9b908878990d4bee17" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38345 } } peers { permanent_uuid: "25fb56633d5240809c3f2cdda1e03513" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 46487 } }
I20260806 01:03:30.228981 16796 leader_election.cc:288] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513 [CANDIDATE]: Term 1 election: Requested vote from peers 5f7c06650fe14ce18951e5c54e0ce13a (127.11.88.66:34253), 92080e729e644b9b908878990d4bee17 (127.11.88.67:38345)
I20260806 01:03:30.229180 16593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78b03ad2a9e44b9db057764a02c7d8cc" candidate_uuid: "25fb56633d5240809c3f2cdda1e03513" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7c06650fe14ce18951e5c54e0ce13a"
I20260806 01:03:30.229206 16726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78b03ad2a9e44b9db057764a02c7d8cc" candidate_uuid: "25fb56633d5240809c3f2cdda1e03513" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92080e729e644b9b908878990d4bee17"
I20260806 01:03:30.229276 16593 raft_consensus.cc:3037] T 78b03ad2a9e44b9db057764a02c7d8cc P 5f7c06650fe14ce18951e5c54e0ce13a [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:30.229276 16726 raft_consensus.cc:3037] T 78b03ad2a9e44b9db057764a02c7d8cc P 92080e729e644b9b908878990d4bee17 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:30.230245 16726 raft_consensus.cc:2454] T 78b03ad2a9e44b9db057764a02c7d8cc P 92080e729e644b9b908878990d4bee17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25fb56633d5240809c3f2cdda1e03513 in term 1.
I20260806 01:03:30.230245 16593 raft_consensus.cc:2454] T 78b03ad2a9e44b9db057764a02c7d8cc P 5f7c06650fe14ce18951e5c54e0ce13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25fb56633d5240809c3f2cdda1e03513 in term 1.
I20260806 01:03:30.230430 16396 leader_election.cc:302] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25fb56633d5240809c3f2cdda1e03513, 92080e729e644b9b908878990d4bee17; no voters:
I20260806 01:03:30.230530 16796 raft_consensus.cc:2781] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:30.230684 16796 raft_consensus.cc:686] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513 [term 1 LEADER]: Becoming Leader. State: Replica: 25fb56633d5240809c3f2cdda1e03513, State: Running, Role: LEADER
I20260806 01:03:30.230782 16796 consensus_queue.cc:237] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f7c06650fe14ce18951e5c54e0ce13a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34253 } } peers { permanent_uuid: "92080e729e644b9b908878990d4bee17" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38345 } } peers { permanent_uuid: "25fb56633d5240809c3f2cdda1e03513" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 46487 } }
I20260806 01:03:30.231666 16317 catalog_manager.cc:5495] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25fb56633d5240809c3f2cdda1e03513 (127.11.88.65). New cstate: current_term: 1 leader_uuid: "25fb56633d5240809c3f2cdda1e03513" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f7c06650fe14ce18951e5c54e0ce13a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92080e729e644b9b908878990d4bee17" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25fb56633d5240809c3f2cdda1e03513" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 46487 } health_report { overall_health: HEALTHY } } }
I20260806 01:03:30.246773 16784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:30.245624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49274 (local address 127.11.88.65:46487)
0806 01:03:30.245697 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:30.245699 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:30.245706 (+ 7us) server_negotiation.cc:407] Connection header received
0806 01:03:30.245748 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:30.245749 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:30.245784 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:30.245908 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:30.246504 (+ 596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:30.246505 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:30.246506 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:03:30.246510 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:30.246535 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:03:30.246539 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:30.246606 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:30.246660 (+ 54us) server_negotiation.cc:299] Negotiation successful
0806 01:03:30.246676 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 01:03:30.249107 16726 raft_consensus.cc:1261] T 78b03ad2a9e44b9db057764a02c7d8cc P 92080e729e644b9b908878990d4bee17 [term 1 FOLLOWER]: Refusing update from remote peer 25fb56633d5240809c3f2cdda1e03513: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:30.249107 16593 raft_consensus.cc:1261] T 78b03ad2a9e44b9db057764a02c7d8cc P 5f7c06650fe14ce18951e5c54e0ce13a [term 1 FOLLOWER]: Refusing update from remote peer 25fb56633d5240809c3f2cdda1e03513: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:30.249637 16799 consensus_queue.cc:1035] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92080e729e644b9b908878990d4bee17" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:30.249936 16796 consensus_queue.cc:1035] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7c06650fe14ce18951e5c54e0ce13a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:30.253031 16802 mvcc.cc:205] Tried to move back new op lower bound from 7315366749176672256 to 7315366749105934336. Current Snapshot: MvccSnapshot[applied={T|T < 7315366749176672256}]
I20260806 01:03:30.255772 16317 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41532:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:30.255903 16317 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41532:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:30.256757 16317 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 69b29e9a3d0f4ad199c92b321b687509: Sending DeleteTablet for 3 replicas of tablet 78b03ad2a9e44b9db057764a02c7d8cc
I20260806 01:03:30.257128 16440 tablet_service.cc:1514] Processing DeleteTablet for tablet 78b03ad2a9e44b9db057764a02c7d8cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:30 UTC) from {username='slave'} at 127.0.0.1:49272
I20260806 01:03:30.257192 16573 tablet_service.cc:1514] Processing DeleteTablet for tablet 78b03ad2a9e44b9db057764a02c7d8cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:30 UTC) from {username='slave'} at 127.0.0.1:39312
I20260806 01:03:30.257246 16706 tablet_service.cc:1514] Processing DeleteTablet for tablet 78b03ad2a9e44b9db057764a02c7d8cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:30 UTC) from {username='slave'} at 127.0.0.1:32932
I20260806 01:03:30.257472 16812 tablet_replica.cc:330] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513: stopping tablet replica
I20260806 01:03:30.257606 16814 tablet_replica.cc:330] T 78b03ad2a9e44b9db057764a02c7d8cc P 92080e729e644b9b908878990d4bee17: stopping tablet replica
I20260806 01:03:30.257640 16812 raft_consensus.cc:2229] T 78b03ad2a9e44b9db057764a02c7d8cc P 25fb56633d5240809c3f2cdda1e03513 [term 1 LEADER]: Raft consensus shutting down.
I20260806 01:03:30.257678 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 16378
I20260806 01:03:30.257714 16814 raft_consensus.cc:2229] T 78b03ad2a9e44b9db057764a02c7d8cc P 92080e729e644b9b908878990d4bee17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:03:30.262032 16813 tablet_replica.cc:330] T 78b03ad2a9e44b9db057764a02c7d8cc P 5f7c06650fe14ce18951e5c54e0ce13a: stopping tablet replica
I20260806 01:03:30.262207 16813 raft_consensus.cc:2229] T 78b03ad2a9e44b9db057764a02c7d8cc P 5f7c06650fe14ce18951e5c54e0ce13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:03:30.262341 16813 raft_consensus.cc:2258] T 78b03ad2a9e44b9db057764a02c7d8cc P 5f7c06650fe14ce18951e5c54e0ce13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:30.262360 16814 raft_consensus.cc:2258] T 78b03ad2a9e44b9db057764a02c7d8cc P 92080e729e644b9b908878990d4bee17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:30.262984 16814 ts_tablet_manager.cc:1905] T 78b03ad2a9e44b9db057764a02c7d8cc P 92080e729e644b9b908878990d4bee17: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:30.262985 16813 ts_tablet_manager.cc:1905] T 78b03ad2a9e44b9db057764a02c7d8cc P 5f7c06650fe14ce18951e5c54e0ce13a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260806 01:03:30.264853 16300 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.88.65:46487 (error 108)
I20260806 01:03:30.265242 16814 ts_tablet_manager.cc:1918] T 78b03ad2a9e44b9db057764a02c7d8cc P 92080e729e644b9b908878990d4bee17: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:03:30.265300 16813 ts_tablet_manager.cc:1918] T 78b03ad2a9e44b9db057764a02c7d8cc P 5f7c06650fe14ce18951e5c54e0ce13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:03:30.265347 16814 log.cc:1196] T 78b03ad2a9e44b9db057764a02c7d8cc P 92080e729e644b9b908878990d4bee17: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-2/wal/wals/78b03ad2a9e44b9db057764a02c7d8cc
I20260806 01:03:30.265537 16813 log.cc:1196] T 78b03ad2a9e44b9db057764a02c7d8cc P 5f7c06650fe14ce18951e5c54e0ce13a: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785978186227899-11617-0/minicluster-data/ts-1/wal/wals/78b03ad2a9e44b9db057764a02c7d8cc
W20260806 01:03:30.265587 16782 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:30.265408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:46487 (local address 127.0.0.1:49288)
0806 01:03:30.265458 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:30.265472 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:30.265522 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.65:46487: BlockingWrite error: write error: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":23}
W20260806 01:03:30.265748 16300 catalog_manager.cc:4584] TS 25fb56633d5240809c3f2cdda1e03513 (127.11.88.65:46487): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 78b03ad2a9e44b9db057764a02c7d8cc: Network error: Client connection negotiation failed: client connection to 127.11.88.65:46487: BlockingWrite error: write error: Connection reset by peer (error 104)
I20260806 01:03:30.265805 16814 ts_tablet_manager.cc:1939] T 78b03ad2a9e44b9db057764a02c7d8cc P 92080e729e644b9b908878990d4bee17: Deleting consensus metadata
I20260806 01:03:30.265806 16813 ts_tablet_manager.cc:1939] T 78b03ad2a9e44b9db057764a02c7d8cc P 5f7c06650fe14ce18951e5c54e0ce13a: Deleting consensus metadata
I20260806 01:03:30.266148 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 16511
I20260806 01:03:30.266295 16303 catalog_manager.cc:4841] TS 5f7c06650fe14ce18951e5c54e0ce13a (127.11.88.66:34253): tablet 78b03ad2a9e44b9db057764a02c7d8cc (table test-table [id=14ccbe727e6b4a89b5c1f468f1257816]) successfully deleted
I20260806 01:03:30.266392 16303 catalog_manager.cc:4841] TS 92080e729e644b9b908878990d4bee17 (127.11.88.67:38345): tablet 78b03ad2a9e44b9db057764a02c7d8cc (table test-table [id=14ccbe727e6b4a89b5c1f468f1257816]) successfully deleted
I20260806 01:03:30.272244 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 16642
I20260806 01:03:30.280306 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 16285
2026-08-06T01:03:30Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (908 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260806 01:03:30.303043 11617 mini_oidc.cc:152] Starting JWKS server
I20260806 01:03:30.304325 11617 webserver.cc:460] Webserver started at https://127.0.0.1:37887/ using document root <none> and password file <none>
I20260806 01:03:30.304468 11617 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 01:03:30.304675 11617 webserver.cc:460] Webserver started at http://127.0.0.1:36635/ using document root <none> and password file <none>
2026-08-06T01:03:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:03:30Z Disabled control of system clock
I20260806 01:03:30.314042 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:33609
--webserver_interface=127.11.88.126
--webserver_port=0
--builtin_ntp_servers=127.11.88.84:35785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:33609
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37887/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785978186227899-11617-0/testchainca.cert with env {}
W20260806 01:03:30.409399 16821 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:30.409634 16821 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:30.409662 16821 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:30.411099 16821 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:03:30.411159 16821 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:30.411173 16821 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:30.411188 16821 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:03:30.411201 16821 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 01:03:30.411222 16821 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 01:03:30.411235 16821 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37887/jwks.json
I20260806 01:03:30.413190 16821 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:35785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:33609
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:33609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37887/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785978186227899-11617-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16821
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:30.413518 16821 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:30.413800 16821 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 01:03:30.419631 16821 server_base.cc:1034] running on GCE node
W20260806 01:03:30.419718 16827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:30.419646 16826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:30.419646 16829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:30.420095 16821 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:30.420447 16821 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:30.421626 16821 hybrid_clock.cc:648] HybridClock initialized: now 1785978210421615 us; error 50 us; skew 500 ppm
I20260806 01:03:30.423096 16821 webserver.cc:460] Webserver started at http://127.11.88.126:34581/ using document root <none> and password file <none>
I20260806 01:03:30.423393 16821 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:30.423465 16821 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:30.423610 16821 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:30.424687 16821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "5ac8c14f74914a8b892202fc02df0279"
format_stamp: "Formatted at 2026-08-06 01:03:30 on dist-test-slave-69rg"
server_key: "b91b8cf66ddcdcad3c0f8db0156c9311"
server_key_iv: "e884b111701da361d9658eb429dd9574"
server_key_version: "encryptionkey@0"
I20260806 01:03:30.425055 16821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "5ac8c14f74914a8b892202fc02df0279"
format_stamp: "Formatted at 2026-08-06 01:03:30 on dist-test-slave-69rg"
server_key: "b91b8cf66ddcdcad3c0f8db0156c9311"
server_key_iv: "e884b111701da361d9658eb429dd9574"
server_key_version: "encryptionkey@0"
I20260806 01:03:30.426589 16821 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 01:03:30.427392 16835 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:30.427574 16821 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:30.427680 16821 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "5ac8c14f74914a8b892202fc02df0279"
format_stamp: "Formatted at 2026-08-06 01:03:30 on dist-test-slave-69rg"
server_key: "b91b8cf66ddcdcad3c0f8db0156c9311"
server_key_iv: "e884b111701da361d9658eb429dd9574"
server_key_version: "encryptionkey@0"
I20260806 01:03:30.427755 16821 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:30.443110 16821 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:30.443488 16821 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:30.443650 16821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:30.447918 16821 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:33609
I20260806 01:03:30.447969 16889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:33609 every 8 connection(s)
I20260806 01:03:30.448343 16821 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:03:30.449447 16890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:30.449860 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 16821
I20260806 01:03:30.449988 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:03:30.450205 11617 external_mini_cluster.cc:1428] Setting key 9331a6dc47f6f6871625a79a3f46b93b
I20260806 01:03:30.452692 16890 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ac8c14f74914a8b892202fc02df0279: Bootstrap starting.
I20260806 01:03:30.453478 16890 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ac8c14f74914a8b892202fc02df0279: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:30.453860 16890 log.cc:824] T 00000000000000000000000000000000 P 5ac8c14f74914a8b892202fc02df0279: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:30.454716 16890 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ac8c14f74914a8b892202fc02df0279: No bootstrap required, opened a new log
I20260806 01:03:30.456359 16893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:30.450827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48342 (local address 127.11.88.126:33609)
0806 01:03:30.451038 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:30.451046 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:30.451071 (+ 25us) server_negotiation.cc:407] Connection header received
0806 01:03:30.451543 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:30.451549 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:30.451616 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:30.451740 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:30.451999 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:30.452941 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:30.454225 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:30.454732 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:30.454895 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:30.455635 (+ 740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:30.455639 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:30.455639 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:03:30.455828 (+ 189us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:30.455860 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:03:30.455870 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:30.455925 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:30.456038 (+ 113us) server_negotiation.cc:299] Negotiation successful
0806 01:03:30.456142 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":91,"threads_started":1}
I20260806 01:03:30.457219 16890 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ac8c14f74914a8b892202fc02df0279 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ac8c14f74914a8b892202fc02df0279" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 33609 } }
I20260806 01:03:30.457384 16890 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5ac8c14f74914a8b892202fc02df0279 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:30.457437 16890 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ac8c14f74914a8b892202fc02df0279 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac8c14f74914a8b892202fc02df0279, State: Initialized, Role: FOLLOWER
I20260806 01:03:30.457576 16890 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ac8c14f74914a8b892202fc02df0279 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ac8c14f74914a8b892202fc02df0279" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 33609 } }
I20260806 01:03:30.457626 11617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 01:03:30.457669 16890 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5ac8c14f74914a8b892202fc02df0279 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:03:30.457724 16890 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ac8c14f74914a8b892202fc02df0279 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:03:30.457772 16890 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ac8c14f74914a8b892202fc02df0279 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:30.458434 16890 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ac8c14f74914a8b892202fc02df0279 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ac8c14f74914a8b892202fc02df0279" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 33609 } }
I20260806 01:03:30.458554 16890 leader_election.cc:302] T 00000000000000000000000000000000 P 5ac8c14f74914a8b892202fc02df0279 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5ac8c14f74914a8b892202fc02df0279; no voters:
I20260806 01:03:30.458724 16890 leader_election.cc:288] T 00000000000000000000000000000000 P 5ac8c14f74914a8b892202fc02df0279 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:03:30.458756 16895 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ac8c14f74914a8b892202fc02df0279 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:30.458870 16895 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5ac8c14f74914a8b892202fc02df0279 [term 1 LEADER]: Becoming Leader. State: Replica: 5ac8c14f74914a8b892202fc02df0279, State: Running, Role: LEADER
I20260806 01:03:30.458956 16895 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ac8c14f74914a8b892202fc02df0279 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ac8c14f74914a8b892202fc02df0279" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 33609 } }
I20260806 01:03:30.459010 16890 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ac8c14f74914a8b892202fc02df0279 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:03:30.459304 16897 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ac8c14f74914a8b892202fc02df0279 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ac8c14f74914a8b892202fc02df0279. Latest consensus state: current_term: 1 leader_uuid: "5ac8c14f74914a8b892202fc02df0279" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ac8c14f74914a8b892202fc02df0279" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 33609 } } }
I20260806 01:03:30.459547 16897 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ac8c14f74914a8b892202fc02df0279 [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:30.459470 16896 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ac8c14f74914a8b892202fc02df0279 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5ac8c14f74914a8b892202fc02df0279" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ac8c14f74914a8b892202fc02df0279" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 33609 } } }
I20260806 01:03:30.459874 16896 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ac8c14f74914a8b892202fc02df0279 [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:30.459935 16903 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:03:30.460604 16903 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:03:30.462245 16903 catalog_manager.cc:1347] Generated new cluster ID: 5ccca17426eb4f21a546d987e474d550
I20260806 01:03:30.462301 16903 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:03:30.494807 16903 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:03:30.495352 16903 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:03:30.499002 16903 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5ac8c14f74914a8b892202fc02df0279: Generated new TSK 0
I20260806 01:03:30.499202 16903 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 01:03:30.530046 16921 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260806 01:03:30.530236 16921 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 01:03:30.530494 16893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:30.507721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48358 (local address 127.11.88.126:33609)
0806 01:03:30.507800 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:30.507803 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:30.507896 (+ 93us) server_negotiation.cc:407] Connection header received
0806 01:03:30.507999 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:30.508000 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:30.508012 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:30.508067 (+ 55us) server_negotiation.cc:226] Negotiated authn=JWT
0806 01:03:30.508231 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:30.508727 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:30.509907 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:30.510089 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:30.510140 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:30.510382 (+ 242us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 01:03:30.530065 (+ 19683us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37887/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0806 01:03:30.530420 (+ 355us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48358: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37887/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":27}
W20260806 01:03:30.530556 16893 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48358: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37887/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260806 01:03:30.530817 16920 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:30.507592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:33609 (local address 127.0.0.1:48358)
0806 01:03:30.507812 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:30.507823 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:30.507902 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:30.508085 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:30.508086 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:30.508087 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0806 01:03:30.508163 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:30.508166 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:30.508830 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:30.508831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:30.509793 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:30.509796 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:30.510176 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:30.510176 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:30.510243 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:30.510267 (+ 24us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 01:03:30.530220 (+ 19953us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37887/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0806 01:03:30.530345 (+ 125us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.88.126:33609: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37887/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":113,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.11.88.126:33609: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37887/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260806 01:03:30.531244 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 16821
2026-08-06T01:03:30Z chronyd exiting
I20260806 01:03:30.569271 11617 test_util.cc:175] -----------------------------------------------
I20260806 01:03:30.569360 11617 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785978186227899-11617-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (268 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260806 01:03:30.570297 11617 mini_oidc.cc:152] Starting JWKS server
I20260806 01:03:30.571026 11617 webserver.cc:460] Webserver started at https://127.0.0.1:41121/ using document root <none> and password file <none>
I20260806 01:03:30.571101 11617 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 01:03:30.571260 11617 webserver.cc:460] Webserver started at http://127.0.0.1:35087/ using document root <none> and password file <none>
2026-08-06T01:03:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:03:30Z Disabled control of system clock
I20260806 01:03:30.580094 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:33491
--webserver_interface=127.11.88.126
--webserver_port=0
--builtin_ntp_servers=127.11.88.84:36541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:33491
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41121/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785978186227899-11617-0/testchainca.cert with env {}
W20260806 01:03:30.663839 16927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:30.664045 16927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:30.664068 16927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:30.665256 16927 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:03:30.665299 16927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:30.665313 16927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:30.665351 16927 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:03:30.665373 16927 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 01:03:30.665396 16927 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 01:03:30.665431 16927 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41121/jwks.json
I20260806 01:03:30.667579 16927 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:36541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:33491
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:33491
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41121/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785978186227899-11617-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16927
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:30.667883 16927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:30.668124 16927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 01:03:30.673691 16927 server_base.cc:1034] running on GCE node
W20260806 01:03:30.673636 16932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:30.673714 16933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:30.673642 16935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:30.674237 16927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:30.674568 16927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:30.675742 16927 hybrid_clock.cc:648] HybridClock initialized: now 1785978210675734 us; error 50 us; skew 500 ppm
I20260806 01:03:30.677011 16927 webserver.cc:460] Webserver started at http://127.11.88.126:43515/ using document root <none> and password file <none>
I20260806 01:03:30.677294 16927 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:30.677369 16927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:30.677541 16927 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:30.678725 16927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "dd0bf01bf3ed47668ab60131489c0ce3"
format_stamp: "Formatted at 2026-08-06 01:03:30 on dist-test-slave-69rg"
server_key: "65e5807e6aa686b5a3e3159c4f493d61"
server_key_iv: "613788e7b2f3f18570907b38ed01df51"
server_key_version: "encryptionkey@0"
I20260806 01:03:30.679107 16927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "dd0bf01bf3ed47668ab60131489c0ce3"
format_stamp: "Formatted at 2026-08-06 01:03:30 on dist-test-slave-69rg"
server_key: "65e5807e6aa686b5a3e3159c4f493d61"
server_key_iv: "613788e7b2f3f18570907b38ed01df51"
server_key_version: "encryptionkey@0"
I20260806 01:03:30.680943 16927 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 01:03:30.681895 16942 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:30.682085 16927 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:03:30.682197 16927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "dd0bf01bf3ed47668ab60131489c0ce3"
format_stamp: "Formatted at 2026-08-06 01:03:30 on dist-test-slave-69rg"
server_key: "65e5807e6aa686b5a3e3159c4f493d61"
server_key_iv: "613788e7b2f3f18570907b38ed01df51"
server_key_version: "encryptionkey@0"
I20260806 01:03:30.682291 16927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:30.692152 16927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:30.692507 16927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:30.692677 16927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:30.697387 16927 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:33491
I20260806 01:03:30.697438 16994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:33491 every 8 connection(s)
I20260806 01:03:30.697903 16927 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:03:30.698724 16995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:30.701699 16995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd0bf01bf3ed47668ab60131489c0ce3: Bootstrap starting.
I20260806 01:03:30.702343 16995 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd0bf01bf3ed47668ab60131489c0ce3: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:30.702703 16995 log.cc:824] T 00000000000000000000000000000000 P dd0bf01bf3ed47668ab60131489c0ce3: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:30.703460 16995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd0bf01bf3ed47668ab60131489c0ce3: No bootstrap required, opened a new log
I20260806 01:03:30.704878 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 16927
I20260806 01:03:30.705016 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:03:30.705220 11617 external_mini_cluster.cc:1428] Setting key 4fcfaa54408cac9f89c93fb66563174b
I20260806 01:03:30.705333 16995 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd0bf01bf3ed47668ab60131489c0ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd0bf01bf3ed47668ab60131489c0ce3" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 33491 } }
I20260806 01:03:30.705513 16995 raft_consensus.cc:374] T 00000000000000000000000000000000 P dd0bf01bf3ed47668ab60131489c0ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:30.705569 16995 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd0bf01bf3ed47668ab60131489c0ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd0bf01bf3ed47668ab60131489c0ce3, State: Initialized, Role: FOLLOWER
I20260806 01:03:30.705741 16995 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd0bf01bf3ed47668ab60131489c0ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd0bf01bf3ed47668ab60131489c0ce3" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 33491 } }
I20260806 01:03:30.705866 16995 raft_consensus.cc:388] T 00000000000000000000000000000000 P dd0bf01bf3ed47668ab60131489c0ce3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:03:30.705911 16995 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd0bf01bf3ed47668ab60131489c0ce3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:03:30.705965 16995 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd0bf01bf3ed47668ab60131489c0ce3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:30.706578 16995 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd0bf01bf3ed47668ab60131489c0ce3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd0bf01bf3ed47668ab60131489c0ce3" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 33491 } }
I20260806 01:03:30.706717 16995 leader_election.cc:302] T 00000000000000000000000000000000 P dd0bf01bf3ed47668ab60131489c0ce3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dd0bf01bf3ed47668ab60131489c0ce3; no voters:
I20260806 01:03:30.706904 16995 leader_election.cc:288] T 00000000000000000000000000000000 P dd0bf01bf3ed47668ab60131489c0ce3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:03:30.706960 17000 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd0bf01bf3ed47668ab60131489c0ce3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:30.707194 16995 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd0bf01bf3ed47668ab60131489c0ce3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:03:30.707209 17000 raft_consensus.cc:686] T 00000000000000000000000000000000 P dd0bf01bf3ed47668ab60131489c0ce3 [term 1 LEADER]: Becoming Leader. State: Replica: dd0bf01bf3ed47668ab60131489c0ce3, State: Running, Role: LEADER
I20260806 01:03:30.707351 17000 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd0bf01bf3ed47668ab60131489c0ce3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd0bf01bf3ed47668ab60131489c0ce3" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 33491 } }
I20260806 01:03:30.707695 17000 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd0bf01bf3ed47668ab60131489c0ce3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd0bf01bf3ed47668ab60131489c0ce3. Latest consensus state: current_term: 1 leader_uuid: "dd0bf01bf3ed47668ab60131489c0ce3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd0bf01bf3ed47668ab60131489c0ce3" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 33491 } } }
I20260806 01:03:30.707765 17001 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd0bf01bf3ed47668ab60131489c0ce3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dd0bf01bf3ed47668ab60131489c0ce3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd0bf01bf3ed47668ab60131489c0ce3" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 33491 } } }
I20260806 01:03:30.707778 17000 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd0bf01bf3ed47668ab60131489c0ce3 [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:30.707827 17001 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd0bf01bf3ed47668ab60131489c0ce3 [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:30.708576 17008 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:03:30.709102 17008 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:03:30.710796 17008 catalog_manager.cc:1347] Generated new cluster ID: feb28df2c52c43ff9b860950a08518d3
I20260806 01:03:30.710853 17008 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:03:30.712915 16999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:30.705896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57680 (local address 127.11.88.126:33491)
0806 01:03:30.707153 (+ 1257us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:30.707165 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:30.707206 (+ 41us) server_negotiation.cc:407] Connection header received
0806 01:03:30.707332 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:30.707339 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:30.707415 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:30.707644 (+ 229us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:30.707967 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:30.709632 (+ 1665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:30.710725 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:30.711322 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:30.711439 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:30.712202 (+ 763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:30.712205 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:30.712206 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:03:30.712421 (+ 215us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:30.712461 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:03:30.712474 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:30.712540 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:30.712638 (+ 98us) server_negotiation.cc:299] Negotiation successful
0806 01:03:30.712711 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1161,"thread_start_us":110,"threads_started":1}
I20260806 01:03:30.713958 11617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 01:03:30.734704 17008 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:03:30.735366 17008 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:03:30.741852 17008 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dd0bf01bf3ed47668ab60131489c0ce3: Generated new TSK 0
I20260806 01:03:30.742074 17008 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 01:03:30.770468 17026 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260806 01:03:30.770569 17026 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 01:03:30.770886 16999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:30.747988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57696 (local address 127.11.88.126:33491)
0806 01:03:30.748088 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:30.748091 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:30.748109 (+ 18us) server_negotiation.cc:407] Connection header received
0806 01:03:30.748193 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:30.748194 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:30.748205 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:30.748269 (+ 64us) server_negotiation.cc:226] Negotiated authn=JWT
0806 01:03:30.748415 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:30.748917 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:30.750105 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:30.750323 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:30.750387 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:30.750579 (+ 192us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 01:03:30.770622 (+ 20043us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41121/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 01:03:30.770826 (+ 204us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57696: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41121/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":33}
W20260806 01:03:30.770970 16999 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57696: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41121/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260806 01:03:30.771023 17025 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:30.747920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:33491 (local address 127.0.0.1:57696)
0806 01:03:30.748051 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:30.748070 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:30.748121 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:30.748286 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:30.748286 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:30.748288 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0806 01:03:30.748348 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:30.748351 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:30.749007 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:30.749008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:30.749991 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:30.749995 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:30.750408 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:30.750410 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:30.750474 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:30.750481 (+ 7us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 01:03:30.770777 (+ 20296us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41121/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 01:03:30.770909 (+ 132us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.88.126:33491: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41121/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":69,"threads_started":1}
I20260806 01:03:30.771498 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 16927
2026-08-06T01:03:30Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (241 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260806 01:03:30.811317 11617 mini_oidc.cc:152] Starting JWKS server
I20260806 01:03:30.812090 11617 webserver.cc:460] Webserver started at https://127.0.0.1:45629/ using document root <none> and password file <none>
I20260806 01:03:30.812145 11617 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 01:03:30.812301 11617 webserver.cc:460] Webserver started at http://127.0.0.1:35719/ using document root <none> and password file <none>
2026-08-06T01:03:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:03:30Z Disabled control of system clock
I20260806 01:03:30.822893 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:37811
--webserver_interface=127.11.88.126
--webserver_port=0
--builtin_ntp_servers=127.11.88.84:35431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:37811
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45629/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 01:03:30.916358 17032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:30.916666 17032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:30.916692 17032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:30.918134 17032 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:03:30.918195 17032 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:30.918219 17032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:30.918242 17032 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:03:30.918264 17032 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 01:03:30.918292 17032 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 01:03:30.918320 17032 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45629/jwks.json
I20260806 01:03:30.921418 17032 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:35431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:37811
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:37811
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45629/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17032
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:30.921746 17032 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:30.922149 17032 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:30.928764 17038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:30.930801 17037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:30.930859 17040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:30.931123 17032 server_base.cc:1034] running on GCE node
I20260806 01:03:30.931870 17032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:30.932431 17032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:30.933651 17032 hybrid_clock.cc:648] HybridClock initialized: now 1785978210933629 us; error 53 us; skew 500 ppm
I20260806 01:03:30.935293 17032 webserver.cc:460] Webserver started at http://127.11.88.126:33067/ using document root <none> and password file <none>
I20260806 01:03:30.936020 17032 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:30.936107 17032 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:30.936267 17032 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:30.938088 17032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "70165ce2488b457bb113ad3b624e3fb9"
format_stamp: "Formatted at 2026-08-06 01:03:30 on dist-test-slave-69rg"
server_key: "63bf64ae219b6f8560c896ab61765f0c"
server_key_iv: "b5467785b40bf1dbbf48b6bb83e87a63"
server_key_version: "encryptionkey@0"
I20260806 01:03:30.938490 17032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "70165ce2488b457bb113ad3b624e3fb9"
format_stamp: "Formatted at 2026-08-06 01:03:30 on dist-test-slave-69rg"
server_key: "63bf64ae219b6f8560c896ab61765f0c"
server_key_iv: "b5467785b40bf1dbbf48b6bb83e87a63"
server_key_version: "encryptionkey@0"
I20260806 01:03:30.940237 17032 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260806 01:03:30.941354 17046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:30.941584 17032 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:30.941726 17032 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "70165ce2488b457bb113ad3b624e3fb9"
format_stamp: "Formatted at 2026-08-06 01:03:30 on dist-test-slave-69rg"
server_key: "63bf64ae219b6f8560c896ab61765f0c"
server_key_iv: "b5467785b40bf1dbbf48b6bb83e87a63"
server_key_version: "encryptionkey@0"
I20260806 01:03:30.941874 17032 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:30.962523 17032 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:30.962965 17032 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:30.963157 17032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:30.969388 17032 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:37811
I20260806 01:03:30.969544 17099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:37811 every 8 connection(s)
I20260806 01:03:30.970103 17032 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:03:30.971228 17100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:30.975792 17100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70165ce2488b457bb113ad3b624e3fb9: Bootstrap starting.
I20260806 01:03:30.976778 17100 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70165ce2488b457bb113ad3b624e3fb9: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:30.977193 17100 log.cc:824] T 00000000000000000000000000000000 P 70165ce2488b457bb113ad3b624e3fb9: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:30.978243 17100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70165ce2488b457bb113ad3b624e3fb9: No bootstrap required, opened a new log
I20260806 01:03:30.979854 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 17032
I20260806 01:03:30.979984 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:03:30.980192 11617 external_mini_cluster.cc:1428] Setting key 49954e840bb145af4ae2bc814b5c7526
I20260806 01:03:30.981935 17100 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70165ce2488b457bb113ad3b624e3fb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70165ce2488b457bb113ad3b624e3fb9" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 37811 } }
I20260806 01:03:30.982115 17100 raft_consensus.cc:374] T 00000000000000000000000000000000 P 70165ce2488b457bb113ad3b624e3fb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:30.982161 17100 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70165ce2488b457bb113ad3b624e3fb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70165ce2488b457bb113ad3b624e3fb9, State: Initialized, Role: FOLLOWER
I20260806 01:03:30.982292 17100 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70165ce2488b457bb113ad3b624e3fb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70165ce2488b457bb113ad3b624e3fb9" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 37811 } }
I20260806 01:03:30.982398 17100 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70165ce2488b457bb113ad3b624e3fb9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:03:30.982462 17100 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70165ce2488b457bb113ad3b624e3fb9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:03:30.982519 17100 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70165ce2488b457bb113ad3b624e3fb9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:30.986496 17104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:30.980965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57544 (local address 127.11.88.126:37811)
0806 01:03:30.981256 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:30.981264 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:30.981292 (+ 28us) server_negotiation.cc:407] Connection header received
0806 01:03:30.981788 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:30.981795 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:30.981924 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:30.982076 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:30.982331 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:30.983561 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:30.984394 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:30.984838 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:30.984982 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:30.985747 (+ 765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:30.985751 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:30.985751 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:03:30.985996 (+ 245us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:30.986033 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:03:30.986061 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:30.986130 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:30.986217 (+ 87us) server_negotiation.cc:299] Negotiation successful
0806 01:03:30.986307 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":100,"threads_started":1}
I20260806 01:03:30.987655 11617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 01:03:31.058766 17100 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70165ce2488b457bb113ad3b624e3fb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70165ce2488b457bb113ad3b624e3fb9" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 37811 } }
I20260806 01:03:31.059047 17100 leader_election.cc:302] T 00000000000000000000000000000000 P 70165ce2488b457bb113ad3b624e3fb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70165ce2488b457bb113ad3b624e3fb9; no voters:
I20260806 01:03:31.059345 17100 leader_election.cc:288] T 00000000000000000000000000000000 P 70165ce2488b457bb113ad3b624e3fb9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:03:31.059469 17105 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70165ce2488b457bb113ad3b624e3fb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:31.059672 17105 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70165ce2488b457bb113ad3b624e3fb9 [term 1 LEADER]: Becoming Leader. State: Replica: 70165ce2488b457bb113ad3b624e3fb9, State: Running, Role: LEADER
I20260806 01:03:31.059790 17105 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70165ce2488b457bb113ad3b624e3fb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70165ce2488b457bb113ad3b624e3fb9" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 37811 } }
I20260806 01:03:31.059870 17100 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70165ce2488b457bb113ad3b624e3fb9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:03:31.060329 17105 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70165ce2488b457bb113ad3b624e3fb9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70165ce2488b457bb113ad3b624e3fb9. Latest consensus state: current_term: 1 leader_uuid: "70165ce2488b457bb113ad3b624e3fb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70165ce2488b457bb113ad3b624e3fb9" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 37811 } } }
I20260806 01:03:31.060434 17105 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70165ce2488b457bb113ad3b624e3fb9 [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:31.060765 17110 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:03:31.061172 17106 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70165ce2488b457bb113ad3b624e3fb9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "70165ce2488b457bb113ad3b624e3fb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70165ce2488b457bb113ad3b624e3fb9" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 37811 } } }
I20260806 01:03:31.061474 17106 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70165ce2488b457bb113ad3b624e3fb9 [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:31.061363 17110 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:03:31.064883 17110 catalog_manager.cc:1347] Generated new cluster ID: 881285ed4aa8499fb0e57c4cf7f835b2
I20260806 01:03:31.064998 17110 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:03:31.099630 17110 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:03:31.101377 17110 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:03:31.112855 17110 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 70165ce2488b457bb113ad3b624e3fb9: Generated new TSK 0
I20260806 01:03:31.113266 17110 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:03:31.134621 17104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:31.129960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57560 (local address 127.11.88.126:37811)
0806 01:03:31.130016 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:31.130019 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:31.130083 (+ 64us) server_negotiation.cc:407] Connection header received
0806 01:03:31.130187 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:31.130188 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:31.130202 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:31.130273 (+ 71us) server_negotiation.cc:226] Negotiated authn=JWT
0806 01:03:31.130467 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:31.131269 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:31.132355 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:31.132670 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:31.132747 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:31.133084 (+ 337us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 01:03:31.134365 (+ 1281us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45629/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 01:03:31.134535 (+ 170us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57560: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45629/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":27}
W20260806 01:03:31.134701 17104 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57560: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45629/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260806 01:03:31.135154 17129 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:31.129788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:37811 (local address 127.0.0.1:57560)
0806 01:03:31.130021 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:31.130033 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:31.130102 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:31.130303 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:31.130304 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:31.130306 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0806 01:03:31.130378 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:31.130387 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:31.131565 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:31.131566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:31.132249 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:31.132251 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:31.132886 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:31.132888 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:31.132946 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:31.132952 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 01:03:31.134529 (+ 1577us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45629/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 01:03:31.134666 (+ 137us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.88.126:37811: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45629/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":118,"threads_started":1}
I20260806 01:03:31.135437 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 17032
E20260806 01:03:31.149447 17130 webserver.cc:533] Webserver: sslize failed:
E20260806 01:03:31.149551 17130 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-06T01:03:31Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (366 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-06T01:03:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:03:31Z Disabled control of system clock
I20260806 01:03:31.190263 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:34285
--webserver_interface=127.11.88.126
--webserver_port=0
--builtin_ntp_servers=127.11.88.84:42327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:34285
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785978186227899-11617-0/testchainca.cert with env {}
W20260806 01:03:31.298861 17134 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:31.299386 17134 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:31.299677 17134 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:31.301924 17134 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:03:31.302030 17134 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:31.302054 17134 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:31.302078 17134 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:03:31.302109 17134 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 01:03:31.302138 17134 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 01:03:31.302173 17134 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260806 01:03:31.304224 17134 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:42327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:34285
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:34285
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785978186227899-11617-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17134
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:31.304584 17134 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:31.304840 17134 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:31.311352 17140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:31.311313 17139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:31.311318 17142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:31.312065 17134 server_base.cc:1034] running on GCE node
I20260806 01:03:31.312378 17134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:31.312781 17134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:31.313916 17134 hybrid_clock.cc:648] HybridClock initialized: now 1785978211313882 us; error 42 us; skew 500 ppm
I20260806 01:03:31.315434 17134 webserver.cc:460] Webserver started at http://127.11.88.126:35115/ using document root <none> and password file <none>
I20260806 01:03:31.315719 17134 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:31.315804 17134 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:31.315959 17134 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:31.317102 17134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "a6f7e3dbabf54ff7a090e87eb7c36c77"
format_stamp: "Formatted at 2026-08-06 01:03:31 on dist-test-slave-69rg"
server_key: "f4fa0fd9195a15e1b436e12c231e0655"
server_key_iv: "b02c781d02f1678a4d420d6bb847de4f"
server_key_version: "encryptionkey@0"
I20260806 01:03:31.317487 17134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "a6f7e3dbabf54ff7a090e87eb7c36c77"
format_stamp: "Formatted at 2026-08-06 01:03:31 on dist-test-slave-69rg"
server_key: "f4fa0fd9195a15e1b436e12c231e0655"
server_key_iv: "b02c781d02f1678a4d420d6bb847de4f"
server_key_version: "encryptionkey@0"
I20260806 01:03:31.319080 17134 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:03:31.319929 17148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:31.320132 17134 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:31.320288 17134 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "a6f7e3dbabf54ff7a090e87eb7c36c77"
format_stamp: "Formatted at 2026-08-06 01:03:31 on dist-test-slave-69rg"
server_key: "f4fa0fd9195a15e1b436e12c231e0655"
server_key_iv: "b02c781d02f1678a4d420d6bb847de4f"
server_key_version: "encryptionkey@0"
I20260806 01:03:31.320369 17134 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:31.337632 17134 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:31.338277 17134 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:31.339349 17134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:31.344973 17134 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:34285
I20260806 01:03:31.345077 17201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:34285 every 8 connection(s)
I20260806 01:03:31.345436 17134 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:03:31.346640 17202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:31.348524 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 17134
I20260806 01:03:31.348655 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:03:31.348862 11617 external_mini_cluster.cc:1428] Setting key ded025f333703fcb9e1ccb0609342c7f
I20260806 01:03:31.349727 17202 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6f7e3dbabf54ff7a090e87eb7c36c77: Bootstrap starting.
I20260806 01:03:31.350561 17202 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a6f7e3dbabf54ff7a090e87eb7c36c77: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:31.350937 17202 log.cc:824] T 00000000000000000000000000000000 P a6f7e3dbabf54ff7a090e87eb7c36c77: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:31.353047 17202 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6f7e3dbabf54ff7a090e87eb7c36c77: No bootstrap required, opened a new log
I20260806 01:03:31.355841 17205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:31.349516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35620 (local address 127.11.88.126:34285)
0806 01:03:31.349747 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:31.349758 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:31.349817 (+ 59us) server_negotiation.cc:407] Connection header received
0806 01:03:31.350372 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:31.350382 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:31.350475 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:31.350632 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:31.350934 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:31.352090 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:31.353248 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:31.353904 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:31.354038 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:31.354971 (+ 933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:31.354977 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:31.354977 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:03:31.355211 (+ 234us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:31.355260 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:03:31.355280 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:31.355366 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:31.355452 (+ 86us) server_negotiation.cc:299] Negotiation successful
0806 01:03:31.355563 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":103,"threads_started":1}
I20260806 01:03:31.356011 17202 raft_consensus.cc:348] T 00000000000000000000000000000000 P a6f7e3dbabf54ff7a090e87eb7c36c77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6f7e3dbabf54ff7a090e87eb7c36c77" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 34285 } }
I20260806 01:03:31.356217 17202 raft_consensus.cc:374] T 00000000000000000000000000000000 P a6f7e3dbabf54ff7a090e87eb7c36c77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:31.356252 17202 raft_consensus.cc:729] T 00000000000000000000000000000000 P a6f7e3dbabf54ff7a090e87eb7c36c77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6f7e3dbabf54ff7a090e87eb7c36c77, State: Initialized, Role: FOLLOWER
I20260806 01:03:31.356400 17202 consensus_queue.cc:260] T 00000000000000000000000000000000 P a6f7e3dbabf54ff7a090e87eb7c36c77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6f7e3dbabf54ff7a090e87eb7c36c77" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 34285 } }
I20260806 01:03:31.356483 17202 raft_consensus.cc:388] T 00000000000000000000000000000000 P a6f7e3dbabf54ff7a090e87eb7c36c77 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:03:31.356516 17202 raft_consensus.cc:482] T 00000000000000000000000000000000 P a6f7e3dbabf54ff7a090e87eb7c36c77 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:03:31.356567 17202 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a6f7e3dbabf54ff7a090e87eb7c36c77 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:31.357208 11617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 01:03:31.360788 17202 raft_consensus.cc:504] T 00000000000000000000000000000000 P a6f7e3dbabf54ff7a090e87eb7c36c77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6f7e3dbabf54ff7a090e87eb7c36c77" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 34285 } }
I20260806 01:03:31.360929 17202 leader_election.cc:302] T 00000000000000000000000000000000 P a6f7e3dbabf54ff7a090e87eb7c36c77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a6f7e3dbabf54ff7a090e87eb7c36c77; no voters:
I20260806 01:03:31.361179 17202 leader_election.cc:288] T 00000000000000000000000000000000 P a6f7e3dbabf54ff7a090e87eb7c36c77 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:03:31.361243 17207 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a6f7e3dbabf54ff7a090e87eb7c36c77 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:31.361405 17207 raft_consensus.cc:686] T 00000000000000000000000000000000 P a6f7e3dbabf54ff7a090e87eb7c36c77 [term 1 LEADER]: Becoming Leader. State: Replica: a6f7e3dbabf54ff7a090e87eb7c36c77, State: Running, Role: LEADER
I20260806 01:03:31.361495 17202 sys_catalog.cc:564] T 00000000000000000000000000000000 P a6f7e3dbabf54ff7a090e87eb7c36c77 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:03:31.361507 17207 consensus_queue.cc:237] T 00000000000000000000000000000000 P a6f7e3dbabf54ff7a090e87eb7c36c77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6f7e3dbabf54ff7a090e87eb7c36c77" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 34285 } }
I20260806 01:03:31.362167 17209 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6f7e3dbabf54ff7a090e87eb7c36c77 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a6f7e3dbabf54ff7a090e87eb7c36c77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6f7e3dbabf54ff7a090e87eb7c36c77" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 34285 } } }
I20260806 01:03:31.362274 17209 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6f7e3dbabf54ff7a090e87eb7c36c77 [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:31.362149 17208 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6f7e3dbabf54ff7a090e87eb7c36c77 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a6f7e3dbabf54ff7a090e87eb7c36c77. Latest consensus state: current_term: 1 leader_uuid: "a6f7e3dbabf54ff7a090e87eb7c36c77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6f7e3dbabf54ff7a090e87eb7c36c77" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 34285 } } }
I20260806 01:03:31.362475 17208 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6f7e3dbabf54ff7a090e87eb7c36c77 [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:31.362695 17216 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:03:31.363214 17216 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:03:31.367113 17216 catalog_manager.cc:1347] Generated new cluster ID: c7408aef8294465185693902d1737433
I20260806 01:03:31.367193 17216 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:03:31.376844 17216 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:03:31.377568 17216 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:03:31.385476 17216 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a6f7e3dbabf54ff7a090e87eb7c36c77: Generated new TSK 0
I20260806 01:03:31.385703 17216 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:03:31.475062 17205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:31.392271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35626 (local address 127.11.88.126:34285)
0806 01:03:31.392344 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:31.392347 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:31.392510 (+ 163us) server_negotiation.cc:407] Connection header received
0806 01:03:31.392587 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:31.392588 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:31.392598 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:31.392659 (+ 61us) server_negotiation.cc:226] Negotiated authn=JWT
0806 01:03:31.392805 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:31.393304 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:31.394476 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:31.394669 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:31.394718 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:31.394914 (+ 196us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 01:03:31.474852 (+ 79938us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 01:03:31.475004 (+ 152us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35626: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":46}
W20260806 01:03:31.475152 17205 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35626: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260806 01:03:31.475378 17231 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:31.392205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:34285 (local address 127.0.0.1:35626)
0806 01:03:31.392433 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:31.392444 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:31.392513 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:31.392678 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:31.392678 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:31.392680 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0806 01:03:31.392740 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:31.392743 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:31.393386 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:31.393387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:31.394384 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:31.394387 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:31.394748 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:31.394749 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:31.394810 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:31.394815 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 01:03:31.475014 (+ 80199us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 01:03:31.475169 (+ 155us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.88.126:34285: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":154,"threads_started":1}
I20260806 01:03:31.475759 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 17134
2026-08-06T01:03:31Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (317 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (102 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (94 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:03:32 dist-test-slave-69rg krb5kdc[17243](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:03:32 dist-test-slave-69rg krb5kdc[17243](info): set up 2 sockets
Aug 06 01:03:32 dist-test-slave-69rg krb5kdc[17243](info): commencing operation
krb5kdc: starting...
W20260806 01:03:33.772473 11617 mini_kdc.cc:121] Time spent starting KDC: real 2.080s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:03:33 dist-test-slave-69rg krb5kdc[17243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978213, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:03:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:03:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:03:33.905607 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:38615
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:42749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:38615
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:33.988157 17257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:33.988406 17257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:33.988446 17257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:33.989595 17257 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:03:33.989670 17257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:33.989696 17257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:33.989737 17257 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:03:33.989763 17257 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:03:33.991675 17257 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:42749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:38615
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:38615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17257
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:33.991999 17257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:33.992272 17257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:33.997412 17263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:33.997458 17257 server_base.cc:1034] running on GCE node
W20260806 01:03:33.997429 17265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:33.997426 17262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:33.998062 17257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:33.998344 17257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:33.999498 17257 hybrid_clock.cc:648] HybridClock initialized: now 1785978213999484 us; error 31 us; skew 500 ppm
Aug 06 01:03:34 dist-test-slave-69rg krb5kdc[17243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978214, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:34.006634 17257 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:03:34.007159 17257 webserver.cc:460] Webserver started at http://127.11.88.126:38963/ using document root <none> and password file <none>
I20260806 01:03:34.007414 17257 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:34.007467 17257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:34.007578 17257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:34.008808 17257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "4a2695e1d08b41ea8e1033c200c06e9a"
format_stamp: "Formatted at 2026-08-06 01:03:34 on dist-test-slave-69rg"
server_key: "992b410910ca0e23c793f60be231804d"
server_key_iv: "1014e079a80a8d39c4e94594edbd5a1f"
server_key_version: "encryptionkey@0"
I20260806 01:03:34.009168 17257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "4a2695e1d08b41ea8e1033c200c06e9a"
format_stamp: "Formatted at 2026-08-06 01:03:34 on dist-test-slave-69rg"
server_key: "992b410910ca0e23c793f60be231804d"
server_key_iv: "1014e079a80a8d39c4e94594edbd5a1f"
server_key_version: "encryptionkey@0"
I20260806 01:03:34.010937 17257 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260806 01:03:34.011827 17272 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:34.012072 17257 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:03:34.012184 17257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "4a2695e1d08b41ea8e1033c200c06e9a"
format_stamp: "Formatted at 2026-08-06 01:03:34 on dist-test-slave-69rg"
server_key: "992b410910ca0e23c793f60be231804d"
server_key_iv: "1014e079a80a8d39c4e94594edbd5a1f"
server_key_version: "encryptionkey@0"
I20260806 01:03:34.012259 17257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:34.025894 17257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:34.028184 17257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:34.028309 17257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:34.032649 17257 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:38615
I20260806 01:03:34.032756 17325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:38615 every 8 connection(s)
I20260806 01:03:34.033114 17257 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:03:34.034050 17326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:34.036429 17326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a2695e1d08b41ea8e1033c200c06e9a: Bootstrap starting.
I20260806 01:03:34.037034 17326 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a2695e1d08b41ea8e1033c200c06e9a: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:34.037369 17326 log.cc:824] T 00000000000000000000000000000000 P 4a2695e1d08b41ea8e1033c200c06e9a: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:34.038220 17326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a2695e1d08b41ea8e1033c200c06e9a: No bootstrap required, opened a new log
I20260806 01:03:34.039877 17326 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4a2695e1d08b41ea8e1033c200c06e9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a2695e1d08b41ea8e1033c200c06e9a" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 38615 } }
I20260806 01:03:34.040047 17326 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4a2695e1d08b41ea8e1033c200c06e9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:34.040100 17326 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4a2695e1d08b41ea8e1033c200c06e9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a2695e1d08b41ea8e1033c200c06e9a, State: Initialized, Role: FOLLOWER
I20260806 01:03:34.040300 17326 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a2695e1d08b41ea8e1033c200c06e9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a2695e1d08b41ea8e1033c200c06e9a" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 38615 } }
I20260806 01:03:34.040406 17326 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4a2695e1d08b41ea8e1033c200c06e9a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:03:34.040457 17326 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4a2695e1d08b41ea8e1033c200c06e9a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:03:34.040510 17326 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4a2695e1d08b41ea8e1033c200c06e9a [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:34.041116 17326 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4a2695e1d08b41ea8e1033c200c06e9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a2695e1d08b41ea8e1033c200c06e9a" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 38615 } }
I20260806 01:03:34.041245 17326 leader_election.cc:302] T 00000000000000000000000000000000 P 4a2695e1d08b41ea8e1033c200c06e9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4a2695e1d08b41ea8e1033c200c06e9a; no voters:
I20260806 01:03:34.041471 17326 leader_election.cc:288] T 00000000000000000000000000000000 P 4a2695e1d08b41ea8e1033c200c06e9a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:03:34.041483 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 17257
I20260806 01:03:34.041529 17329 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4a2695e1d08b41ea8e1033c200c06e9a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:34.041589 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:03:34.041764 17326 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4a2695e1d08b41ea8e1033c200c06e9a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:03:34.041847 11617 external_mini_cluster.cc:1428] Setting key b3016b233ae02409edb9dc21c81baa67
I20260806 01:03:34.042105 17329 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4a2695e1d08b41ea8e1033c200c06e9a [term 1 LEADER]: Becoming Leader. State: Replica: 4a2695e1d08b41ea8e1033c200c06e9a, State: Running, Role: LEADER
I20260806 01:03:34.042289 17329 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4a2695e1d08b41ea8e1033c200c06e9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a2695e1d08b41ea8e1033c200c06e9a" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 38615 } }
I20260806 01:03:34.042897 17330 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a2695e1d08b41ea8e1033c200c06e9a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4a2695e1d08b41ea8e1033c200c06e9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a2695e1d08b41ea8e1033c200c06e9a" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 38615 } } }
I20260806 01:03:34.042980 17330 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a2695e1d08b41ea8e1033c200c06e9a [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:34.043332 17343 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:03:34.043479 17331 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a2695e1d08b41ea8e1033c200c06e9a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a2695e1d08b41ea8e1033c200c06e9a. Latest consensus state: current_term: 1 leader_uuid: "4a2695e1d08b41ea8e1033c200c06e9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a2695e1d08b41ea8e1033c200c06e9a" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 38615 } } }
I20260806 01:03:34.043707 17331 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a2695e1d08b41ea8e1033c200c06e9a [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:34.044081 17343 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:03:34.045881 17343 catalog_manager.cc:1347] Generated new cluster ID: be14feda3e3d43e7ba55a6210bf5620b
I20260806 01:03:34.045948 17343 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 01:03:34 dist-test-slave-69rg krb5kdc[17243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978213, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:34.053762 17336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:34.042364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56254 (local address 127.11.88.126:38615)
0806 01:03:34.042692 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:34.042702 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:34.042739 (+ 37us) server_negotiation.cc:407] Connection header received
0806 01:03:34.042894 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:34.042902 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:34.042961 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:34.043785 (+ 824us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:34.044042 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:34.045329 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:34.046376 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:34.046817 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:34.046952 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:34.049547 (+ 2595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:34.049554 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:34.049555 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:34.049577 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:34.052064 (+ 2487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:34.052495 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:34.052501 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:34.052501 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:34.052602 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:34.052831 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:34.052832 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:34.052832 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:34.053098 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:34.053298 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:34.053372 (+ 74us) server_negotiation.cc:299] Negotiation successful
0806 01:03:34.053529 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":91,"threads_started":1}
I20260806 01:03:34.090404 17343 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:03:34.090981 17343 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:03:34.099610 17343 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4a2695e1d08b41ea8e1033c200c06e9a: Generated new TSK 0
I20260806 01:03:34.099871 17343 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.88.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
I20260806 01:03:34.142374 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:0
--local_ip_for_outbound_sockets=127.11.88.65
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:38615
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:42749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:34.241019 17353 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:34.241300 17353 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:34.241326 17353 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:34.242748 17353 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:34.242797 17353 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:34.242825 17353 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:03:34.244433 17353 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:42749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:38615
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17353
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:34.244689 17353 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:34.244947 17353 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:34.250283 17361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:34.250283 17359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:34.250664 17358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:34.250983 17353 server_base.cc:1034] running on GCE node
I20260806 01:03:34.251292 17353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:34.251600 17353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:34.252810 17353 hybrid_clock.cc:648] HybridClock initialized: now 1785978214252785 us; error 41 us; skew 500 ppm
Aug 06 01:03:34 dist-test-slave-69rg krb5kdc[17243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978214, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:34.256455 17353 init.cc:377] Logged in from keytab as kudu/127.11.88.65@KRBTEST.COM (short username kudu)
I20260806 01:03:34.257074 17353 webserver.cc:460] Webserver started at http://127.11.88.65:39527/ using document root <none> and password file <none>
I20260806 01:03:34.257359 17353 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:34.257419 17353 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:34.257555 17353 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:34.259050 17353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-0/data/instance:
uuid: "455615c8d5c046ee9cd93a03ef09deed"
format_stamp: "Formatted at 2026-08-06 01:03:34 on dist-test-slave-69rg"
server_key: "dd26ae231c14fd2024779f16ddaf944d"
server_key_iv: "28ea8c56e5c3330bdd7506a42e09845b"
server_key_version: "encryptionkey@0"
I20260806 01:03:34.259493 17353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance:
uuid: "455615c8d5c046ee9cd93a03ef09deed"
format_stamp: "Formatted at 2026-08-06 01:03:34 on dist-test-slave-69rg"
server_key: "dd26ae231c14fd2024779f16ddaf944d"
server_key_iv: "28ea8c56e5c3330bdd7506a42e09845b"
server_key_version: "encryptionkey@0"
I20260806 01:03:34.261329 17353 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 01:03:34.262283 17368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:34.262481 17353 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 01:03:34.262595 17353 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "455615c8d5c046ee9cd93a03ef09deed"
format_stamp: "Formatted at 2026-08-06 01:03:34 on dist-test-slave-69rg"
server_key: "dd26ae231c14fd2024779f16ddaf944d"
server_key_iv: "28ea8c56e5c3330bdd7506a42e09845b"
server_key_version: "encryptionkey@0"
I20260806 01:03:34.262689 17353 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:34.284456 17353 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:34.287258 17353 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:34.287453 17353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:34.287726 17353 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:34.288077 17353 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:34.288136 17353 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:34.288187 17353 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:34.288224 17353 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:34.295255 17353 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:33167
I20260806 01:03:34.295301 17483 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:33167 every 8 connection(s)
I20260806 01:03:34.295658 17353 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
I20260806 01:03:34.299460 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 17353
I20260806 01:03:34.299594 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance
I20260806 01:03:34.299809 11617 external_mini_cluster.cc:1428] Setting key f70c8409363ed70a0e5db53cf785be67
Aug 06 01:03:34 dist-test-slave-69rg krb5kdc[17243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978214, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:34.306914 17336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:34.296500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:40729 (local address 127.11.88.126:38615)
0806 01:03:34.296623 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:34.296630 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:34.296829 (+ 199us) server_negotiation.cc:407] Connection header received
0806 01:03:34.297850 (+ 1021us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:34.297851 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:34.297868 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:34.297925 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:34.298615 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:34.299127 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:34.300271 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:34.300487 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:34.300565 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:34.303283 (+ 2718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:34.303285 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:34.303286 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:34.303297 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:34.305154 (+ 1857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:34.305671 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:34.305672 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:34.305673 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:34.305743 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:34.306068 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:34.306070 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:34.306070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:34.306295 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:34.306381 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:34.306660 (+ 279us) server_negotiation.cc:299] Negotiation successful
0806 01:03:34.306771 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 01:03:34.306944 17486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:34.296394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:38615 (local address 127.11.88.65:40729)
0806 01:03:34.296663 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:34.296719 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:34.297690 (+ 971us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:34.298014 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:34.298017 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:34.298320 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:34.298513 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:34.298516 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:34.299226 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:34.299227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:34.300181 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:34.300184 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:34.300572 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:34.300573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:34.300696 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:34.301328 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:34.301337 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:34.303171 (+ 1834us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:34.305295 (+ 2124us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:34.305305 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:34.305308 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:34.305582 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:34.305862 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:34.305863 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:34.305864 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:34.305990 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:34.306375 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:34.306381 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:34.306513 (+ 132us) client_negotiation.cc:769] Sending connection context
0806 01:03:34.306609 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 01:03:34.306760 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":97,"threads_started":1}
I20260806 01:03:34.307560 17484 heartbeater.cc:347] Connected to a master server at 127.11.88.126:38615
I20260806 01:03:34.307682 17484 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:34.307904 17484 heartbeater.cc:511] Master 127.11.88.126:38615 requested a full tablet report, sending...
I20260806 01:03:34.308528 17290 ts_manager.cc:194] Registered new tserver with Master: 455615c8d5c046ee9cd93a03ef09deed (127.11.88.65:33167)
I20260806 01:03:34.309317 17290 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.65@KRBTEST.COM'} at 127.11.88.65:40729
WARNING: no policy specified for kudu/127.11.88.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
I20260806 01:03:34.331156 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:0
--local_ip_for_outbound_sockets=127.11.88.66
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:38615
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:42749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:34.413347 17489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:34.413579 17489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:34.413618 17489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:34.414958 17489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:34.415006 17489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:34.415036 17489 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:03:34.416791 17489 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:42749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:38615
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:34.417060 17489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:34.417326 17489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 01:03:34.422663 17489 server_base.cc:1034] running on GCE node
W20260806 01:03:34.422616 17497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:34.422622 17495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:34.422659 17494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:34.423134 17489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:34.423390 17489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:34.424538 17489 hybrid_clock.cc:648] HybridClock initialized: now 1785978214424529 us; error 32 us; skew 500 ppm
Aug 06 01:03:34 dist-test-slave-69rg krb5kdc[17243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978214, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:34.427243 17489 init.cc:377] Logged in from keytab as kudu/127.11.88.66@KRBTEST.COM (short username kudu)
I20260806 01:03:34.427739 17489 webserver.cc:460] Webserver started at http://127.11.88.66:38469/ using document root <none> and password file <none>
I20260806 01:03:34.427975 17489 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:34.428020 17489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:34.428174 17489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:34.429241 17489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-1/data/instance:
uuid: "4b980a08800d48f08873703d6393d985"
format_stamp: "Formatted at 2026-08-06 01:03:34 on dist-test-slave-69rg"
server_key: "8f66b85604b62c241a951f0d34c5ee87"
server_key_iv: "09ee49a02828aa8c5ce8c2a71688c147"
server_key_version: "encryptionkey@0"
I20260806 01:03:34.429600 17489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance:
uuid: "4b980a08800d48f08873703d6393d985"
format_stamp: "Formatted at 2026-08-06 01:03:34 on dist-test-slave-69rg"
server_key: "8f66b85604b62c241a951f0d34c5ee87"
server_key_iv: "09ee49a02828aa8c5ce8c2a71688c147"
server_key_version: "encryptionkey@0"
I20260806 01:03:34.430969 17489 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:03:34.431838 17505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:34.432058 17489 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:34.432155 17489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "4b980a08800d48f08873703d6393d985"
format_stamp: "Formatted at 2026-08-06 01:03:34 on dist-test-slave-69rg"
server_key: "8f66b85604b62c241a951f0d34c5ee87"
server_key_iv: "09ee49a02828aa8c5ce8c2a71688c147"
server_key_version: "encryptionkey@0"
I20260806 01:03:34.432210 17489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:34.455281 17489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:34.458148 17489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:34.458287 17489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:34.458514 17489 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:34.458968 17489 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:34.459017 17489 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:34.459043 17489 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:34.459055 17489 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:34.465487 17489 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:35351
I20260806 01:03:34.465581 17620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:35351 every 8 connection(s)
I20260806 01:03:34.465972 17489 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
I20260806 01:03:34.466964 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 17489
I20260806 01:03:34.467120 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance
I20260806 01:03:34.467332 11617 external_mini_cluster.cc:1428] Setting key a54c927c2e9c060e30bf35271eefc4ad
Aug 06 01:03:34 dist-test-slave-69rg krb5kdc[17243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978214, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.88.67@KRBTEST.COM; defaulting to no policy
I20260806 01:03:34.476565 17336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:34.466843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:45309 (local address 127.11.88.126:38615)
0806 01:03:34.466931 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:34.466934 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:34.467236 (+ 302us) server_negotiation.cc:407] Connection header received
0806 01:03:34.468454 (+ 1218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:34.468455 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:34.468468 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:34.468519 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:34.469166 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:34.469676 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:34.470739 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:34.470957 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:34.471047 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:34.473616 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:34.473617 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:34.473618 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:34.473633 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:34.475066 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:34.475503 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:34.475504 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:34.475504 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:34.475568 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:34.475922 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:34.475923 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:34.475923 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:34.476087 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:34.476174 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:34.476421 (+ 247us) server_negotiation.cc:299] Negotiation successful
0806 01:03:34.476497 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 01:03:34.476763 17623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:34.466833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:38615 (local address 127.11.88.66:45309)
0806 01:03:34.467106 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:34.467150 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:34.468347 (+ 1197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:34.468606 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:34.468609 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:34.468881 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:34.469067 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:34.469071 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:34.469781 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:34.469783 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:34.470641 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:34.470644 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:34.471060 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:34.471061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:34.471189 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:34.471815 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:34.471823 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:34.473506 (+ 1683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:34.475170 (+ 1664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:34.475178 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:34.475181 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:34.475422 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:34.475640 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:34.475641 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:34.475641 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:34.475766 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:34.476166 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:34.476171 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:34.476301 (+ 130us) client_negotiation.cc:769] Sending connection context
0806 01:03:34.476388 (+ 87us) client_negotiation.cc:240] Negotiation successful
0806 01:03:34.476515 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":131,"threads_started":1}
I20260806 01:03:34.477248 17621 heartbeater.cc:347] Connected to a master server at 127.11.88.126:38615
I20260806 01:03:34.477365 17621 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:34.477550 17621 heartbeater.cc:511] Master 127.11.88.126:38615 requested a full tablet report, sending...
I20260806 01:03:34.478087 17290 ts_manager.cc:194] Registered new tserver with Master: 4b980a08800d48f08873703d6393d985 (127.11.88.66:35351)
I20260806 01:03:34.478574 17290 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.66@KRBTEST.COM'} at 127.11.88.66:45309
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
I20260806 01:03:34.496786 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:0
--local_ip_for_outbound_sockets=127.11.88.67
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:38615
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:42749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:34.580467 17626 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:34.580685 17626 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:34.580711 17626 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:34.581985 17626 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:34.582029 17626 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:34.582078 17626 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:03:34.583639 17626 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:42749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:38615
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17626
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:34.583891 17626 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:34.584133 17626 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:34.589571 17632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:34.589582 17631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:34.589622 17626 server_base.cc:1034] running on GCE node
W20260806 01:03:34.589593 17634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:34.590044 17626 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:34.590310 17626 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:34.591451 17626 hybrid_clock.cc:648] HybridClock initialized: now 1785978214591439 us; error 29 us; skew 500 ppm
Aug 06 01:03:34 dist-test-slave-69rg krb5kdc[17243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978214, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:34.594082 17626 init.cc:377] Logged in from keytab as kudu/127.11.88.67@KRBTEST.COM (short username kudu)
I20260806 01:03:34.594532 17626 webserver.cc:460] Webserver started at http://127.11.88.67:35693/ using document root <none> and password file <none>
I20260806 01:03:34.594762 17626 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:34.594810 17626 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:34.594983 17626 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:34.596033 17626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-2/data/instance:
uuid: "f3223b4b660e48e085fed38ab3c0fc97"
format_stamp: "Formatted at 2026-08-06 01:03:34 on dist-test-slave-69rg"
server_key: "f4ae43b6b890a9c6e300bd7770dff4d6"
server_key_iv: "b64b7b9d06de09ceb9a2636be93c635d"
server_key_version: "encryptionkey@0"
I20260806 01:03:34.596333 17626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance:
uuid: "f3223b4b660e48e085fed38ab3c0fc97"
format_stamp: "Formatted at 2026-08-06 01:03:34 on dist-test-slave-69rg"
server_key: "f4ae43b6b890a9c6e300bd7770dff4d6"
server_key_iv: "b64b7b9d06de09ceb9a2636be93c635d"
server_key_version: "encryptionkey@0"
I20260806 01:03:34.597666 17626 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 01:03:34.598477 17641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:34.598667 17626 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 01:03:34.598783 17626 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "f3223b4b660e48e085fed38ab3c0fc97"
format_stamp: "Formatted at 2026-08-06 01:03:34 on dist-test-slave-69rg"
server_key: "f4ae43b6b890a9c6e300bd7770dff4d6"
server_key_iv: "b64b7b9d06de09ceb9a2636be93c635d"
server_key_version: "encryptionkey@0"
I20260806 01:03:34.598851 17626 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:34.629009 17626 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:34.631031 17626 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:34.631194 17626 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:34.631443 17626 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:34.631765 17626 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:34.631799 17626 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:34.631840 17626 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:34.631870 17626 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:34.638000 17626 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:40725
I20260806 01:03:34.638068 17756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:40725 every 8 connection(s)
I20260806 01:03:34.638398 17626 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
I20260806 01:03:34.642380 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 17626
I20260806 01:03:34.642464 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance
I20260806 01:03:34.642652 11617 external_mini_cluster.cc:1428] Setting key de84699c92ba83ecc92a975d5af5defc
Aug 06 01:03:34 dist-test-slave-69rg krb5kdc[17243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978214, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:34.648234 17336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:34.639156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:35757 (local address 127.11.88.126:38615)
0806 01:03:34.639242 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:34.639245 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:34.639421 (+ 176us) server_negotiation.cc:407] Connection header received
0806 01:03:34.640369 (+ 948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:34.640370 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:34.640382 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:34.640444 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:34.641072 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:34.641574 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:34.642785 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:34.643083 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:34.643146 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:34.645349 (+ 2203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:34.645351 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:34.645351 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:34.645359 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:34.646810 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:34.647235 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:34.647237 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:34.647237 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:34.647302 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:34.647563 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:34.647564 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:34.647565 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:34.647692 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:34.647767 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:34.648045 (+ 278us) server_negotiation.cc:299] Negotiation successful
0806 01:03:34.648130 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 01:03:34.648427 17759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:34.639105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:38615 (local address 127.11.88.67:35757)
0806 01:03:34.639299 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:34.639338 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:34.640248 (+ 910us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:34.640521 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:34.640524 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:34.640800 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:34.640987 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:34.640991 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:34.641654 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:34.641655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:34.642710 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:34.642715 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:34.643155 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:34.643156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:34.643315 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:34.643879 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:34.643887 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:34.645244 (+ 1357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:34.646915 (+ 1671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:34.646924 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:34.646926 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:34.647155 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:34.647378 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:34.647379 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:34.647379 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:34.647497 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:34.647768 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:34.647776 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:34.647915 (+ 139us) client_negotiation.cc:769] Sending connection context
0806 01:03:34.648021 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 01:03:34.648185 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":109,"threads_started":1}
I20260806 01:03:34.648941 17757 heartbeater.cc:347] Connected to a master server at 127.11.88.126:38615
I20260806 01:03:34.649044 17757 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:34.649192 17757 heartbeater.cc:511] Master 127.11.88.126:38615 requested a full tablet report, sending...
I20260806 01:03:34.649569 17290 ts_manager.cc:194] Registered new tserver with Master: f3223b4b660e48e085fed38ab3c0fc97 (127.11.88.67:40725)
I20260806 01:03:34.650017 17290 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.67@KRBTEST.COM'} at 127.11.88.67:35757
I20260806 01:03:34.654524 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/test-admin.keytab.
Aug 06 01:03:34 dist-test-slave-69rg krb5kdc[17243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978214, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:34.671247 11617 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260806 01:03:34.673007 17764 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:34.672157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48884 (local address 127.11.88.65:33167)
0806 01:03:34.672368 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:34.672373 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:34.672383 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:03:34.672411 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:34.672413 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:34.672427 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:34.672495 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:34.672908 (+ 413us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48884: BlockingRecv error: recv got EOF from 127.0.0.1:48884 (error 108)
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":118,"threads_started":1}
W20260806 01:03:34.673070 11617 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/krb5cc' of type FILE
Aug 06 01:03:34 dist-test-slave-69rg krb5kdc[17243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978214, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:34.674125 11617 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 01:03:34 dist-test-slave-69rg krb5kdc[17243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978214, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:34.674993 11617 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 01:03:34 dist-test-slave-69rg krb5kdc[17243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978214, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.65@KRBTEST.COM
I20260806 01:03:34.683765 17764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:34.675531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48886 (local address 127.11.88.65:33167)
0806 01:03:34.675585 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:34.675587 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:34.675631 (+ 44us) server_negotiation.cc:407] Connection header received
0806 01:03:34.675690 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:34.675691 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:34.675700 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:34.675747 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:34.676105 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:34.676845 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:34.677523 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:34.677899 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:34.677954 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:34.680135 (+ 2181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:34.680147 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:34.680148 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:34.680159 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:34.682319 (+ 2160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:34.682748 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:34.682751 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:34.682751 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:34.682847 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:34.683092 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:34.683093 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:34.683094 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:34.683275 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:34.683435 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:34.683540 (+ 105us) server_negotiation.cc:299] Negotiation successful
0806 01:03:34.683635 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
W20260806 01:03:34.685567 17764 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:34.685050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48890 (local address 127.11.88.65:33167)
0806 01:03:34.685084 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:34.685086 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:34.685148 (+ 62us) server_negotiation.cc:407] Connection header received
0806 01:03:34.685198 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:34.685199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:34.685208 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:34.685262 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:34.685496 (+ 234us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48890: BlockingRecv error: recv got EOF from 127.0.0.1:48890 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260806 01:03:34.685652 11617 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/krb5cc' of type FILE
Aug 06 01:03:34 dist-test-slave-69rg krb5kdc[17243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978214, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:34.686637 11617 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 01:03:34 dist-test-slave-69rg krb5kdc[17243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978214, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:34.687474 11617 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 01:03:34 dist-test-slave-69rg krb5kdc[17243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978214, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.65@KRBTEST.COM
I20260806 01:03:34.694674 17764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:34.687973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48904 (local address 127.11.88.65:33167)
0806 01:03:34.688037 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:34.688039 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:34.688110 (+ 71us) server_negotiation.cc:407] Connection header received
0806 01:03:34.688257 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:34.688258 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:34.688269 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:34.688319 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:34.688679 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:34.689158 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:34.689848 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:34.690065 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:34.690142 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:34.692084 (+ 1942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:34.692086 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:34.692086 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:34.692094 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:34.693495 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:34.693910 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:34.693911 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:34.693912 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:34.693971 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:34.694179 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:34.694180 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:34.694180 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:34.694284 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:34.694386 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:34.694481 (+ 95us) server_negotiation.cc:299] Negotiation successful
0806 01:03:34.694563 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260806 01:03:34.696579 17764 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:34.695859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48912 (local address 127.11.88.65:33167)
0806 01:03:34.695926 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:34.695928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:34.696036 (+ 108us) server_negotiation.cc:407] Connection header received
0806 01:03:34.696121 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:34.696122 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:34.696133 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:34.696207 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:34.696523 (+ 316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48912: BlockingRecv error: recv got EOF from 127.0.0.1:48912 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260806 01:03:34.696655 11617 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785978186227899-11617-0/krb5kdc/krb5cc' of type FILE
Aug 06 01:03:34 dist-test-slave-69rg krb5kdc[17243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978214, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:34.697605 11617 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 01:03:34 dist-test-slave-69rg krb5kdc[17243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978214, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:34.698516 11617 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 01:03:34 dist-test-slave-69rg krb5kdc[17243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978214, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.65@KRBTEST.COM
I20260806 01:03:34.706110 17764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:34.699014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48924 (local address 127.11.88.65:33167)
0806 01:03:34.699052 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:34.699053 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:34.699108 (+ 55us) server_negotiation.cc:407] Connection header received
0806 01:03:34.699146 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:34.699146 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:34.699153 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:34.699223 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:34.699601 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:34.700118 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:34.700798 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:34.700980 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:34.701087 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:34.703262 (+ 2175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:34.703263 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:34.703264 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:34.703270 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:34.704635 (+ 1365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:34.705014 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:34.705014 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:34.705015 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:34.705067 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:34.705373 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:34.705375 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:34.705375 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:34.705494 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:34.705589 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:34.705794 (+ 205us) server_negotiation.cc:299] Negotiation successful
0806 01:03:34.705965 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 01:03:34.707299 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 17353
I20260806 01:03:34.715107 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 17489
I20260806 01:03:34.720418 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 17626
I20260806 01:03:34.725323 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 17257
2026-08-06T01:03:34Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (3054 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:03:34 dist-test-slave-69rg krb5kdc[17777](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:03:34 dist-test-slave-69rg krb5kdc[17777](info): set up 2 sockets
Aug 06 01:03:34 dist-test-slave-69rg krb5kdc[17777](info): commencing operation
krb5kdc: starting...
W20260806 01:03:35.782716 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.036s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:03:35 dist-test-slave-69rg krb5kdc[17777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978215, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:03:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:03:35Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.126.keytab.
Entry for principal oryx/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.126.keytab.
I20260806 01:03:35.912528 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:45409
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.126.keytab
--principal=oryx/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:43277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:45409
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:35.994743 17790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:35.995034 17790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:35.995086 17790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:35.996353 17790 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:03:35.996438 17790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:35.996462 17790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:35.996483 17790 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:03:35.996515 17790 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:03:35.998205 17790 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:43277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:45409
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.126.keytab
--principal=oryx/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:45409
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17790
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:35.998569 17790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:35.998872 17790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:36.004395 17798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:36.004376 17795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:36.004351 17796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:36.004680 17790 server_base.cc:1034] running on GCE node
I20260806 01:03:36.004987 17790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:36.005314 17790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:36.006521 17790 hybrid_clock.cc:648] HybridClock initialized: now 1785978216006484 us; error 55 us; skew 500 ppm
Aug 06 01:03:36 dist-test-slave-69rg krb5kdc[17777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978216, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:36.009624 17790 init.cc:377] Logged in from keytab as oryx/127.11.88.126@KRBTEST.COM (short username oryx)
I20260806 01:03:36.010260 17790 webserver.cc:460] Webserver started at http://127.11.88.126:39207/ using document root <none> and password file <none>
I20260806 01:03:36.010527 17790 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:36.010603 17790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:36.010772 17790 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:36.011924 17790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "acc5d4a82f92474e873513845cc9550c"
format_stamp: "Formatted at 2026-08-06 01:03:36 on dist-test-slave-69rg"
server_key: "97d2b83e2bfed5efae732658f3091d0c"
server_key_iv: "8844d451b440a9c11e50bacea1aaf689"
server_key_version: "encryptionkey@0"
I20260806 01:03:36.012349 17790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "acc5d4a82f92474e873513845cc9550c"
format_stamp: "Formatted at 2026-08-06 01:03:36 on dist-test-slave-69rg"
server_key: "97d2b83e2bfed5efae732658f3091d0c"
server_key_iv: "8844d451b440a9c11e50bacea1aaf689"
server_key_version: "encryptionkey@0"
I20260806 01:03:36.014180 17790 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 01:03:36.015368 17805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:36.015662 17790 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:36.015802 17790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "acc5d4a82f92474e873513845cc9550c"
format_stamp: "Formatted at 2026-08-06 01:03:36 on dist-test-slave-69rg"
server_key: "97d2b83e2bfed5efae732658f3091d0c"
server_key_iv: "8844d451b440a9c11e50bacea1aaf689"
server_key_version: "encryptionkey@0"
I20260806 01:03:36.015897 17790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:36.027024 17790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:36.029208 17790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:36.029382 17790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:36.033723 17790 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:45409
I20260806 01:03:36.033757 17857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:45409 every 8 connection(s)
I20260806 01:03:36.034144 17790 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:03:36.035157 17858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:36.037420 17858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c: Bootstrap starting.
I20260806 01:03:36.037772 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 17790
I20260806 01:03:36.037930 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:03:36.038115 17858 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:36.038324 11617 external_mini_cluster.cc:1428] Setting key bdf8921401d4ffc584590c72d9233726
I20260806 01:03:36.038457 17858 log.cc:824] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:36.039597 17858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c: No bootstrap required, opened a new log
I20260806 01:03:36.042016 17858 raft_consensus.cc:348] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } }
I20260806 01:03:36.042253 17858 raft_consensus.cc:374] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:36.042294 17858 raft_consensus.cc:729] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acc5d4a82f92474e873513845cc9550c, State: Initialized, Role: FOLLOWER
I20260806 01:03:36.042415 17858 consensus_queue.cc:260] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } }
I20260806 01:03:36.042502 17858 raft_consensus.cc:388] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:03:36.042531 17858 raft_consensus.cc:482] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:03:36.042568 17858 raft_consensus.cc:3037] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:36.043232 17858 raft_consensus.cc:504] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } }
I20260806 01:03:36.043319 17858 leader_election.cc:302] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: acc5d4a82f92474e873513845cc9550c; no voters:
I20260806 01:03:36.043497 17858 leader_election.cc:288] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:03:36.043607 17863 raft_consensus.cc:2781] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:36.043783 17858 sys_catalog.cc:564] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:03:36.044239 17863 raft_consensus.cc:686] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [term 1 LEADER]: Becoming Leader. State: Replica: acc5d4a82f92474e873513845cc9550c, State: Running, Role: LEADER
I20260806 01:03:36.044426 17863 consensus_queue.cc:237] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } }
I20260806 01:03:36.045118 17864 sys_catalog.cc:455] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [sys.catalog]: SysCatalogTable state changed. Reason: New leader acc5d4a82f92474e873513845cc9550c. Latest consensus state: current_term: 1 leader_uuid: "acc5d4a82f92474e873513845cc9550c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } }
I20260806 01:03:36.045252 17865 sys_catalog.cc:455] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "acc5d4a82f92474e873513845cc9550c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } }
I20260806 01:03:36.045408 17865 sys_catalog.cc:458] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:36.045394 17864 sys_catalog.cc:458] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [sys.catalog]: This master's current role is: LEADER
W20260806 01:03:36.046090 17877 catalog_manager.cc:1558] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 01:03:36.046151 17877 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 06 01:03:36 dist-test-slave-69rg krb5kdc[17777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978215, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM
I20260806 01:03:36.046209 17879 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:03:36.046381 17879 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:03:36.048116 17879 catalog_manager.cc:1347] Generated new cluster ID: f9a0b39ee4ba48bca7246ff8cb183476
I20260806 01:03:36.048180 17879 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:03:36.050890 17862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:36.038901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50300 (local address 127.11.88.126:45409)
0806 01:03:36.039058 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:36.039069 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:36.039101 (+ 32us) server_negotiation.cc:407] Connection header received
0806 01:03:36.039918 (+ 817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:36.039925 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:36.039977 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:36.040095 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:36.040900 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.041769 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.042910 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.043451 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.043603 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:36.046814 (+ 3211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:36.046818 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:36.046819 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:36.046833 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:36.049109 (+ 2276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:36.049568 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:36.049572 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:36.049573 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:36.049695 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:36.049936 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:36.049937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:36.049938 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:36.050252 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:36.050416 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:36.050543 (+ 127us) server_negotiation.cc:299] Negotiation successful
0806 01:03:36.050680 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":85,"threads_started":1}
I20260806 01:03:36.073068 17879 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:03:36.073657 17879 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:03:36.080461 17879 catalog_manager.cc:5868] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c: Generated new TSK 0
I20260806 01:03:36.080715 17879 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.88.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.88.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.88.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.65.keytab.
Entry for principal oryx/127.11.88.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.65.keytab.
I20260806 01:03:36.115271 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:0
--local_ip_for_outbound_sockets=127.11.88.65
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:45409
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.65.keytab
--principal=oryx/127.11.88.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:43277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:36.210255 17884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:36.210537 17884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:36.210577 17884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:36.212039 17884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:36.212112 17884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:36.212152 17884 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:03:36.213935 17884 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:43277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.65.keytab
--principal=oryx/127.11.88.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:45409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17884
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:36.214232 17884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:36.214511 17884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:36.220156 17889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:36.220235 17884 server_base.cc:1034] running on GCE node
W20260806 01:03:36.220156 17892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:36.220229 17890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:36.220616 17884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:36.220896 17884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:36.222072 17884 hybrid_clock.cc:648] HybridClock initialized: now 1785978216222062 us; error 40 us; skew 500 ppm
Aug 06 01:03:36 dist-test-slave-69rg krb5kdc[17777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978216, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:36.224888 17884 init.cc:377] Logged in from keytab as oryx/127.11.88.65@KRBTEST.COM (short username oryx)
I20260806 01:03:36.225467 17884 webserver.cc:460] Webserver started at http://127.11.88.65:36019/ using document root <none> and password file <none>
I20260806 01:03:36.225747 17884 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:36.225845 17884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:36.226020 17884 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:36.227248 17884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/data/instance:
uuid: "6956eb0902894681952bcdca7d6571b8"
format_stamp: "Formatted at 2026-08-06 01:03:36 on dist-test-slave-69rg"
server_key: "c2b1b5e3b12da6e03f05040c2dab19c2"
server_key_iv: "be00e4d84f8b9a22f372bc5d435cee1f"
server_key_version: "encryptionkey@0"
I20260806 01:03:36.227665 17884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance:
uuid: "6956eb0902894681952bcdca7d6571b8"
format_stamp: "Formatted at 2026-08-06 01:03:36 on dist-test-slave-69rg"
server_key: "c2b1b5e3b12da6e03f05040c2dab19c2"
server_key_iv: "be00e4d84f8b9a22f372bc5d435cee1f"
server_key_version: "encryptionkey@0"
I20260806 01:03:36.229485 17884 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 01:03:36.230476 17900 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:36.230754 17884 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 01:03:36.230890 17884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "6956eb0902894681952bcdca7d6571b8"
format_stamp: "Formatted at 2026-08-06 01:03:36 on dist-test-slave-69rg"
server_key: "c2b1b5e3b12da6e03f05040c2dab19c2"
server_key_iv: "be00e4d84f8b9a22f372bc5d435cee1f"
server_key_version: "encryptionkey@0"
I20260806 01:03:36.230993 17884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:36.247761 17884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:36.250209 17884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:36.250404 17884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:36.250726 17884 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:36.251171 17884 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:36.251216 17884 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:36.251252 17884 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:36.251276 17884 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:36.259321 17884 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:43511
I20260806 01:03:36.259366 18015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:43511 every 8 connection(s)
I20260806 01:03:36.259748 17884 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
I20260806 01:03:36.261852 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 17884
I20260806 01:03:36.261972 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance
I20260806 01:03:36.262230 11617 external_mini_cluster.cc:1428] Setting key e89b9fc99b078cca152f2e26078133e8
Aug 06 01:03:36 dist-test-slave-69rg krb5kdc[17777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978216, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM
WARNING: no policy specified for oryx/127.11.88.66@KRBTEST.COM; defaulting to no policy
I20260806 01:03:36.272723 17862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:36.260630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:56863 (local address 127.11.88.126:45409)
0806 01:03:36.260706 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:36.260709 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:36.260888 (+ 179us) server_negotiation.cc:407] Connection header received
0806 01:03:36.261399 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:36.261400 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:36.261415 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:36.261503 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:36.262852 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.263573 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.265354 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.265574 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.265641 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:36.268835 (+ 3194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:36.268837 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:36.268837 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:36.268846 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:36.270850 (+ 2004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:36.271384 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:36.271386 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:36.271386 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:36.271456 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:36.271796 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:36.271797 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:36.271797 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:36.271957 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:36.272036 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:36.272492 (+ 456us) server_negotiation.cc:299] Negotiation successful
0806 01:03:36.272604 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 01:03:36.272840 18018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:36.260544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.11.88.65:56863)
0806 01:03:36.260751 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:36.260794 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:36.261298 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:36.261563 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:36.261566 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:36.262458 (+ 892us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:36.262742 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:36.262754 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.263708 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.263709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:36.265243 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:36.265247 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.265693 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.265694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:36.265875 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:36.266512 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:36.266523 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:36.268695 (+ 2172us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:36.270960 (+ 2265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:36.270970 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:36.270973 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:36.271289 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:36.271543 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:36.271544 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:36.271545 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:36.271702 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:36.272041 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:36.272048 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:36.272224 (+ 176us) client_negotiation.cc:769] Sending connection context
0806 01:03:36.272357 (+ 133us) client_negotiation.cc:240] Negotiation successful
0806 01:03:36.272556 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":101,"threads_started":1}
I20260806 01:03:36.273463 18016 heartbeater.cc:347] Connected to a master server at 127.11.88.126:45409
I20260806 01:03:36.273581 18016 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:36.273795 18016 heartbeater.cc:511] Master 127.11.88.126:45409 requested a full tablet report, sending...
I20260806 01:03:36.274530 17822 ts_manager.cc:194] Registered new tserver with Master: 6956eb0902894681952bcdca7d6571b8 (127.11.88.65:43511)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.88.66@KRBTEST.COM" created.
I20260806 01:03:36.275290 17822 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.88.65@KRBTEST.COM'} at 127.11.88.65:56863
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.88.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.66.keytab.
Entry for principal oryx/127.11.88.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.66.keytab.
I20260806 01:03:36.300823 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:0
--local_ip_for_outbound_sockets=127.11.88.66
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:45409
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.66.keytab
--principal=oryx/127.11.88.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:43277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:36.399022 18021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:36.399312 18021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:36.399355 18021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:36.400656 18021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:36.400735 18021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:36.400787 18021 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:03:36.402534 18021 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:43277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.66.keytab
--principal=oryx/127.11.88.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:45409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18021
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:36.402873 18021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:36.403134 18021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:36.408879 18027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:36.408926 18021 server_base.cc:1034] running on GCE node
W20260806 01:03:36.408846 18029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:36.408845 18026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:36.409379 18021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:36.409657 18021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:36.410876 18021 hybrid_clock.cc:648] HybridClock initialized: now 1785978216410846 us; error 39 us; skew 500 ppm
Aug 06 01:03:36 dist-test-slave-69rg krb5kdc[17777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978216, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:36.413538 18021 init.cc:377] Logged in from keytab as oryx/127.11.88.66@KRBTEST.COM (short username oryx)
I20260806 01:03:36.414077 18021 webserver.cc:460] Webserver started at http://127.11.88.66:45385/ using document root <none> and password file <none>
I20260806 01:03:36.414321 18021 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:36.414390 18021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:36.414542 18021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:36.415608 18021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/data/instance:
uuid: "0cc705ff89a7431ba40de3ebe04ff15a"
format_stamp: "Formatted at 2026-08-06 01:03:36 on dist-test-slave-69rg"
server_key: "0a9a8b8133076f0b63a6550b2e35aa38"
server_key_iv: "c1472faaafd93b3576c9eb43b5bec789"
server_key_version: "encryptionkey@0"
I20260806 01:03:36.415998 18021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance:
uuid: "0cc705ff89a7431ba40de3ebe04ff15a"
format_stamp: "Formatted at 2026-08-06 01:03:36 on dist-test-slave-69rg"
server_key: "0a9a8b8133076f0b63a6550b2e35aa38"
server_key_iv: "c1472faaafd93b3576c9eb43b5bec789"
server_key_version: "encryptionkey@0"
I20260806 01:03:36.417407 18021 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:03:36.418277 18036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:36.418495 18021 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 01:03:36.418592 18021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "0cc705ff89a7431ba40de3ebe04ff15a"
format_stamp: "Formatted at 2026-08-06 01:03:36 on dist-test-slave-69rg"
server_key: "0a9a8b8133076f0b63a6550b2e35aa38"
server_key_iv: "c1472faaafd93b3576c9eb43b5bec789"
server_key_version: "encryptionkey@0"
I20260806 01:03:36.418663 18021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:36.433409 18021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:36.436221 18021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:36.436411 18021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:36.436666 18021 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:36.437021 18021 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:36.437065 18021 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:36.437090 18021 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:36.437139 18021 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:36.443516 18021 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:41757
I20260806 01:03:36.443586 18151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:41757 every 8 connection(s)
I20260806 01:03:36.443971 18021 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
I20260806 01:03:36.447549 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 18021
I20260806 01:03:36.447669 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance
I20260806 01:03:36.447863 11617 external_mini_cluster.cc:1428] Setting key 20b0a1ab192d4521498c7f21041f8012
Aug 06 01:03:36 dist-test-slave-69rg krb5kdc[17777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978216, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM
I20260806 01:03:36.454754 17862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:36.444969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:57871 (local address 127.11.88.126:45409)
0806 01:03:36.445077 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:36.445079 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:36.445286 (+ 207us) server_negotiation.cc:407] Connection header received
0806 01:03:36.445899 (+ 613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:36.445901 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:36.445914 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:36.445971 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:36.446941 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.447570 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.448975 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.449264 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.449342 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:36.451722 (+ 2380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:36.451723 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:36.451723 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:36.451730 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:36.453205 (+ 1475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:36.453720 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:36.453721 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:36.453721 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:36.453772 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:36.454092 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:36.454093 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:36.454093 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:36.454201 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:36.454251 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:36.454613 (+ 362us) server_negotiation.cc:299] Negotiation successful
0806 01:03:36.454686 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 01:03:36.455036 18154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:36.444940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.11.88.66:57871)
0806 01:03:36.445111 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:36.445165 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:36.445745 (+ 580us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:36.446036 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:36.446041 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:36.446633 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:36.446830 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:36.446834 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.447727 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.447728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:36.448889 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:36.448892 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.449353 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.449354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:36.449454 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:36.450066 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:36.450076 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:36.451617 (+ 1541us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:36.453291 (+ 1674us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:36.453300 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:36.453302 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:36.453634 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:36.453858 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:36.453860 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:36.453860 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:36.454014 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:36.454268 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:36.454275 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:36.454459 (+ 184us) client_negotiation.cc:769] Sending connection context
0806 01:03:36.454582 (+ 123us) client_negotiation.cc:240] Negotiation successful
0806 01:03:36.454776 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":75,"threads_started":1}
I20260806 01:03:36.455578 18152 heartbeater.cc:347] Connected to a master server at 127.11.88.126:45409
I20260806 01:03:36.455693 18152 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:36.455888 18152 heartbeater.cc:511] Master 127.11.88.126:45409 requested a full tablet report, sending...
I20260806 01:03:36.456302 17822 ts_manager.cc:194] Registered new tserver with Master: 0cc705ff89a7431ba40de3ebe04ff15a (127.11.88.66:41757)
I20260806 01:03:36.456696 17822 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.88.66@KRBTEST.COM'} at 127.11.88.66:57871
WARNING: no policy specified for oryx/127.11.88.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.88.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.88.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.67.keytab.
Entry for principal oryx/127.11.88.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.67.keytab.
I20260806 01:03:36.477030 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:0
--local_ip_for_outbound_sockets=127.11.88.67
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:45409
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.67.keytab
--principal=oryx/127.11.88.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:43277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:36.560600 18157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:36.560863 18157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:36.560906 18157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:36.562196 18157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:36.562265 18157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:36.562317 18157 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:03:36.563879 18157 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:43277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.67.keytab
--principal=oryx/127.11.88.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:45409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:36.564170 18157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:36.564407 18157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:36.569682 18165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:36.569657 18162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:36.569657 18163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:36.569713 18157 server_base.cc:1034] running on GCE node
I20260806 01:03:36.570173 18157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:36.570472 18157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:36.571621 18157 hybrid_clock.cc:648] HybridClock initialized: now 1785978216571610 us; error 35 us; skew 500 ppm
Aug 06 01:03:36 dist-test-slave-69rg krb5kdc[17777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978216, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:36.574219 18157 init.cc:377] Logged in from keytab as oryx/127.11.88.67@KRBTEST.COM (short username oryx)
I20260806 01:03:36.574716 18157 webserver.cc:460] Webserver started at http://127.11.88.67:33443/ using document root <none> and password file <none>
I20260806 01:03:36.574949 18157 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:36.575014 18157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:36.575205 18157 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:36.576294 18157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/data/instance:
uuid: "54c1154a37dc44bdb3e437b8a43a9d9c"
format_stamp: "Formatted at 2026-08-06 01:03:36 on dist-test-slave-69rg"
server_key: "c67aead56695880953b32e1c1d90d681"
server_key_iv: "cb144d69676102deb5d8ccb6603a42ce"
server_key_version: "encryptionkey@0"
I20260806 01:03:36.576666 18157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance:
uuid: "54c1154a37dc44bdb3e437b8a43a9d9c"
format_stamp: "Formatted at 2026-08-06 01:03:36 on dist-test-slave-69rg"
server_key: "c67aead56695880953b32e1c1d90d681"
server_key_iv: "cb144d69676102deb5d8ccb6603a42ce"
server_key_version: "encryptionkey@0"
I20260806 01:03:36.578207 18157 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 01:03:36.579013 18173 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:36.579295 18157 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:36.579406 18157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "54c1154a37dc44bdb3e437b8a43a9d9c"
format_stamp: "Formatted at 2026-08-06 01:03:36 on dist-test-slave-69rg"
server_key: "c67aead56695880953b32e1c1d90d681"
server_key_iv: "cb144d69676102deb5d8ccb6603a42ce"
server_key_version: "encryptionkey@0"
I20260806 01:03:36.579483 18157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:36.602625 18157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:36.605069 18157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:36.605244 18157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:36.605513 18157 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:36.605863 18157 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:36.605919 18157 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:36.605962 18157 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:36.606019 18157 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:36.612628 18157 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:34291
I20260806 01:03:36.612673 18288 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:34291 every 8 connection(s)
I20260806 01:03:36.613034 18157 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
Aug 06 01:03:36 dist-test-slave-69rg krb5kdc[17777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978216, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM
I20260806 01:03:36.622736 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 18157
I20260806 01:03:36.622841 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance
I20260806 01:03:36.622869 17862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:36.613855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:52523 (local address 127.11.88.126:45409)
0806 01:03:36.613939 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:36.613941 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:36.614130 (+ 189us) server_negotiation.cc:407] Connection header received
0806 01:03:36.614765 (+ 635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:36.614766 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:36.614779 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:36.614846 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:36.615875 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.616389 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.617389 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.617587 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.617669 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:36.619910 (+ 2241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:36.619911 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:36.619912 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:36.619919 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:36.621285 (+ 1366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:36.621906 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:36.621907 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:36.621907 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:36.621966 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:36.622224 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:36.622225 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:36.622225 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:36.622339 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:36.622387 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:36.622661 (+ 274us) server_negotiation.cc:299] Negotiation successful
0806 01:03:36.622750 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260806 01:03:36.623054 11617 external_mini_cluster.cc:1428] Setting key ec50c0ff4cbfa2237999043637bafcab
I20260806 01:03:36.623088 18291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:36.613791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.11.88.67:52523)
0806 01:03:36.613996 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:36.614035 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:36.614610 (+ 575us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:36.614929 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:36.614932 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:36.615557 (+ 625us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:36.615766 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:36.615770 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.616491 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.616492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:36.617292 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:36.617294 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.617686 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.617688 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:36.617811 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:36.618353 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:36.618362 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:36.619825 (+ 1463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:36.621368 (+ 1543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:36.621375 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:36.621377 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:36.621799 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:36.622029 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:36.622029 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:36.622029 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:36.622137 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:36.622392 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:36.622396 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:36.622517 (+ 121us) client_negotiation.cc:769] Sending connection context
0806 01:03:36.622595 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 01:03:36.622811 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":102,"threads_started":1}
I20260806 01:03:36.623632 18289 heartbeater.cc:347] Connected to a master server at 127.11.88.126:45409
I20260806 01:03:36.623765 18289 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:36.623958 18289 heartbeater.cc:511] Master 127.11.88.126:45409 requested a full tablet report, sending...
I20260806 01:03:36.624392 17822 ts_manager.cc:194] Registered new tserver with Master: 54c1154a37dc44bdb3e437b8a43a9d9c (127.11.88.67:34291)
I20260806 01:03:36.624835 17822 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.88.67@KRBTEST.COM'} at 127.11.88.67:52523
I20260806 01:03:36.635594 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.88.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.88.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.88.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.125.keytab.
Entry for principal oryx/127.11.88.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.125.keytab.
I20260806 01:03:36.664937 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.125:38547
--webserver_interface=127.11.88.125
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.125.keytab
--principal=oryx/127.11.88.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:43277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:45409,127.11.88.125:38547
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:36.751528 18294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:36.751760 18294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:36.751786 18294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:36.753022 18294 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:03:36.753073 18294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:36.753088 18294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:36.753101 18294 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:03:36.753113 18294 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:03:36.754725 18294 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:43277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:45409,127.11.88.125:38547
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.125.keytab
--principal=oryx/127.11.88.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.125:38547
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.88.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18294
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
W20260806 01:03:36.754837 18294 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.11.88.126:45409,127.11.88.125:38547'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260806 01:03:36.755026 18294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:36.755273 18294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:36.760371 18302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:36.760375 18299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:36.760426 18300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:36.760663 18294 server_base.cc:1034] running on GCE node
I20260806 01:03:36.760931 18294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:36.761272 18294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:36.762425 18294 hybrid_clock.cc:648] HybridClock initialized: now 1785978216762402 us; error 40 us; skew 500 ppm
Aug 06 01:03:36 dist-test-slave-69rg krb5kdc[17777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978216, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:36.765404 18294 init.cc:377] Logged in from keytab as oryx/127.11.88.125@KRBTEST.COM (short username oryx)
I20260806 01:03:36.765864 18294 webserver.cc:460] Webserver started at http://127.11.88.125:37797/ using document root <none> and password file <none>
I20260806 01:03:36.766116 18294 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:36.766165 18294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:36.766305 18294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:36.767383 18294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-1/data/instance:
uuid: "92cdedeae7ad4a7ca6ce1891eecf885b"
format_stamp: "Formatted at 2026-08-06 01:03:36 on dist-test-slave-69rg"
server_key: "6778a58d5495fa1652c15d9fe9caa7f2"
server_key_iv: "2f1cac9e488fc5e9a423b457396b1334"
server_key_version: "encryptionkey@0"
I20260806 01:03:36.767746 18294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-1/wal/instance:
uuid: "92cdedeae7ad4a7ca6ce1891eecf885b"
format_stamp: "Formatted at 2026-08-06 01:03:36 on dist-test-slave-69rg"
server_key: "6778a58d5495fa1652c15d9fe9caa7f2"
server_key_iv: "2f1cac9e488fc5e9a423b457396b1334"
server_key_version: "encryptionkey@0"
I20260806 01:03:36.769192 18294 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:03:36.770079 18309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:36.770264 18294 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:36.770375 18294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-1/wal
uuid: "92cdedeae7ad4a7ca6ce1891eecf885b"
format_stamp: "Formatted at 2026-08-06 01:03:36 on dist-test-slave-69rg"
server_key: "6778a58d5495fa1652c15d9fe9caa7f2"
server_key_iv: "2f1cac9e488fc5e9a423b457396b1334"
server_key_version: "encryptionkey@0"
I20260806 01:03:36.770458 18294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:36.779752 18294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:36.781703 18294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:36.781960 18294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:36.786012 18294 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.125:38547
I20260806 01:03:36.786047 18364 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.125:38547 every 8 connection(s)
I20260806 01:03:36.786461 18294 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-1/data/info.pb
I20260806 01:03:36.787742 18365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:36.789260 18365 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } has no permanent_uuid. Determining permanent_uuid...
I20260806 01:03:36.790855 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 18294
Aug 06 01:03:36 dist-test-slave-69rg krb5kdc[17777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978216, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.125@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM
Aug 06 01:03:36 dist-test-slave-69rg krb5kdc[17777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978215, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.88.125@KRBTEST.COM
I20260806 01:03:36.799638 17862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:36.790014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50312 (local address 127.11.88.126:45409)
0806 01:03:36.790078 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:36.790080 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:36.790297 (+ 217us) server_negotiation.cc:407] Connection header received
0806 01:03:36.790870 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:36.790871 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:36.790881 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:36.790961 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:36.791821 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.792401 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.793405 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.793595 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.793648 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:36.796357 (+ 2709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:36.796358 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:36.796359 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:36.796368 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:36.797916 (+ 1548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:36.798550 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:36.798551 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:36.798551 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:36.798607 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:36.798890 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:36.798891 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:36.798891 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:36.799039 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:36.799093 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:36.799447 (+ 354us) server_negotiation.cc:299] Negotiation successful
0806 01:03:36.799538 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 01:03:36.799862 18367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:36.790005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.0.0.1:50312)
0806 01:03:36.790186 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:36.790222 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:36.790752 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:36.791032 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:36.791036 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:36.791444 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:36.791742 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:36.791749 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.792509 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.792510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:36.793310 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:36.793313 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.793687 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.793688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:36.793860 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:36.794501 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:36.794510 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:36.796260 (+ 1750us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:36.798019 (+ 1759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:36.798026 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:36.798028 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:36.798452 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:36.798677 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:36.798678 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:36.798678 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:36.798815 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:36.799110 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:36.799116 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:36.799300 (+ 184us) client_negotiation.cc:769] Sending connection context
0806 01:03:36.799395 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 01:03:36.799562 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":100,"threads_started":1}
I20260806 01:03:36.800640 18365 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } has no permanent_uuid. Determining permanent_uuid...
I20260806 01:03:36.800936 18369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:36.791385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34812 (local address 127.11.88.125:38547)
0806 01:03:36.791556 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:36.791560 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:36.791575 (+ 15us) server_negotiation.cc:407] Connection header received
0806 01:03:36.791622 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:36.791624 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:36.791639 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:36.791699 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:36.792324 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.793180 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.794219 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.794527 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.794614 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:36.797110 (+ 2496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:36.797118 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:36.797118 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:36.797125 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:36.799141 (+ 2016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:36.799566 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:36.799569 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:36.799569 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:36.799635 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:36.800188 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:36.800189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:36.800189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:36.800346 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:36.800507 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:36.800676 (+ 169us) server_negotiation.cc:299] Negotiation successful
0806 01:03:36.800783 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":99,"threads_started":1}
Aug 06 01:03:36 dist-test-slave-69rg krb5kdc[17777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978216, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.125@KRBTEST.COM for oryx/127.11.88.125@KRBTEST.COM
I20260806 01:03:36.807065 18367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:36.800935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:38547 (local address 127.0.0.1:34822)
0806 01:03:36.800980 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:36.800991 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:36.801029 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:36.801172 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:36.801173 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:36.801314 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:36.801365 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:36.801366 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.802162 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.802163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:36.802633 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:36.802635 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.803015 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.803016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:36.803086 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:36.803513 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:36.803518 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:36.804765 (+ 1247us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:36.806176 (+ 1411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:36.806177 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:36.806177 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:36.806335 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:36.806508 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:36.806508 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:36.806509 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:36.806558 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:36.806796 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:36.806796 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:36.806831 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 01:03:36.806884 (+ 53us) client_negotiation.cc:240] Negotiation successful
0806 01:03:36.806999 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260806 01:03:36.807214 18369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:36.800953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34822 (local address 127.11.88.125:38547)
0806 01:03:36.801019 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:36.801022 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:36.801032 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:03:36.801069 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:36.801070 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:36.801085 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:36.801168 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:36.801454 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.802083 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.802721 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.802930 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.803015 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:36.804843 (+ 1828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:36.804845 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:36.804845 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:36.804851 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:36.806085 (+ 1234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:36.806400 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:36.806401 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:36.806401 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:36.806450 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:36.806609 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:36.806609 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:36.806610 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:36.806741 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:36.806792 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:36.806946 (+ 154us) server_negotiation.cc:299] Negotiation successful
0806 01:03:36.807055 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":50,"thread_start_us":98,"threads_started":1}
I20260806 01:03:36.808573 18365 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b: Bootstrap starting.
I20260806 01:03:36.809388 18365 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:36.809616 18365 log.cc:824] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:36.810484 18365 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b: No bootstrap required, opened a new log
I20260806 01:03:36.811902 18365 raft_consensus.cc:348] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } }
I20260806 01:03:36.812023 18365 raft_consensus.cc:374] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:36.812045 18365 raft_consensus.cc:729] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92cdedeae7ad4a7ca6ce1891eecf885b, State: Initialized, Role: FOLLOWER
I20260806 01:03:36.812167 18365 consensus_queue.cc:260] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } }
I20260806 01:03:36.812431 18365 sys_catalog.cc:564] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:03:36.812446 18372 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } } }
I20260806 01:03:36.812645 18372 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [sys.catalog]: This master's current role is: FOLLOWER
W20260806 01:03:36.814210 18384 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 01:03:36.814280 18384 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 01:03:36.816401 18294 master_runner.cc:428] Detected that this master 92cdedeae7ad4a7ca6ce1891eecf885b is joining an existing cluster
I20260806 01:03:36.816457 18294 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.88.125:38547
I20260806 01:03:36.826113 18369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:36.817810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34838 (local address 127.11.88.125:38547)
0806 01:03:36.817886 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:36.817888 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:36.818200 (+ 312us) server_negotiation.cc:407] Connection header received
0806 01:03:36.818325 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:36.818326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:36.818339 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:36.818393 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:36.818823 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.819581 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.821135 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.821432 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.821499 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:36.822544 (+ 1045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:36.822545 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:36.822546 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:36.822552 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:36.824758 (+ 2206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:36.825173 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:36.825174 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:36.825174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:36.825239 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:36.825475 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:36.825476 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:36.825476 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:36.825618 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:36.825661 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:36.825904 (+ 243us) server_negotiation.cc:299] Negotiation successful
0806 01:03:36.825998 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 01:03:36.826426 18390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:36.817587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:38547 (local address 127.0.0.1:34838)
0806 01:03:36.818112 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:36.818122 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:36.818212 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:36.818407 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:36.818408 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:36.818601 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:36.818696 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:36.818698 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.819672 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.819673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:36.820535 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:36.820538 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.821549 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.821550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:36.821609 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:36.821981 (+ 372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:36.821985 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:36.822428 (+ 443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:36.824870 (+ 2442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:36.824871 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:36.824871 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:36.825094 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:36.825326 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:36.825327 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:36.825328 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:36.825396 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:36.825714 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:36.825714 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:36.825752 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 01:03:36.826215 (+ 463us) client_negotiation.cc:240] Negotiation successful
0806 01:03:36.826321 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":124,"threads_started":1}
I20260806 01:03:36.826553 17862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:36.817658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50320 (local address 127.11.88.126:45409)
0806 01:03:36.817714 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:36.817716 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:36.818054 (+ 338us) server_negotiation.cc:407] Connection header received
0806 01:03:36.818110 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:36.818112 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:36.818127 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:36.818207 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:36.818720 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.819309 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.820642 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.820970 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.821054 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:36.822425 (+ 1371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:36.822427 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:36.822427 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:36.822552 (+ 125us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:36.824888 (+ 2336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:36.825387 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:36.825389 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:36.825389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:36.825466 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:36.825723 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:36.825724 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:36.825724 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:36.825942 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:36.826096 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:36.826325 (+ 229us) server_negotiation.cc:299] Negotiation successful
0806 01:03:36.826456 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260806 01:03:36.827112 18391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:36.817605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.0.0.1:50320)
0806 01:03:36.817944 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:36.817956 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:36.818030 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:36.818234 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:36.818235 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:36.818502 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:36.818617 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:36.818620 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.819457 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.819458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:36.820535 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:36.820538 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.821099 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.821099 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:36.821209 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:36.821765 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:36.821771 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:36.822339 (+ 568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:36.825023 (+ 2684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:36.825024 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:36.825024 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:36.825315 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:36.825551 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:36.825552 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:36.825552 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:36.825642 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:36.826120 (+ 478us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:36.826121 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:36.826171 (+ 50us) client_negotiation.cc:769] Sending connection context
0806 01:03:36.826655 (+ 484us) client_negotiation.cc:240] Negotiation successful
0806 01:03:36.826778 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"mutex_wait_us":2,"thread_start_us":104,"threads_started":1}
Aug 06 01:03:36 dist-test-slave-69rg krb5kdc[17777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978216, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.126@KRBTEST.COM for oryx/127.11.88.125@KRBTEST.COM
I20260806 01:03:36.838097 18369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:36.830194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34842 (local address 127.11.88.125:38547)
0806 01:03:36.830244 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:36.830246 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:36.830387 (+ 141us) server_negotiation.cc:407] Connection header received
0806 01:03:36.830472 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:36.830473 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:36.830482 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:36.830534 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:36.831061 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.831613 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.832769 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.832948 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.833010 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:36.835300 (+ 2290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:36.835302 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:36.835302 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:36.835310 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:36.836714 (+ 1404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:36.837145 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:36.837146 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:36.837147 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:36.837217 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:36.837441 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:36.837442 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:36.837442 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:36.837589 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:36.837672 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:36.837891 (+ 219us) server_negotiation.cc:299] Negotiation successful
0806 01:03:36.837981 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260806 01:03:36.838117 18392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:36.830067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:38547 (local address 127.0.0.1:34842)
0806 01:03:36.830261 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:36.830313 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:36.830393 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:36.830541 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:36.830544 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:36.830906 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:36.830978 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:36.830980 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.831704 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.831706 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:36.832659 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:36.832662 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.833028 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.833029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:36.833111 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:36.833549 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:36.833554 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:36.835193 (+ 1639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:36.836814 (+ 1621us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:36.836825 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:36.836828 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:36.837063 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:36.837299 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:36.837299 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:36.837300 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:36.837368 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:36.837663 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:36.837673 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:36.837743 (+ 70us) client_negotiation.cc:769] Sending connection context
0806 01:03:36.837863 (+ 120us) client_negotiation.cc:240] Negotiation successful
0806 01:03:36.838005 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":111,"threads_started":1}
I20260806 01:03:36.838765 17822 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.88.125:38547: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b"
member_type: NON_VOTER
last_known_addr {
host: "127.11.88.125"
port: 38547
}
attrs {
promote: true
}
}
dest_uuid: "acc5d4a82f92474e873513845cc9550c"
cas_config_opid_index: -1
I20260806 01:03:36.839097 17822 consensus_queue.cc:237] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: NON_VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: true } }
I20260806 01:03:36.839627 18394 raft_consensus.cc:2932] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 92cdedeae7ad4a7ca6ce1891eecf885b (127.11.88.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: NON_VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: true } } }
I20260806 01:03:36.840039 18339 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:36.840866 18394 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.88.125:38547
I20260806 01:03:36.841233 18339 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [term 1 FOLLOWER]: Refusing update from remote peer acc5d4a82f92474e873513845cc9550c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260806 01:03:36.841277 18294 master.cc:537] Master@127.11.88.125:38547 shutting down...
I20260806 01:03:36.841214 18393 sys_catalog.cc:455] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "acc5d4a82f92474e873513845cc9550c" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: NON_VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: true } } }
I20260806 01:03:36.841478 18393 sys_catalog.cc:458] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:36.842118 18393 consensus_queue.cc:1035] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: NON_VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 01:03:36.843010 17808 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260806 01:03:36.843499 17808 consensus_peers.cc:487] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c -> Peer 92cdedeae7ad4a7ca6ce1891eecf885b (127.11.88.125:38547): Couldn't send request to peer 92cdedeae7ad4a7ca6ce1891eecf885b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 01:03:36.844841 18294 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:03:36.844967 18294 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:36.845023 18294 tablet_replica.cc:330] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b: stopping tablet replica
I20260806 01:03:36.858321 18294 master.cc:552] Master@127.11.88.125:38547 shutdown complete.
I20260806 01:03:36.858395 18294 master_runner.cc:305] Clearing existing system tablet
I20260806 01:03:36.858529 18294 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:36.858592 18294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:36.859272 18294 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260806 01:03:36.859797 18398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:36.859947 18294 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:36.860011 18294 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:36.860049 18294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-1/wal
uuid: "92cdedeae7ad4a7ca6ce1891eecf885b"
format_stamp: "Formatted at 2026-08-06 01:03:36 on dist-test-slave-69rg"
server_key: "6778a58d5495fa1652c15d9fe9caa7f2"
server_key_iv: "2f1cac9e488fc5e9a423b457396b1334"
server_key_version: "encryptionkey@0"
I20260806 01:03:36.860714 18294 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:36.862448 18294 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 01:03:36.862519 18294 log.cc:1196] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260806 01:03:36.862749 18294 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b: Deleting consensus metadata
I20260806 01:03:36.862895 18294 master_runner.cc:315] Copying system tablet from 127.11.88.126:45409
I20260806 01:03:36.863618 18294 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.88.126:45409
I20260806 01:03:36.870048 18405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:36.863957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.0.0.1:50336)
0806 01:03:36.864082 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:36.864096 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:36.864175 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:36.864339 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:36.864340 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:36.864519 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:36.864586 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:36.864588 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.865303 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.865304 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:36.865932 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:36.865934 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.866312 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.866313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:36.866385 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:36.866906 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:36.866912 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:36.867220 (+ 308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:36.868907 (+ 1687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:36.868908 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:36.868908 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:36.869086 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:36.869314 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:36.869315 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:36.869315 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:36.869380 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:36.869641 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:36.869642 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:36.869688 (+ 46us) client_negotiation.cc:769] Sending connection context
0806 01:03:36.869776 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 01:03:36.869928 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":74,"threads_started":1}
I20260806 01:03:36.870072 17862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:36.864039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50336 (local address 127.11.88.126:45409)
0806 01:03:36.864092 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:36.864094 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:36.864155 (+ 61us) server_negotiation.cc:407] Connection header received
0806 01:03:36.864249 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:36.864250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:36.864260 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:36.864320 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:36.864681 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.865205 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.866018 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.866233 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.866314 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:36.867320 (+ 1006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:36.867321 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:36.867322 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:36.867330 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:36.868800 (+ 1470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:36.869170 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:36.869171 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:36.869172 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:36.869238 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:36.869444 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:36.869445 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:36.869445 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:36.869565 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:36.869640 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:36.869900 (+ 260us) server_negotiation.cc:299] Negotiation successful
0806 01:03:36.869979 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260806 01:03:36.870607 17842 tablet_copy_service.cc:140] P acc5d4a82f92474e873513845cc9550c: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 92cdedeae7ad4a7ca6ce1891eecf885b ({username='oryx', principal='oryx/127.11.88.125@KRBTEST.COM'} at 127.0.0.1:50336)
I20260806 01:03:36.870694 17842 tablet_copy_service.cc:161] P acc5d4a82f92474e873513845cc9550c: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 92cdedeae7ad4a7ca6ce1891eecf885b at {username='oryx', principal='oryx/127.11.88.125@KRBTEST.COM'} at 127.0.0.1:50336: session id = 92cdedeae7ad4a7ca6ce1891eecf885b-00000000000000000000000000000000
I20260806 01:03:36.871387 17842 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 01:03:36.872057 18294 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 01:03:36.873104 18294 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b: tablet copy: Starting download of 0 data blocks...
I20260806 01:03:36.873275 18294 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b: tablet copy: Starting download of 1 WAL segments...
I20260806 01:03:36.874302 18294 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 01:03:36.875416 17842 tablet_copy_service.cc:342] P acc5d4a82f92474e873513845cc9550c: Request end of tablet copy session 92cdedeae7ad4a7ca6ce1891eecf885b-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.88.125@KRBTEST.COM'} at 127.0.0.1:50336
I20260806 01:03:36.875494 17842 tablet_copy_service.cc:433] P acc5d4a82f92474e873513845cc9550c: ending tablet copy session 92cdedeae7ad4a7ca6ce1891eecf885b-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 92cdedeae7ad4a7ca6ce1891eecf885b
I20260806 01:03:36.878508 18294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:36.879869 18407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:36.879959 18409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:36.880177 18406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:36.880257 18294 server_base.cc:1034] running on GCE node
I20260806 01:03:36.880347 18294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:36.880486 18294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:36.881614 18294 hybrid_clock.cc:648] HybridClock initialized: now 1785978216881579 us; error 46 us; skew 500 ppm
Aug 06 01:03:36 dist-test-slave-69rg krb5kdc[17777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978216, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:36.883229 18294 init.cc:377] Logged in from keytab as oryx/127.11.88.125@KRBTEST.COM (short username oryx)
I20260806 01:03:36.883559 18294 webserver.cc:460] Webserver started at http://127.11.88.125:39599/ using document root <none> and password file <none>
I20260806 01:03:36.883724 18294 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:36.883770 18294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:36.884526 18294 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260806 01:03:36.885162 18416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:36.885330 18294 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 01:03:36.885386 18294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-1/wal
uuid: "92cdedeae7ad4a7ca6ce1891eecf885b"
format_stamp: "Formatted at 2026-08-06 01:03:36 on dist-test-slave-69rg"
server_key: "6778a58d5495fa1652c15d9fe9caa7f2"
server_key_iv: "2f1cac9e488fc5e9a423b457396b1334"
server_key_version: "encryptionkey@0"
I20260806 01:03:36.885455 18294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:36.902993 18294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:36.904942 18294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:36.908182 18294 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.125:38547
I20260806 01:03:36.908247 18471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.125:38547 every 8 connection(s)
I20260806 01:03:36.908553 18294 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-1/data/info.pb
I20260806 01:03:36.909428 18472 sys_catalog.cc:263] Verifying existing consensus state
I20260806 01:03:36.910007 18472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b: Bootstrap starting.
I20260806 01:03:36.912528 18472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 01:03:36.912778 18472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b: Bootstrap complete.
I20260806 01:03:36.913024 18472 raft_consensus.cc:348] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: NON_VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: true } }
I20260806 01:03:36.913126 18472 raft_consensus.cc:729] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 92cdedeae7ad4a7ca6ce1891eecf885b, State: Initialized, Role: LEARNER
I20260806 01:03:36.913192 18472 consensus_queue.cc:260] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: NON_VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: true } }
I20260806 01:03:36.913400 18472 sys_catalog.cc:564] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:03:36.913393 18475 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: NON_VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: true } } }
I20260806 01:03:36.913496 18475 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [sys.catalog]: This master's current role is: LEARNER
I20260806 01:03:36.915277 18486 catalog_manager.cc:1259] Loaded cluster ID: f9a0b39ee4ba48bca7246ff8cb183476
I20260806 01:03:36.915334 18486 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b: loading cluster ID for follower catalog manager: success
I20260806 01:03:36.916435 18486 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b: acquiring CA information for follower catalog manager: success
I20260806 01:03:36.916744 18486 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 01:03:36.959966 18487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:36.953384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34872 (local address 127.11.88.125:38547)
0806 01:03:36.953559 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:36.953566 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:36.953574 (+ 8us) server_negotiation.cc:407] Connection header received
0806 01:03:36.953598 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:36.953598 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:36.953608 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:36.953689 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:36.954319 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.954985 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.955823 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:36.956035 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:36.956117 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:36.957403 (+ 1286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:36.957404 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:36.957404 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:36.957411 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:36.958925 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:36.959248 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:36.959249 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:36.959249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:36.959303 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:36.959479 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:36.959479 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:36.959480 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:36.959583 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:36.959659 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:36.959825 (+ 166us) server_negotiation.cc:299] Negotiation successful
0806 01:03:36.959894 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":76,"threads_started":1}
WARNING: no policy specified for oryx/127.11.88.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.88.124@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.88.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.124.keytab.
Entry for principal oryx/127.11.88.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.124.keytab.
I20260806 01:03:36.988534 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.124:34625
--webserver_interface=127.11.88.124
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.124.keytab
--principal=oryx/127.11.88.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:43277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:45409,127.11.88.125:38547,127.11.88.124:34625
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:37.081239 18491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:37.081471 18491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:37.081496 18491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:37.082947 18491 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:03:37.083009 18491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:37.083024 18491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:37.083038 18491 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:03:37.083056 18491 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:03:37.084944 18491 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:43277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:45409,127.11.88.125:38547,127.11.88.124:34625
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.124.keytab
--principal=oryx/127.11.88.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.124:34625
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.88.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18491
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:37.085265 18491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:37.085585 18491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:37.090811 18496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:37.090818 18497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:37.090839 18499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:37.091238 18491 server_base.cc:1034] running on GCE node
I20260806 01:03:37.091511 18491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:37.091969 18491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:37.093163 18491 hybrid_clock.cc:648] HybridClock initialized: now 1785978217093155 us; error 52 us; skew 500 ppm
Aug 06 01:03:37 dist-test-slave-69rg krb5kdc[17777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978217, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:37.096103 18491 init.cc:377] Logged in from keytab as oryx/127.11.88.124@KRBTEST.COM (short username oryx)
I20260806 01:03:37.096634 18491 webserver.cc:460] Webserver started at http://127.11.88.124:45779/ using document root <none> and password file <none>
I20260806 01:03:37.096882 18491 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:37.096930 18491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:37.097080 18491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:37.098315 18491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-2/data/instance:
uuid: "4cb70d80d509438eacfbbd231d7d0589"
format_stamp: "Formatted at 2026-08-06 01:03:37 on dist-test-slave-69rg"
server_key: "ce717cdef55d1722b4ad32c0db2497b6"
server_key_iv: "32c0b27e4605ffd72f5c1d368f2f4926"
server_key_version: "encryptionkey@0"
I20260806 01:03:37.098754 18491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-2/wal/instance:
uuid: "4cb70d80d509438eacfbbd231d7d0589"
format_stamp: "Formatted at 2026-08-06 01:03:37 on dist-test-slave-69rg"
server_key: "ce717cdef55d1722b4ad32c0db2497b6"
server_key_iv: "32c0b27e4605ffd72f5c1d368f2f4926"
server_key_version: "encryptionkey@0"
I20260806 01:03:37.100446 18491 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 01:03:37.101351 18506 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:37.101512 18491 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:37.101606 18491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-2/wal
uuid: "4cb70d80d509438eacfbbd231d7d0589"
format_stamp: "Formatted at 2026-08-06 01:03:37 on dist-test-slave-69rg"
server_key: "ce717cdef55d1722b4ad32c0db2497b6"
server_key_iv: "32c0b27e4605ffd72f5c1d368f2f4926"
server_key_version: "encryptionkey@0"
I20260806 01:03:37.101665 18491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:37.111992 18491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:37.114283 18491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:37.114449 18491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:37.118455 18491 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.124:34625
I20260806 01:03:37.118510 18559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.124:34625 every 8 connection(s)
I20260806 01:03:37.118883 18491 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-2/data/info.pb
I20260806 01:03:37.120033 18560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:37.121707 18560 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } has no permanent_uuid. Determining permanent_uuid...
I20260806 01:03:37.124770 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 18491
Aug 06 01:03:37 dist-test-slave-69rg krb5kdc[17777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978217, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.124@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM
Aug 06 01:03:37 dist-test-slave-69rg krb5kdc[17777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978215, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.88.124@KRBTEST.COM
I20260806 01:03:37.132915 17862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.122641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50348 (local address 127.11.88.126:45409)
0806 01:03:37.122725 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.122727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.122842 (+ 115us) server_negotiation.cc:407] Connection header received
0806 01:03:37.123364 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.123365 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.123376 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.123434 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:37.124021 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.124511 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.125952 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.126308 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.126395 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.129100 (+ 2705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:37.129102 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:37.129102 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:37.129110 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:37.130999 (+ 1889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.131522 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.131523 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.131523 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.131578 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.131938 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.131940 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.131941 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.132184 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:37.132283 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.132663 (+ 380us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.132785 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 01:03:37.133176 18562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.122534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.0.0.1:50348)
0806 01:03:37.122722 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:37.122757 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:37.123193 (+ 436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:37.123491 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:37.123495 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:37.123746 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:37.123944 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.123948 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.124616 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.124618 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.125781 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.125783 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.126463 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.126464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.126610 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.127191 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:37.127202 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:37.129011 (+ 1809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:37.131102 (+ 2091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.131111 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.131113 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.131438 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.131648 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.131649 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.131650 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.131808 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.132275 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:37.132281 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:37.132466 (+ 185us) client_negotiation.cc:769] Sending connection context
0806 01:03:37.132595 (+ 129us) client_negotiation.cc:240] Negotiation successful
0806 01:03:37.132830 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":91,"threads_started":1}
I20260806 01:03:37.133904 18560 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } has no permanent_uuid. Determining permanent_uuid...
I20260806 01:03:37.135824 18563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.125433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39018 (local address 127.11.88.124:34625)
0806 01:03:37.125584 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.125589 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.125605 (+ 16us) server_negotiation.cc:407] Connection header received
0806 01:03:37.125626 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.125628 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.125647 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.125739 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:37.126633 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.127681 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.128829 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.129254 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.129307 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.132351 (+ 3044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:37.132355 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:37.132356 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:37.132363 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:37.134500 (+ 2137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.135019 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.135021 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.135022 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.135079 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.135298 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.135298 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.135298 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.135422 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:37.135527 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.135656 (+ 129us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.135722 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":81,"threads_started":1}
Aug 06 01:03:37 dist-test-slave-69rg krb5kdc[17777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978217, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.124@KRBTEST.COM for oryx/127.11.88.125@KRBTEST.COM
I20260806 01:03:37.141044 18487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.134314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34874 (local address 127.11.88.125:38547)
0806 01:03:37.134366 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.134368 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.134379 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:03:37.134462 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.134463 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.134478 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.134530 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:37.134920 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.135752 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.136546 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.136766 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.136844 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.138593 (+ 1749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:37.138595 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:37.138595 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:37.138603 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:37.139915 (+ 1312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.140249 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.140250 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.140251 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.140312 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.140514 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.140515 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.140516 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.140632 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:37.140711 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.140867 (+ 156us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.140951 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 01:03:37.141044 18562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.134244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:38547 (local address 127.0.0.1:34874)
0806 01:03:37.134305 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:37.134318 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:37.134368 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:37.134549 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:37.134550 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:37.134684 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:37.134726 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.134728 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.135842 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.135843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.136479 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.136482 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.136842 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.136843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.136904 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.137287 (+ 383us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:37.137291 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:37.138502 (+ 1211us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:37.140001 (+ 1499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.140001 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.140002 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.140171 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.140390 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.140390 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.140391 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.140452 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.140702 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:37.140708 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:37.140753 (+ 45us) client_negotiation.cc:769] Sending connection context
0806 01:03:37.140842 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 01:03:37.140941 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260806 01:03:37.141613 18560 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34625 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 01:03:37 dist-test-slave-69rg krb5kdc[17777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978217, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.124@KRBTEST.COM for oryx/127.11.88.124@KRBTEST.COM
I20260806 01:03:37.148126 18563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.142022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39022 (local address 127.11.88.124:34625)
0806 01:03:37.142055 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.142057 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.142066 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:03:37.142088 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.142088 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.142098 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.142157 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:37.142393 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.142862 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.143595 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.143835 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.143908 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.145788 (+ 1880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:37.145789 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:37.145790 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:37.145796 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:37.147006 (+ 1210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.147339 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.147340 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.147341 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.147390 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.147594 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.147594 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.147595 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.147712 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:37.147785 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.147932 (+ 147us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.148019 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":17}
I20260806 01:03:37.148201 18562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.141940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:34625 (local address 127.0.0.1:39022)
0806 01:03:37.141990 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:37.142001 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:37.142044 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:37.142161 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:37.142161 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:37.142294 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:37.142321 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.142323 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.142946 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.142947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.143515 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.143517 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.143915 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.143916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.143965 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.144379 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:37.144385 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:37.145699 (+ 1314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:37.147088 (+ 1389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.147090 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.147090 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.147256 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.147468 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.147469 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.147469 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.147522 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.147787 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:37.147788 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:37.147824 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 01:03:37.147909 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 01:03:37.148065 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":68}
I20260806 01:03:37.149672 18560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589: Bootstrap starting.
I20260806 01:03:37.150578 18560 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:37.150882 18560 log.cc:824] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:37.151800 18560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589: No bootstrap required, opened a new log
I20260806 01:03:37.153337 18560 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34625 } }
I20260806 01:03:37.153474 18560 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:37.153498 18560 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cb70d80d509438eacfbbd231d7d0589, State: Initialized, Role: FOLLOWER
I20260806 01:03:37.153642 18560 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34625 } }
I20260806 01:03:37.154023 18560 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:03:37.153993 18566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34625 } } }
I20260806 01:03:37.154134 18566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [sys.catalog]: This master's current role is: FOLLOWER
W20260806 01:03:37.155833 18577 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 01:03:37.155908 18577 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 01:03:37.158385 18491 master_runner.cc:428] Detected that this master 4cb70d80d509438eacfbbd231d7d0589 is joining an existing cluster
I20260806 01:03:37.158444 18491 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.88.124:34625
I20260806 01:03:37.167163 18584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.159905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:34625 (local address 127.0.0.1:39036)
0806 01:03:37.160371 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:37.160380 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:37.160438 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:37.160599 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:37.160599 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:37.160786 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:37.160836 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.160838 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.161681 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.161682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.162695 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.162698 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.163199 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.163200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.163253 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.163784 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:37.163789 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:37.164155 (+ 366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:37.165979 (+ 1824us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.165980 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.165980 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.166183 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.166421 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.166421 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.166422 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.166474 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.166794 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:37.166795 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:37.166834 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 01:03:37.166926 (+ 92us) client_negotiation.cc:240] Negotiation successful
0806 01:03:37.167040 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"mutex_wait_us":38,"thread_start_us":66,"threads_started":1}
I20260806 01:03:37.167215 18563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.160118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39036 (local address 127.11.88.124:34625)
0806 01:03:37.160314 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.160316 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.160419 (+ 103us) server_negotiation.cc:407] Connection header received
0806 01:03:37.160499 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.160499 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.160507 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.160535 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:37.160909 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.161591 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.162796 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.163073 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.163110 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.164259 (+ 1149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:37.164261 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:37.164261 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:37.164268 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:37.165893 (+ 1625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.166266 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.166268 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.166268 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.166338 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.166533 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.166533 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.166534 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.166699 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:37.166769 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.166968 (+ 199us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.167112 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":65,"server-negotiator.queue_time_us":177}
I20260806 01:03:37.186841 18585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.159656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.0.0.1:50356)
0806 01:03:37.160028 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:37.160039 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:37.160139 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:37.160331 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:37.160332 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:37.160581 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:37.160659 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.160662 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.161665 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.161666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.162756 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.162759 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.163300 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.163301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.163379 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.182709 (+ 19330us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:37.182717 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:37.183353 (+ 636us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:37.185488 (+ 2135us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.185490 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.185490 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.185707 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.185991 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.185991 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.185992 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.186050 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.186414 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:37.186415 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:37.186466 (+ 51us) client_negotiation.cc:769] Sending connection context
0806 01:03:37.186569 (+ 103us) client_negotiation.cc:240] Negotiation successful
0806 01:03:37.186714 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"mutex_wait_us":110,"thread_start_us":93,"threads_started":1}
I20260806 01:03:37.186854 17862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.160091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50356 (local address 127.11.88.126:45409)
0806 01:03:37.160139 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.160141 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.160150 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:03:37.160202 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.160203 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.160213 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.160268 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:37.160763 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.161550 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.162864 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.163168 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.163215 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.183518 (+ 20303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:37.183522 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:37.183522 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:37.183534 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:37.185379 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.185809 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.185810 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.185843 (+ 33us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.185913 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.186135 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.186136 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.186136 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.186307 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:37.186380 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.186640 (+ 260us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.186746 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260806 01:03:37.187109 18487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.160076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34882 (local address 127.11.88.125:38547)
0806 01:03:37.160160 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.160162 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.160172 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:03:37.160197 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.160198 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.160208 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.160261 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:37.160763 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.161594 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.162798 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.163111 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.163151 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.183566 (+ 20415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:37.183568 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:37.183569 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:37.183578 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:37.185802 (+ 2224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.186244 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.186245 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.186245 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.186305 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.186509 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.186510 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.186510 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.186658 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:37.186725 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.186914 (+ 189us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.187004 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 01:03:37.187697 18583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.159631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:38547 (local address 127.0.0.1:34882)
0806 01:03:37.159799 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:37.159812 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:37.159872 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:37.160262 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:37.160263 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:37.160570 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:37.160670 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.160672 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.161681 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.161682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.162700 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.162701 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.163219 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.163220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.163275 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.182768 (+ 19493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:37.182775 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:37.183396 (+ 621us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:37.185926 (+ 2530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.185927 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.185927 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.186157 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.186379 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.186380 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.186380 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.186437 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.186755 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:37.186756 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:37.186801 (+ 45us) client_negotiation.cc:769] Sending connection context
0806 01:03:37.187202 (+ 401us) client_negotiation.cc:240] Negotiation successful
0806 01:03:37.187336 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":95,"thread_start_us":98,"threads_started":1}
I20260806 01:03:37.188341 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 17884
Aug 06 01:03:37 dist-test-slave-69rg krb5kdc[17777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978216, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.126@KRBTEST.COM for oryx/127.11.88.124@KRBTEST.COM
I20260806 01:03:37.199038 18563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.190367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39044 (local address 127.11.88.124:34625)
0806 01:03:37.190411 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.190413 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.190448 (+ 35us) server_negotiation.cc:407] Connection header received
0806 01:03:37.190485 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.190486 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.190499 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.190557 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:37.190922 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.191802 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.192896 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.193261 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.193339 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.195802 (+ 2463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:37.195803 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:37.195803 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:37.195812 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:37.197632 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.198107 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.198108 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.198108 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.198169 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.198410 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.198411 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.198411 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.198560 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:37.198629 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.198843 (+ 214us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.198928 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 01:03:37.199064 18392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.190308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:34625 (local address 127.0.0.1:39044)
0806 01:03:37.190362 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:37.190372 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:37.190408 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:37.190581 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:37.190582 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:37.190789 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:37.190842 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.190844 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.191897 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.191899 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.192807 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.192810 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.193349 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.193350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.193427 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.193948 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:37.193954 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:37.195700 (+ 1746us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:37.197729 (+ 2029us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.197731 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.197731 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.197999 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.198274 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.198275 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.198275 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.198340 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.198645 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:37.198647 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:37.198704 (+ 57us) client_negotiation.cc:769] Sending connection context
0806 01:03:37.198786 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 01:03:37.198914 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260806 01:03:37.200156 17822 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.88.124:34625: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589"
member_type: NON_VOTER
last_known_addr {
host: "127.11.88.124"
port: 34625
}
attrs {
promote: true
}
}
dest_uuid: "acc5d4a82f92474e873513845cc9550c"
cas_config_opid_index: 5
I20260806 01:03:37.200460 17822 consensus_queue.cc:237] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: NON_VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: true } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: NON_VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: true } }
I20260806 01:03:37.201035 18394 raft_consensus.cc:2932] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 4cb70d80d509438eacfbbd231d7d0589 (127.11.88.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: NON_VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: true } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: NON_VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: true } } }
I20260806 01:03:37.201977 18394 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.88.124:34625
I20260806 01:03:37.202054 18393 sys_catalog.cc:455] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "acc5d4a82f92474e873513845cc9550c" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: NON_VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: true } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: NON_VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: true } } }
I20260806 01:03:37.202131 18393 sys_catalog.cc:458] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:37.202215 18491 master.cc:537] Master@127.11.88.124:34625 shutting down...
W20260806 01:03:37.202692 17806 consensus_peers.cc:487] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c -> Peer 4cb70d80d509438eacfbbd231d7d0589 (127.11.88.124:34625): Couldn't send request to peer 4cb70d80d509438eacfbbd231d7d0589. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 01:03:37.203586 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:43511
--local_ip_for_outbound_sockets=127.11.88.65
--tserver_master_addrs=127.11.88.126:45409
--webserver_port=36019
--webserver_interface=127.11.88.65
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.65.keytab
--principal=oryx/127.11.88.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:43277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.88.126:45409,127.11.88.125:38547
--tserver_master_addrs=127.11.88.126:45409,127.11.88.125:38547,127.11.88.124:34625 with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 01:03:37.205971 18491 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260806 01:03:37.206081 18491 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:37.206137 18491 tablet_replica.cc:330] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589: stopping tablet replica
I20260806 01:03:37.208282 18392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.200993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:38547 (local address 127.0.0.1:34896)
0806 01:03:37.202550 (+ 1557us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:37.202561 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:37.202605 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:37.202855 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:37.202857 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:37.202858 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:37.202908 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.202909 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.205417 (+ 2508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.205419 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.206911 (+ 1492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.206917 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.207975 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.207976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.208055 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.208095 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 01:03:37.208140 (+ 45us) client_negotiation.cc:240] Negotiation successful
0806 01:03:37.208193 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1539}
I20260806 01:03:37.208930 18487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.201078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34896 (local address 127.11.88.125:38547)
0806 01:03:37.201125 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.201127 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.202666 (+ 1539us) server_negotiation.cc:407] Connection header received
0806 01:03:37.202699 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.202700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.202727 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.202786 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:37.202979 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.203750 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.207021 (+ 3271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.207721 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.208673 (+ 952us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.208766 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.208788 (+ 22us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.208834 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 01:03:37.209141 18444 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [term 1 LEARNER]: Refusing update from remote peer acc5d4a82f92474e873513845cc9550c: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260806 01:03:37.209340 18393 consensus_queue.cc:1035] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: NON_VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260806 01:03:37.209604 18491 master.cc:552] Master@127.11.88.124:34625 shutdown complete.
I20260806 01:03:37.209645 18491 master_runner.cc:305] Clearing existing system tablet
I20260806 01:03:37.209769 18491 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:37.209810 18491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:37.209997 18444 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 4cb70d80d509438eacfbbd231d7d0589 (127.11.88.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: NON_VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: true } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: NON_VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: true } } }
I20260806 01:03:37.211648 18475 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [sys.catalog]: SysCatalogTable state changed. Reason: New leader acc5d4a82f92474e873513845cc9550c. Latest consensus state: current_term: 1 leader_uuid: "acc5d4a82f92474e873513845cc9550c" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: NON_VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: true } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: NON_VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: true } } }
I20260806 01:03:37.211751 18475 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [sys.catalog]: This master's current role is: LEARNER
I20260806 01:03:37.211789 18475 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "acc5d4a82f92474e873513845cc9550c" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: NON_VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: true } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: NON_VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: true } } }
I20260806 01:03:37.211841 18475 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [sys.catalog]: This master's current role is: LEARNER
I20260806 01:03:37.213907 18491 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.001s
I20260806 01:03:37.214478 18393 raft_consensus.cc:1050] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c: attempting to promote NON_VOTER 92cdedeae7ad4a7ca6ce1891eecf885b to VOTER
I20260806 01:03:37.214787 18393 consensus_queue.cc:237] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: NON_VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: true } }
I20260806 01:03:37.215535 18591 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:37.215580 18392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.215342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:34625 (local address 127.0.0.1:39056)
0806 01:03:37.215472 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:37.215535 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:34625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260806 01:03:37.215669 18491 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:37.215721 18491 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 01:03:37.215747 18491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-2/wal
uuid: "4cb70d80d509438eacfbbd231d7d0589"
format_stamp: "Formatted at 2026-08-06 01:03:37 on dist-test-slave-69rg"
server_key: "ce717cdef55d1722b4ad32c0db2497b6"
server_key_iv: "32c0b27e4605ffd72f5c1d368f2f4926"
server_key_version: "encryptionkey@0"
I20260806 01:03:37.215888 18392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.215814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:34625 (local address 127.0.0.1:39072)
0806 01:03:37.215846 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:37.215868 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:34625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260806 01:03:37.215941 17806 consensus_peers.cc:487] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c -> Peer 4cb70d80d509438eacfbbd231d7d0589 (127.11.88.124:34625): Couldn't send request to peer 4cb70d80d509438eacfbbd231d7d0589. Status: Network error: Client connection negotiation failed: client connection to 127.11.88.124:34625: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260806 01:03:37.216336 18444 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [term 1 LEARNER]: Refusing update from remote peer acc5d4a82f92474e873513845cc9550c: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260806 01:03:37.216575 18394 consensus_queue.cc:1035] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260806 01:03:37.216840 18491 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:37.217555 18394 raft_consensus.cc:2932] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 92cdedeae7ad4a7ca6ce1891eecf885b (127.11.88.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: NON_VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: true } } }
I20260806 01:03:37.218981 18394 sys_catalog.cc:455] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "acc5d4a82f92474e873513845cc9550c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: NON_VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: true } } }
I20260806 01:03:37.219094 18394 sys_catalog.cc:458] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:37.219187 18394 sys_catalog.cc:455] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "acc5d4a82f92474e873513845cc9550c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: NON_VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: true } } }
I20260806 01:03:37.219231 18394 sys_catalog.cc:458] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:37.219555 18444 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 92cdedeae7ad4a7ca6ce1891eecf885b (127.11.88.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: NON_VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: true } } }
I20260806 01:03:37.219833 18491 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 01:03:37.219916 18491 log.cc:1196] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260806 01:03:37.220136 18491 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589: Deleting consensus metadata
I20260806 01:03:37.220252 18491 master_runner.cc:315] Copying system tablet from 127.11.88.126:45409
I20260806 01:03:37.220746 18589 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "acc5d4a82f92474e873513845cc9550c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: NON_VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: true } } }
I20260806 01:03:37.220834 18589 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [sys.catalog]: This master's current role is: FOLLOWER
I20260806 01:03:37.220950 18491 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589: tablet copy: Beginning tablet copy session from remote peer at address 127.11.88.126:45409
I20260806 01:03:37.228987 17862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.221322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50358 (local address 127.11.88.126:45409)
0806 01:03:37.221370 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.221373 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.221647 (+ 274us) server_negotiation.cc:407] Connection header received
0806 01:03:37.221698 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.221699 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.221711 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.221774 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:37.222332 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.223146 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.224207 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.224528 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.224600 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.225885 (+ 1285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:37.225887 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:37.225887 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:37.225896 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:37.227669 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.228116 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.228117 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.228117 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.228178 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.228387 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.228388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.228388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.228529 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:37.228573 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.228789 (+ 216us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.228878 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 01:03:37.229429 18597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.221385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.0.0.1:50358)
0806 01:03:37.221547 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:37.221560 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:37.221639 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:37.221978 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:37.221979 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:37.222194 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:37.222247 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.222249 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.223248 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.223249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.224106 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.224110 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.224620 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.224621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.224686 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.225296 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:37.225302 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:37.225737 (+ 435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:37.227776 (+ 2039us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.227777 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.227777 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.228018 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.228252 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.228252 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.228253 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.228313 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.228622 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:37.228623 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:37.228675 (+ 52us) client_negotiation.cc:769] Sending connection context
0806 01:03:37.229136 (+ 461us) client_negotiation.cc:240] Negotiation successful
0806 01:03:37.229263 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":87,"threads_started":1}
I20260806 01:03:37.229717 17842 tablet_copy_service.cc:140] P acc5d4a82f92474e873513845cc9550c: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 4cb70d80d509438eacfbbd231d7d0589 ({username='oryx', principal='oryx/127.11.88.124@KRBTEST.COM'} at 127.0.0.1:50358)
I20260806 01:03:37.229803 17842 tablet_copy_service.cc:161] P acc5d4a82f92474e873513845cc9550c: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 4cb70d80d509438eacfbbd231d7d0589 at {username='oryx', principal='oryx/127.11.88.124@KRBTEST.COM'} at 127.0.0.1:50358: session id = 4cb70d80d509438eacfbbd231d7d0589-00000000000000000000000000000000
I20260806 01:03:37.230475 17842 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 01:03:37.231114 18491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 01:03:37.232561 18491 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589: tablet copy: Starting download of 0 data blocks...
I20260806 01:03:37.232743 18491 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589: tablet copy: Starting download of 1 WAL segments...
I20260806 01:03:37.233719 18491 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 01:03:37.234903 17842 tablet_copy_service.cc:342] P acc5d4a82f92474e873513845cc9550c: Request end of tablet copy session 4cb70d80d509438eacfbbd231d7d0589-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.88.124@KRBTEST.COM'} at 127.0.0.1:50358
I20260806 01:03:37.234967 17842 tablet_copy_service.cc:433] P acc5d4a82f92474e873513845cc9550c: ending tablet copy session 4cb70d80d509438eacfbbd231d7d0589-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 4cb70d80d509438eacfbbd231d7d0589
I20260806 01:03:37.238179 18491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:37.239305 18598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:37.244730 18599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:37.244875 18491 server_base.cc:1034] running on GCE node
W20260806 01:03:37.245014 18601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:37.245297 18491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:37.245532 18491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:37.246711 18491 hybrid_clock.cc:648] HybridClock initialized: now 1785978217246686 us; error 43 us; skew 500 ppm
Aug 06 01:03:37 dist-test-slave-69rg krb5kdc[17777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978217, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:37.248417 18491 init.cc:377] Logged in from keytab as oryx/127.11.88.124@KRBTEST.COM (short username oryx)
I20260806 01:03:37.248708 18491 webserver.cc:460] Webserver started at http://127.11.88.124:40731/ using document root <none> and password file <none>
I20260806 01:03:37.248842 18491 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:37.248878 18491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:37.249677 18491 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:37.250372 18609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:37.250492 18491 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:37.250532 18491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-2/wal
uuid: "4cb70d80d509438eacfbbd231d7d0589"
format_stamp: "Formatted at 2026-08-06 01:03:37 on dist-test-slave-69rg"
server_key: "ce717cdef55d1722b4ad32c0db2497b6"
server_key_iv: "32c0b27e4605ffd72f5c1d368f2f4926"
server_key_version: "encryptionkey@0"
I20260806 01:03:37.250598 18491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:37.279261 18491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:37.281405 18491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:37.285043 18491 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.124:34625
I20260806 01:03:37.285531 18491 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/master-2/data/info.pb
I20260806 01:03:37.285981 18662 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.124:34625 every 8 connection(s)
I20260806 01:03:37.286957 18663 sys_catalog.cc:263] Verifying existing consensus state
I20260806 01:03:37.287531 18663 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589: Bootstrap starting.
I20260806 01:03:37.291050 18663 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 01:03:37.291302 18663 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589: Bootstrap complete.
I20260806 01:03:37.291522 18663 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: NON_VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: true } }
I20260806 01:03:37.291630 18663 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4cb70d80d509438eacfbbd231d7d0589, State: Initialized, Role: LEARNER
I20260806 01:03:37.291672 18663 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: NON_VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: true } }
I20260806 01:03:37.291899 18663 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:03:37.291913 18666 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: NON_VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: true } } }
I20260806 01:03:37.292193 18666 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [sys.catalog]: This master's current role is: LEARNER
I20260806 01:03:37.293537 18677 catalog_manager.cc:1259] Loaded cluster ID: f9a0b39ee4ba48bca7246ff8cb183476
I20260806 01:03:37.293634 18677 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589: loading cluster ID for follower catalog manager: success
I20260806 01:03:37.294866 18677 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589: acquiring CA information for follower catalog manager: success
I20260806 01:03:37.295202 18677 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260806 01:03:37.308877 18586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:37.309113 18586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:37.309146 18586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:37.310513 18586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:37.310576 18586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:37.310608 18586 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:03:37.312333 18586 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:43277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.65.keytab
--principal=oryx/127.11.88.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:43511
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=36019
--tserver_master_addrs=127.11.88.126:45409,127.11.88.125:38547,127.11.88.124:34625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18586
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:37.312610 18586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:37.312904 18586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:37.318328 18686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:37.318296 18683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:37.318296 18682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:37.318630 18586 server_base.cc:1034] running on GCE node
I20260806 01:03:37.318856 18586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:37.319147 18586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:37.320325 18586 hybrid_clock.cc:648] HybridClock initialized: now 1785978217320311 us; error 30 us; skew 500 ppm
Aug 06 01:03:37 dist-test-slave-69rg krb5kdc[17777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978217, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:37.323845 18586 init.cc:377] Logged in from keytab as oryx/127.11.88.65@KRBTEST.COM (short username oryx)
I20260806 01:03:37.324383 18586 webserver.cc:460] Webserver started at http://127.11.88.65:36019/ using document root <none> and password file <none>
I20260806 01:03:37.324657 18586 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:37.324764 18586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:37.326633 18586 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:37.327570 18693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:37.327838 18586 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:37.327970 18586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "6956eb0902894681952bcdca7d6571b8"
format_stamp: "Formatted at 2026-08-06 01:03:36 on dist-test-slave-69rg"
server_key: "c2b1b5e3b12da6e03f05040c2dab19c2"
server_key_iv: "be00e4d84f8b9a22f372bc5d435cee1f"
server_key_version: "encryptionkey@0"
I20260806 01:03:37.328527 18586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:37.341917 18586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:37.344600 18586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:37.344838 18586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:37.345237 18586 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:37.345642 18586 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:37.345701 18586 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:37.345755 18586 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:37.345785 18586 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:37.362164 18586 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:43511
I20260806 01:03:37.362293 18808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:43511 every 8 connection(s)
I20260806 01:03:37.362716 18586 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
Aug 06 01:03:37 dist-test-slave-69rg krb5kdc[17777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978217, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM
Aug 06 01:03:37 dist-test-slave-69rg krb5kdc[17777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978217, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.125@KRBTEST.COM
Aug 06 01:03:37 dist-test-slave-69rg krb5kdc[17777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978217, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.124@KRBTEST.COM
I20260806 01:03:37.372783 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 18586
I20260806 01:03:37.372937 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 18021
I20260806 01:03:37.378440 17862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.363829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:43365 (local address 127.11.88.126:45409)
0806 01:03:37.363891 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.363893 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.364405 (+ 512us) server_negotiation.cc:407] Connection header received
0806 01:03:37.365910 (+ 1505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.365911 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.365925 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.365958 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:37.366963 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.367782 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.368985 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.369205 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.369285 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.373793 (+ 4508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:37.373795 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:37.373795 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:37.373805 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:37.375815 (+ 2010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.376977 (+ 1162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.376978 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.376979 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.377053 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.377441 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.377442 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.377442 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.377621 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:37.377678 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.378225 (+ 547us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.378329 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260806 01:03:37.378440 18487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.364540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:49731 (local address 127.11.88.125:38547)
0806 01:03:37.364580 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.364581 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.364800 (+ 219us) server_negotiation.cc:407] Connection header received
0806 01:03:37.365910 (+ 1110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.365911 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.365924 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.365958 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:37.366958 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.367529 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.369247 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.369550 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.369587 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.372767 (+ 3180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:37.372769 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:37.372769 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:37.372778 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:37.375927 (+ 3149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.376978 (+ 1051us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.376979 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.376979 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.377053 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.377441 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.377442 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.377443 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.377641 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:37.377689 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.378225 (+ 536us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.378328 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260806 01:03:37.379259 18816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.364471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:38547 (local address 127.11.88.65:49731)
0806 01:03:37.364729 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:37.364737 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:37.365771 (+ 1034us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:37.366239 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:37.366240 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:37.366643 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:37.366846 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.366853 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.367764 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.367765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.369098 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.369101 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.369665 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.369666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.369770 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.370494 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:37.370499 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:37.372654 (+ 2155us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:37.376121 (+ 3467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.376122 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.376123 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.376863 (+ 740us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.377146 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.377146 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.377147 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.377346 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.377771 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:37.377771 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:37.378012 (+ 241us) client_negotiation.cc:769] Sending connection context
0806 01:03:37.378952 (+ 940us) client_negotiation.cc:240] Negotiation successful
0806 01:03:37.379063 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":3,"thread_start_us":104,"threads_started":1}
I20260806 01:03:37.379256 18813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.363614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:34625 (local address 127.11.88.65:49371)
0806 01:03:37.364137 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:37.364180 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:37.365752 (+ 1572us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:37.366108 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:37.366113 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:37.366476 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:37.366846 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.366852 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.368184 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.368186 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.369325 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.369328 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.370464 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.370466 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.370593 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.371083 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:37.371089 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:37.373234 (+ 2145us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:37.377532 (+ 4298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.377533 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.377533 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.377777 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.378079 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.378079 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.378080 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.378145 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.378448 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:37.378449 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:37.378716 (+ 267us) client_negotiation.cc:769] Sending connection context
0806 01:03:37.378779 (+ 63us) client_negotiation.cc:240] Negotiation successful
0806 01:03:37.378903 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"mutex_wait_us":3,"thread_start_us":327,"threads_started":1}
I20260806 01:03:37.379256 18815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.363612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.11.88.65:43365)
0806 01:03:37.364310 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:37.364321 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:37.365771 (+ 1450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:37.366170 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:37.366171 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:37.366638 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:37.366846 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.366853 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.367880 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.367880 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.368883 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.368886 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.369305 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.369306 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.369535 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.370307 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:37.370316 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:37.373656 (+ 3340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:37.375933 (+ 2277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.375944 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.375947 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.376863 (+ 916us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.377150 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.377150 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.377150 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.377345 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.377742 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:37.377751 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:37.378012 (+ 261us) client_negotiation.cc:769] Sending connection context
0806 01:03:37.378610 (+ 598us) client_negotiation.cc:240] Negotiation successful
0806 01:03:37.378841 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"mutex_wait_us":31,"thread_start_us":515,"threads_started":1}
I20260806 01:03:37.379949 18814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.363903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:49371 (local address 127.11.88.124:34625)
0806 01:03:37.364082 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.364084 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.364306 (+ 222us) server_negotiation.cc:407] Connection header received
0806 01:03:37.365912 (+ 1606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.365914 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.365930 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.366023 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:37.366993 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.368074 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.369406 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.369751 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.369860 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.373336 (+ 3476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:37.373338 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:37.373338 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:37.373346 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:37.377428 (+ 4082us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.377908 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.377909 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.377910 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.377990 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.378219 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.378220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.378220 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.378368 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:37.378423 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.379686 (+ 1263us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.379803 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":73,"threads_started":1}
I20260806 01:03:37.380283 18811 heartbeater.cc:347] Connected to a master server at 127.11.88.125:38547
I20260806 01:03:37.380417 18811 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:37.380637 18811 heartbeater.cc:511] Master 127.11.88.125:38547 requested a full tablet report, sending...
I20260806 01:03:37.381114 18810 heartbeater.cc:347] Connected to a master server at 127.11.88.126:45409
I20260806 01:03:37.381178 18810 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:37.381250 18810 heartbeater.cc:511] Master 127.11.88.126:45409 requested a full tablet report, sending...
I20260806 01:03:37.381301 18433 ts_manager.cc:194] Registered new tserver with Master: 6956eb0902894681952bcdca7d6571b8 (127.11.88.65:43511)
I20260806 01:03:37.381564 18809 heartbeater.cc:347] Connected to a master server at 127.11.88.124:34625
I20260806 01:03:37.381632 18809 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:37.381633 17822 ts_manager.cc:194] Re-registered known tserver with Master: 6956eb0902894681952bcdca7d6571b8 (127.11.88.65:43511)
I20260806 01:03:37.381712 18809 heartbeater.cc:511] Master 127.11.88.124:34625 requested a full tablet report, sending...
I20260806 01:03:37.382145 18625 ts_manager.cc:194] Registered new tserver with Master: 6956eb0902894681952bcdca7d6571b8 (127.11.88.65:43511)
I20260806 01:03:37.382217 17822 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.88.65@KRBTEST.COM'} at 127.11.88.65:43365
I20260806 01:03:37.383335 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:41757
--local_ip_for_outbound_sockets=127.11.88.66
--tserver_master_addrs=127.11.88.126:45409
--webserver_port=45385
--webserver_interface=127.11.88.66
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.66.keytab
--principal=oryx/127.11.88.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:43277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.88.126:45409,127.11.88.125:38547
--tserver_master_addrs=127.11.88.126:45409,127.11.88.125:38547,127.11.88.124:34625 with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:37.469749 18817 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:37.470018 18817 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:37.470043 18817 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:37.471232 18817 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:37.471278 18817 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:37.471304 18817 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:03:37.472818 18817 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:43277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.66.keytab
--principal=oryx/127.11.88.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:41757
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=45385
--tserver_master_addrs=127.11.88.126:45409,127.11.88.125:38547,127.11.88.124:34625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18817
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:37.473084 18817 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:37.473331 18817 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:37.478955 18823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:37.479019 18826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:37.478950 18824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:37.479477 18817 server_base.cc:1034] running on GCE node
I20260806 01:03:37.479696 18817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:37.479894 18817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:37.481065 18817 hybrid_clock.cc:648] HybridClock initialized: now 1785978217481044 us; error 30 us; skew 500 ppm
Aug 06 01:03:37 dist-test-slave-69rg krb5kdc[17777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978217, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:37.483789 18817 init.cc:377] Logged in from keytab as oryx/127.11.88.66@KRBTEST.COM (short username oryx)
I20260806 01:03:37.484191 18817 webserver.cc:460] Webserver started at http://127.11.88.66:45385/ using document root <none> and password file <none>
I20260806 01:03:37.484450 18817 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:37.484511 18817 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:37.486171 18817 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:37.486934 18833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:37.487112 18817 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:37.487233 18817 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "0cc705ff89a7431ba40de3ebe04ff15a"
format_stamp: "Formatted at 2026-08-06 01:03:36 on dist-test-slave-69rg"
server_key: "0a9a8b8133076f0b63a6550b2e35aa38"
server_key_iv: "c1472faaafd93b3576c9eb43b5bec789"
server_key_version: "encryptionkey@0"
I20260806 01:03:37.487586 18817 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:37.499799 18817 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:37.502107 18817 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:37.502275 18817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:37.502537 18817 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:37.502926 18817 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:37.502980 18817 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:37.503026 18817 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:37.503057 18817 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:37.511195 18817 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:41757
I20260806 01:03:37.511369 18948 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:41757 every 8 connection(s)
I20260806 01:03:37.511690 18817 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
Aug 06 01:03:37 dist-test-slave-69rg krb5kdc[17777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978217, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.125@KRBTEST.COM
Aug 06 01:03:37 dist-test-slave-69rg krb5kdc[17777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978217, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM
I20260806 01:03:37.520160 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 18817
I20260806 01:03:37.520339 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 18157
Aug 06 01:03:37 dist-test-slave-69rg krb5kdc[17777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978217, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.124@KRBTEST.COM
I20260806 01:03:37.524474 18487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.512734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:48551 (local address 127.11.88.125:38547)
0806 01:03:37.512868 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.512870 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.513088 (+ 218us) server_negotiation.cc:407] Connection header received
0806 01:03:37.513538 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.513539 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.513552 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.513587 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:37.515450 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.515905 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.516860 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.517053 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.517130 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.519907 (+ 2777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:37.519909 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:37.519909 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:37.519918 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:37.522502 (+ 2584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.523108 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.523110 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.523110 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.523173 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.523537 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.523538 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.523539 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.523751 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:37.523805 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.524266 (+ 461us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.524357 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260806 01:03:37.524827 18955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.512525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:38547 (local address 127.11.88.66:48551)
0806 01:03:37.513033 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:37.513043 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:37.513419 (+ 376us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:37.513736 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:37.513737 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:37.514330 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:37.514727 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.514734 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.515983 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.515984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.516789 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.516791 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.517140 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.517141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.517268 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.517998 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:37.518009 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:37.519778 (+ 1769us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:37.522600 (+ 2822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.522609 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.522612 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.523017 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.523260 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.523261 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.523262 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.523434 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.523860 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:37.523868 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:37.524075 (+ 207us) client_negotiation.cc:769] Sending connection context
0806 01:03:37.524212 (+ 137us) client_negotiation.cc:240] Negotiation successful
0806 01:03:37.524498 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"mutex_wait_us":450,"thread_start_us":76,"threads_started":1}
I20260806 01:03:37.525440 18951 heartbeater.cc:347] Connected to a master server at 127.11.88.125:38547
I20260806 01:03:37.525543 18951 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:37.525627 17862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.512815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:37753 (local address 127.11.88.126:45409)
0806 01:03:37.512871 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.512873 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.512883 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:03:37.513510 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.513511 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.513524 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.513583 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:37.515989 (+ 2406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.516448 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.517383 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.517633 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.517733 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.522633 (+ 4900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:37.522634 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:37.522635 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:37.522643 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:37.524226 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.524718 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.524720 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.524721 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.524779 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.524978 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.524979 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.524980 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.525118 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:37.525164 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.525393 (+ 229us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.525487 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 01:03:37.525671 18953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.512525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.11.88.66:37753)
0806 01:03:37.512730 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:37.512775 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:37.513404 (+ 629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:37.513649 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:37.513653 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:37.514333 (+ 680us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:37.514728 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.514735 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.516540 (+ 1805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.516541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.517298 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.517299 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.517735 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.517736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.517846 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.518264 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:37.518268 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:37.522521 (+ 4253us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:37.524323 (+ 1802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.524324 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.524324 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.524607 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.524851 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.524852 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.524852 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.524906 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.525216 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:37.525216 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:37.525258 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 01:03:37.525345 (+ 87us) client_negotiation.cc:240] Negotiation successful
0806 01:03:37.525481 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":59,"thread_start_us":78,"threads_started":1}
I20260806 01:03:37.525776 18951 heartbeater.cc:511] Master 127.11.88.125:38547 requested a full tablet report, sending...
I20260806 01:03:37.526131 18950 heartbeater.cc:347] Connected to a master server at 127.11.88.126:45409
I20260806 01:03:37.526190 18950 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:37.526270 18950 heartbeater.cc:511] Master 127.11.88.126:45409 requested a full tablet report, sending...
I20260806 01:03:37.526358 18433 ts_manager.cc:194] Registered new tserver with Master: 0cc705ff89a7431ba40de3ebe04ff15a (127.11.88.66:41757)
I20260806 01:03:37.526490 17822 ts_manager.cc:194] Re-registered known tserver with Master: 0cc705ff89a7431ba40de3ebe04ff15a (127.11.88.66:41757)
I20260806 01:03:37.527025 17822 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.88.66@KRBTEST.COM'} at 127.11.88.66:37753
I20260806 01:03:37.530375 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:34291
--local_ip_for_outbound_sockets=127.11.88.67
--tserver_master_addrs=127.11.88.126:45409
--webserver_port=33443
--webserver_interface=127.11.88.67
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.67.keytab
--principal=oryx/127.11.88.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:43277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.88.126:45409,127.11.88.125:38547
--tserver_master_addrs=127.11.88.126:45409,127.11.88.125:38547,127.11.88.124:34625 with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 01:03:37.533651 18814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.512643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:45641 (local address 127.11.88.124:34625)
0806 01:03:37.512822 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.512825 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.513033 (+ 208us) server_negotiation.cc:407] Connection header received
0806 01:03:37.513538 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.513539 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.513556 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.513587 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:37.514818 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.515364 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.516808 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.517133 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.517199 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.530500 (+ 13301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:37.530502 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:37.530503 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:37.530513 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:37.532267 (+ 1754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.532593 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.532594 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.532594 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.532658 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.532998 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.532999 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.532999 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.533121 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:37.533199 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.533446 (+ 247us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.533535 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150}
I20260806 01:03:37.533887 18954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.512525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:34625 (local address 127.11.88.66:45641)
0806 01:03:37.512935 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:37.512945 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:37.513425 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:37.513735 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:37.513736 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:37.514317 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:37.514727 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.514734 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.515455 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.515456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.516718 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.516720 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.517259 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.517260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.517326 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.518142 (+ 816us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:37.518148 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:37.530388 (+ 12240us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:37.532341 (+ 1953us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.532342 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.532342 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.532506 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.532787 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.532788 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.532788 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.532841 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.533191 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:37.533192 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:37.533247 (+ 55us) client_negotiation.cc:769] Sending connection context
0806 01:03:37.533405 (+ 158us) client_negotiation.cc:240] Negotiation successful
0806 01:03:37.533534 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"mutex_wait_us":73,"thread_start_us":215,"threads_started":1}
I20260806 01:03:37.534458 18949 heartbeater.cc:347] Connected to a master server at 127.11.88.124:34625
I20260806 01:03:37.534524 18949 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:37.534616 18949 heartbeater.cc:511] Master 127.11.88.124:34625 requested a full tablet report, sending...
I20260806 01:03:37.534925 18625 ts_manager.cc:194] Registered new tserver with Master: 0cc705ff89a7431ba40de3ebe04ff15a (127.11.88.66:41757)
W20260806 01:03:37.616570 18956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:37.616772 18956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:37.616796 18956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:37.617988 18956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:37.618028 18956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:37.618124 18956 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:03:37.619745 18956 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:43277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.67.keytab
--principal=oryx/127.11.88.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:34291
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=33443
--tserver_master_addrs=127.11.88.126:45409,127.11.88.125:38547,127.11.88.124:34625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18956
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:37.619982 18956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:37.620249 18956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:37.625381 18963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:37.625464 18966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:37.625481 18956 server_base.cc:1034] running on GCE node
W20260806 01:03:37.625510 18962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:37.625932 18956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:37.626189 18956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:37.627432 18956 hybrid_clock.cc:648] HybridClock initialized: now 1785978217627353 us; error 41 us; skew 500 ppm
Aug 06 01:03:37 dist-test-slave-69rg krb5kdc[17777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978217, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:37.630563 18956 init.cc:377] Logged in from keytab as oryx/127.11.88.67@KRBTEST.COM (short username oryx)
I20260806 01:03:37.631031 18956 webserver.cc:460] Webserver started at http://127.11.88.67:33443/ using document root <none> and password file <none>
I20260806 01:03:37.631269 18956 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:37.631357 18956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:37.632905 18956 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:37.633566 18973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:37.633762 18956 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:37.633886 18956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "54c1154a37dc44bdb3e437b8a43a9d9c"
format_stamp: "Formatted at 2026-08-06 01:03:36 on dist-test-slave-69rg"
server_key: "c67aead56695880953b32e1c1d90d681"
server_key_iv: "cb144d69676102deb5d8ccb6603a42ce"
server_key_version: "encryptionkey@0"
I20260806 01:03:37.634254 18956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:37.641290 18956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:37.643216 18956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:37.643380 18956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:37.643694 18956 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:37.644037 18956 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:37.644093 18956 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:37.644137 18956 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:37.644164 18956 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:37.650444 18956 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:34291
I20260806 01:03:37.650506 19089 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:34291 every 8 connection(s)
I20260806 01:03:37.650890 18956 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
I20260806 01:03:37.657040 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 18956
Aug 06 01:03:37 dist-test-slave-69rg krb5kdc[17777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978217, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM
Aug 06 01:03:37 dist-test-slave-69rg krb5kdc[17777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978217, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.124@KRBTEST.COM
Aug 06 01:03:37 dist-test-slave-69rg krb5kdc[17777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978217, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.125@KRBTEST.COM
I20260806 01:03:37.662956 19096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.651770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.11.88.67:39591)
0806 01:03:37.652160 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:37.652169 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:37.652714 (+ 545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:37.653016 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:37.653017 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:37.653489 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:37.653694 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.653700 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.654697 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.654698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.655607 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.655609 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.656064 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.656065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.656131 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.656820 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:37.656825 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:37.658974 (+ 2149us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:37.660878 (+ 1904us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.660885 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.660889 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.661275 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.661692 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.661693 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.661694 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.661854 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.662213 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:37.662219 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:37.662377 (+ 158us) client_negotiation.cc:769] Sending connection context
0806 01:03:37.662492 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 01:03:37.662678 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"mutex_wait_us":205,"thread_start_us":98,"threads_started":1}
I20260806 01:03:37.663523 17862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.651896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:39591 (local address 127.11.88.126:45409)
0806 01:03:37.652056 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.652058 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.652254 (+ 196us) server_negotiation.cc:407] Connection header received
0806 01:03:37.652900 (+ 646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.652902 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.652916 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.652972 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:37.653869 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.654609 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.655701 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.655974 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.656063 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.659092 (+ 3029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:37.659093 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:37.659093 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:37.659119 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:37.660786 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.661546 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.661547 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.661547 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.661613 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.661933 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.661934 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.661935 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.662109 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:37.662170 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.663349 (+ 1179us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.663432 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132}
I20260806 01:03:37.663916 19091 heartbeater.cc:347] Connected to a master server at 127.11.88.126:45409
I20260806 01:03:37.664019 19091 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:37.664238 19091 heartbeater.cc:511] Master 127.11.88.126:45409 requested a full tablet report, sending...
I20260806 01:03:37.664763 17822 ts_manager.cc:194] Re-registered known tserver with Master: 54c1154a37dc44bdb3e437b8a43a9d9c (127.11.88.67:34291)
I20260806 01:03:37.665277 17822 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.88.67@KRBTEST.COM'} at 127.11.88.67:39591
I20260806 01:03:37.665794 19095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.651768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:38547 (local address 127.11.88.67:39251)
0806 01:03:37.652058 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:37.652103 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:37.652674 (+ 571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:37.653086 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:37.653087 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:37.653482 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:37.653694 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.653700 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.654461 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.654461 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.655727 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.655728 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.656201 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.656202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.656396 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.657911 (+ 1515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:37.657916 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:37.660887 (+ 2971us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:37.664319 (+ 3432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.664320 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.664320 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.664515 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.664739 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.664739 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.664740 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.664795 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.665289 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:37.665290 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:37.665330 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 01:03:37.665486 (+ 156us) client_negotiation.cc:240] Negotiation successful
0806 01:03:37.665604 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"mutex_wait_us":17,"thread_start_us":87,"threads_started":1}
I20260806 01:03:37.666922 19097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.651769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:34625 (local address 127.11.88.67:49627)
0806 01:03:37.652058 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:37.652103 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:37.652674 (+ 571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:37.652978 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:37.652982 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:37.653481 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:37.653693 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.653697 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.654699 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.654700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.655421 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.655423 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.655863 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.655864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.656050 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.656707 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:37.656715 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:37.660590 (+ 3875us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:37.663186 (+ 2596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.663187 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.663188 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.663519 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.664971 (+ 1452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:37.664972 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:37.664972 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:37.665017 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:37.666268 (+ 1251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:37.666269 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:37.666312 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 01:03:37.666444 (+ 132us) client_negotiation.cc:240] Negotiation successful
0806 01:03:37.666558 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"mutex_wait_us":74,"thread_start_us":87,"threads_started":1}
I20260806 01:03:37.667320 18487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.651883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:39251 (local address 127.11.88.125:38547)
0806 01:03:37.652006 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.652009 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.652216 (+ 207us) server_negotiation.cc:407] Connection header received
0806 01:03:37.652974 (+ 758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.652976 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.652988 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.653040 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:37.653799 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.654355 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.655793 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.656078 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.656142 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.660962 (+ 4820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:37.660963 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:37.660964 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:37.660972 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:37.664238 (+ 3266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.664610 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.664611 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.664611 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.664670 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.665079 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.665080 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.665081 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.665204 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:37.665263 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.667137 (+ 1874us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.667228 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260806 01:03:37.667644 19093 heartbeater.cc:347] Connected to a master server at 127.11.88.125:38547
I20260806 01:03:37.667675 18814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.651947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:49627 (local address 127.11.88.124:34625)
0806 01:03:37.652096 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.652098 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.652239 (+ 141us) server_negotiation.cc:407] Connection header received
0806 01:03:37.652806 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.652808 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.652823 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.652885 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:37.653797 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.654597 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.655517 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.655787 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.655847 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.660658 (+ 4811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:37.660659 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:37.660659 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:37.660667 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:37.663092 (+ 2425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.664861 (+ 1769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.664862 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.664862 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.664911 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.666004 (+ 1093us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.666004 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.666005 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.666169 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:37.666236 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.667456 (+ 1220us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.667539 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
I20260806 01:03:37.667692 19093 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:37.667764 19093 heartbeater.cc:511] Master 127.11.88.125:38547 requested a full tablet report, sending...
I20260806 01:03:37.668113 18433 ts_manager.cc:194] Registered new tserver with Master: 54c1154a37dc44bdb3e437b8a43a9d9c (127.11.88.67:34291)
I20260806 01:03:37.668124 19090 heartbeater.cc:347] Connected to a master server at 127.11.88.124:34625
I20260806 01:03:37.668177 19090 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:37.668241 19090 heartbeater.cc:511] Master 127.11.88.124:34625 requested a full tablet report, sending...
I20260806 01:03:37.668541 18625 ts_manager.cc:194] Registered new tserver with Master: 54c1154a37dc44bdb3e437b8a43a9d9c (127.11.88.67:34291)
I20260806 01:03:37.669358 19104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.658577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39084 (local address 127.11.88.124:34625)
0806 01:03:37.659196 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.659198 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.659414 (+ 216us) server_negotiation.cc:407] Connection header received
0806 01:03:37.659438 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.659439 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.659452 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.659508 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:37.660429 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.661924 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.663301 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.663589 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.663657 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.665236 (+ 1579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:37.665237 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:37.665238 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:37.665244 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:37.667270 (+ 2026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.668395 (+ 1125us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.668396 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.668396 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.668458 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.668699 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.668700 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.668700 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.668843 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:37.668942 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.669152 (+ 210us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.669234 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":564,"thread_start_us":90,"threads_started":1}
I20260806 01:03:37.670905 18814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.661971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39090 (local address 127.11.88.124:34625)
0806 01:03:37.667752 (+ 5781us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.667754 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.667762 (+ 8us) server_negotiation.cc:407] Connection header received
0806 01:03:37.667783 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.667784 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.667807 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.667867 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:37.668119 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.668852 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.670219 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.670613 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.670704 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.670788 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.670813 (+ 25us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.670844 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5765,"thread_start_us":62,"threads_started":1}
I20260806 01:03:37.670923 18392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.661726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:34625 (local address 127.0.0.1:39090)
0806 01:03:37.661846 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:37.661858 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:37.661898 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:37.667998 (+ 6100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:37.667999 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:37.668001 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:37.668042 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.668043 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.668924 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.668925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.670118 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.670121 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.670704 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.670705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.670762 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.670766 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:03:37.670811 (+ 45us) client_negotiation.cc:240] Negotiation successful
0806 01:03:37.670854 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84}
I20260806 01:03:37.671351 18627 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260806 01:03:37.671567 18666 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [sys.catalog]: SysCatalogTable state changed. Reason: New leader acc5d4a82f92474e873513845cc9550c. Latest consensus state: current_term: 1 leader_uuid: "acc5d4a82f92474e873513845cc9550c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: NON_VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: true } } }
I20260806 01:03:37.671660 18666 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [sys.catalog]: This master's current role is: LEARNER
I20260806 01:03:37.673108 19107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.659042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34910 (local address 127.11.88.125:38547)
0806 01:03:37.659171 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.659173 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.661392 (+ 2219us) server_negotiation.cc:407] Connection header received
0806 01:03:37.661416 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.661417 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.661429 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.661483 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:37.662463 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.664007 (+ 1544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.665244 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.665568 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.665661 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.667478 (+ 1817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:37.667479 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:37.667480 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:37.667486 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:37.671474 (+ 3988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.672269 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.672270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.672271 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.672339 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.672554 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.672555 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.672555 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.672678 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:37.672783 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.672903 (+ 120us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.672984 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":55,"threads_started":1}
I20260806 01:03:37.675730 19103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.658344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50368 (local address 127.11.88.126:45409)
0806 01:03:37.661026 (+ 2682us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.661028 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.661036 (+ 8us) server_negotiation.cc:407] Connection header received
0806 01:03:37.661056 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.661056 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.661070 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.661157 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:37.669898 (+ 8741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.670384 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.671543 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.671839 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.671904 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.673157 (+ 1253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:37.673158 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:37.673158 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:37.673167 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:37.674860 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.675187 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.675188 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.675188 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.675240 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.675387 (+ 147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.675388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.675388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.675478 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:37.675547 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.675604 (+ 57us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.675666 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2632,"thread_start_us":171,"threads_started":1}
I20260806 01:03:37.677407 17822 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50368:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 01:03:37.679150 17822 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:03:37.680059 18393 sys_catalog.cc:455] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "acc5d4a82f92474e873513845cc9550c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: NON_VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: true } } }
I20260806 01:03:37.680199 18393 sys_catalog.cc:458] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:37.681564 18393 raft_consensus.cc:1050] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c: attempting to promote NON_VOTER 4cb70d80d509438eacfbbd231d7d0589 to VOTER
I20260806 01:03:37.681718 18393 consensus_queue.cc:237] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: false } }
I20260806 01:03:37.682292 18627 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [term 1 LEARNER]: Refusing update from remote peer acc5d4a82f92474e873513845cc9550c: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260806 01:03:37.682564 18393 consensus_queue.cc:1035] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260806 01:03:37.682937 18444 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [term 1 FOLLOWER]: Refusing update from remote peer acc5d4a82f92474e873513845cc9550c: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260806 01:03:37.683151 18394 consensus_queue.cc:1035] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [LEADER]: Connected to new peer: Peer: permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260806 01:03:37.683458 18590 raft_consensus.cc:2932] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 4cb70d80d509438eacfbbd231d7d0589 (127.11.88.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: false } } }
I20260806 01:03:37.683590 18627 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 4cb70d80d509438eacfbbd231d7d0589 (127.11.88.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: false } } }
I20260806 01:03:37.684216 18444 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 4cb70d80d509438eacfbbd231d7d0589 (127.11.88.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: false } } }
I20260806 01:03:37.684809 18666 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "acc5d4a82f92474e873513845cc9550c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: false } } }
I20260806 01:03:37.684926 18666 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 01:03:37.684904 18590 sys_catalog.cc:455] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "acc5d4a82f92474e873513845cc9550c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: false } } }
I20260806 01:03:37.684996 18590 sys_catalog.cc:458] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:37.685081 18590 sys_catalog.cc:455] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "acc5d4a82f92474e873513845cc9550c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: false } } }
I20260806 01:03:37.685129 18590 sys_catalog.cc:458] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:37.685186 18590 sys_catalog.cc:455] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "acc5d4a82f92474e873513845cc9550c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: false } } }
I20260806 01:03:37.685236 18590 sys_catalog.cc:458] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:37.685907 18589 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "acc5d4a82f92474e873513845cc9550c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: false } } }
I20260806 01:03:37.686013 18589 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [sys.catalog]: This master's current role is: FOLLOWER
I20260806 01:03:37.690913 18392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.685804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:34291 (local address 127.0.0.1:40224)
0806 01:03:37.685974 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:37.685987 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:37.686034 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:37.686491 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:37.686492 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:37.686494 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:37.686551 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.686552 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.688236 (+ 1684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.688237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.689331 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.689334 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.690627 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.690628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.690695 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.690699 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:03:37.690784 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 01:03:37.690836 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149}
I20260806 01:03:37.691061 19117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.685986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40224 (local address 127.11.88.67:34291)
0806 01:03:37.686219 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.686224 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.686235 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:03:37.686358 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.686361 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.686380 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.686634 (+ 254us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:37.686702 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.688126 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.689493 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.690522 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.690601 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.690802 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.690837 (+ 35us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.690884 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":148,"threads_started":1}
I20260806 01:03:37.691402 19118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.686180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:43511 (local address 127.0.0.1:42796)
0806 01:03:37.686466 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:37.686479 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:37.686541 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:37.687640 (+ 1099us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:37.687641 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:37.687644 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:37.687687 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.687688 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.688785 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.688786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.690043 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.690044 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.691107 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.691108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.691184 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.691189 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 01:03:37.691260 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 01:03:37.691308 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":3,"thread_start_us":121,"threads_started":1}
I20260806 01:03:37.691511 19120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.686447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:41757 (local address 127.0.0.1:39508)
0806 01:03:37.686588 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:37.686599 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:37.686645 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:37.687117 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:37.687118 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:37.687120 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:37.687172 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.687173 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.688569 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.688570 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.689903 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.689906 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.691184 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.691185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.691304 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.691310 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 01:03:37.691352 (+ 42us) client_negotiation.cc:240] Negotiation successful
0806 01:03:37.691420 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":50,"thread_start_us":91,"threads_started":1}
I20260806 01:03:37.691713 19116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.685983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42796 (local address 127.11.88.65:43511)
0806 01:03:37.687453 (+ 1470us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.687457 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.687468 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:03:37.687534 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.687536 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.687552 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.687636 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:37.687769 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.688689 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.690103 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.690789 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.690848 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.691546 (+ 698us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.691585 (+ 39us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.691632 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1375,"thread_start_us":111,"threads_started":1}
I20260806 01:03:37.692263 19022 tablet_service.cc:1467] Processing CreateTablet for tablet 67ed2076270b470596b12a61ca5bb3a6 (DEFAULT_TABLE table=test-table [id=524fbe9106b74b13b8ae4a6e7cd226af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:37.692611 19122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.686703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39508 (local address 127.11.88.66:41757)
0806 01:03:37.686907 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.686911 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.686920 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:03:37.686991 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.686993 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.687006 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.687105 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:37.687260 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.688458 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.690025 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.691078 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.691756 (+ 678us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.692003 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.692037 (+ 34us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.692086 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":123,"threads_started":1}
I20260806 01:03:37.692550 18742 tablet_service.cc:1467] Processing CreateTablet for tablet 67ed2076270b470596b12a61ca5bb3a6 (DEFAULT_TABLE table=test-table [id=524fbe9106b74b13b8ae4a6e7cd226af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:37.692701 19022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67ed2076270b470596b12a61ca5bb3a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:37.692991 18742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67ed2076270b470596b12a61ca5bb3a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:37.693449 18882 tablet_service.cc:1467] Processing CreateTablet for tablet 67ed2076270b470596b12a61ca5bb3a6 (DEFAULT_TABLE table=test-table [id=524fbe9106b74b13b8ae4a6e7cd226af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:37.693794 18882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67ed2076270b470596b12a61ca5bb3a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:37.697786 19123 tablet_bootstrap.cc:492] T 67ed2076270b470596b12a61ca5bb3a6 P 6956eb0902894681952bcdca7d6571b8: Bootstrap starting.
I20260806 01:03:37.699139 19123 tablet_bootstrap.cc:654] T 67ed2076270b470596b12a61ca5bb3a6 P 6956eb0902894681952bcdca7d6571b8: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:37.699908 19123 log.cc:824] T 67ed2076270b470596b12a61ca5bb3a6 P 6956eb0902894681952bcdca7d6571b8: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:37.700484 19124 tablet_bootstrap.cc:492] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a: Bootstrap starting.
I20260806 01:03:37.701094 19126 tablet_bootstrap.cc:492] T 67ed2076270b470596b12a61ca5bb3a6 P 54c1154a37dc44bdb3e437b8a43a9d9c: Bootstrap starting.
I20260806 01:03:37.702239 19124 tablet_bootstrap.cc:654] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:37.702514 19126 tablet_bootstrap.cc:654] T 67ed2076270b470596b12a61ca5bb3a6 P 54c1154a37dc44bdb3e437b8a43a9d9c: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:37.702589 19123 tablet_bootstrap.cc:492] T 67ed2076270b470596b12a61ca5bb3a6 P 6956eb0902894681952bcdca7d6571b8: No bootstrap required, opened a new log
I20260806 01:03:37.702683 19123 ts_tablet_manager.cc:1397] T 67ed2076270b470596b12a61ca5bb3a6 P 6956eb0902894681952bcdca7d6571b8: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260806 01:03:37.703169 19124 log.cc:824] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:37.703379 19126 log.cc:824] T 67ed2076270b470596b12a61ca5bb3a6 P 54c1154a37dc44bdb3e437b8a43a9d9c: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:37.704236 19124 tablet_bootstrap.cc:492] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a: No bootstrap required, opened a new log
I20260806 01:03:37.704332 19124 ts_tablet_manager.cc:1397] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260806 01:03:37.704490 19126 tablet_bootstrap.cc:492] T 67ed2076270b470596b12a61ca5bb3a6 P 54c1154a37dc44bdb3e437b8a43a9d9c: No bootstrap required, opened a new log
I20260806 01:03:37.704567 19126 ts_tablet_manager.cc:1397] T 67ed2076270b470596b12a61ca5bb3a6 P 54c1154a37dc44bdb3e437b8a43a9d9c: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260806 01:03:37.707762 19124 raft_consensus.cc:348] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34291 } } peers { permanent_uuid: "0cc705ff89a7431ba40de3ebe04ff15a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 41757 } } peers { permanent_uuid: "6956eb0902894681952bcdca7d6571b8" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43511 } }
I20260806 01:03:37.707762 19123 raft_consensus.cc:348] T 67ed2076270b470596b12a61ca5bb3a6 P 6956eb0902894681952bcdca7d6571b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34291 } } peers { permanent_uuid: "0cc705ff89a7431ba40de3ebe04ff15a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 41757 } } peers { permanent_uuid: "6956eb0902894681952bcdca7d6571b8" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43511 } }
I20260806 01:03:37.707947 19124 raft_consensus.cc:374] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:37.707981 19123 raft_consensus.cc:374] T 67ed2076270b470596b12a61ca5bb3a6 P 6956eb0902894681952bcdca7d6571b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:37.708005 19124 raft_consensus.cc:729] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cc705ff89a7431ba40de3ebe04ff15a, State: Initialized, Role: FOLLOWER
I20260806 01:03:37.708033 19123 raft_consensus.cc:729] T 67ed2076270b470596b12a61ca5bb3a6 P 6956eb0902894681952bcdca7d6571b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6956eb0902894681952bcdca7d6571b8, State: Initialized, Role: FOLLOWER
I20260806 01:03:37.708168 19124 consensus_queue.cc:260] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34291 } } peers { permanent_uuid: "0cc705ff89a7431ba40de3ebe04ff15a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 41757 } } peers { permanent_uuid: "6956eb0902894681952bcdca7d6571b8" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43511 } }
I20260806 01:03:37.708195 19123 consensus_queue.cc:260] T 67ed2076270b470596b12a61ca5bb3a6 P 6956eb0902894681952bcdca7d6571b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34291 } } peers { permanent_uuid: "0cc705ff89a7431ba40de3ebe04ff15a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 41757 } } peers { permanent_uuid: "6956eb0902894681952bcdca7d6571b8" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43511 } }
I20260806 01:03:37.708531 19124 ts_tablet_manager.cc:1428] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260806 01:03:37.708577 19123 ts_tablet_manager.cc:1428] T 67ed2076270b470596b12a61ca5bb3a6 P 6956eb0902894681952bcdca7d6571b8: Time spent starting tablet: real 0.006s user 0.004s sys 0.002s
I20260806 01:03:37.708806 18810 heartbeater.cc:503] Master 127.11.88.126:45409 was elected leader, sending a full tablet report...
I20260806 01:03:37.709031 18950 heartbeater.cc:503] Master 127.11.88.126:45409 was elected leader, sending a full tablet report...
I20260806 01:03:37.710506 19126 raft_consensus.cc:348] T 67ed2076270b470596b12a61ca5bb3a6 P 54c1154a37dc44bdb3e437b8a43a9d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34291 } } peers { permanent_uuid: "0cc705ff89a7431ba40de3ebe04ff15a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 41757 } } peers { permanent_uuid: "6956eb0902894681952bcdca7d6571b8" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43511 } }
I20260806 01:03:37.710705 19126 raft_consensus.cc:374] T 67ed2076270b470596b12a61ca5bb3a6 P 54c1154a37dc44bdb3e437b8a43a9d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:37.710758 19126 raft_consensus.cc:729] T 67ed2076270b470596b12a61ca5bb3a6 P 54c1154a37dc44bdb3e437b8a43a9d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54c1154a37dc44bdb3e437b8a43a9d9c, State: Initialized, Role: FOLLOWER
I20260806 01:03:37.710901 19126 consensus_queue.cc:260] T 67ed2076270b470596b12a61ca5bb3a6 P 54c1154a37dc44bdb3e437b8a43a9d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34291 } } peers { permanent_uuid: "0cc705ff89a7431ba40de3ebe04ff15a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 41757 } } peers { permanent_uuid: "6956eb0902894681952bcdca7d6571b8" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43511 } }
I20260806 01:03:37.711239 19126 ts_tablet_manager.cc:1428] T 67ed2076270b470596b12a61ca5bb3a6 P 54c1154a37dc44bdb3e437b8a43a9d9c: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260806 01:03:37.711596 19091 heartbeater.cc:503] Master 127.11.88.126:45409 was elected leader, sending a full tablet report...
W20260806 01:03:37.762750 18952 tablet.cc:2369] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 01:03:37.864066 18812 tablet.cc:2369] T 67ed2076270b470596b12a61ca5bb3a6 P 6956eb0902894681952bcdca7d6571b8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 01:03:37.902033 19129 raft_consensus.cc:482] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260806 01:03:37.902071 19094 tablet.cc:2369] T 67ed2076270b470596b12a61ca5bb3a6 P 54c1154a37dc44bdb3e437b8a43a9d9c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 01:03:37.902217 19129 raft_consensus.cc:504] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34291 } } peers { permanent_uuid: "0cc705ff89a7431ba40de3ebe04ff15a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 41757 } } peers { permanent_uuid: "6956eb0902894681952bcdca7d6571b8" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43511 } }
I20260806 01:03:37.902734 19129 leader_election.cc:288] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54c1154a37dc44bdb3e437b8a43a9d9c (127.11.88.67:34291), 6956eb0902894681952bcdca7d6571b8 (127.11.88.65:43511)
I20260806 01:03:37.905791 18953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.903036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:43511 (local address 127.11.88.66:41693)
0806 01:03:37.903086 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:37.903097 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:37.903194 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:37.903366 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:37.903367 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:37.903368 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:37.903518 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.903519 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.904177 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.904178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.904906 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.904908 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.905485 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.905486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.905626 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.905630 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:03:37.905675 (+ 45us) client_negotiation.cc:240] Negotiation successful
0806 01:03:37.905710 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":2}
I20260806 01:03:37.905855 19116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.903078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:41693 (local address 127.11.88.65:43511)
0806 01:03:37.903125 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.903127 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.903183 (+ 56us) server_negotiation.cc:407] Connection header received
0806 01:03:37.903276 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.903277 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.903287 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.903349 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:37.903601 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.904090 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.905009 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.905400 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.905455 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.905462 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.905708 (+ 246us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.905765 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 01:03:37.905961 19117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.903091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:58987 (local address 127.11.88.67:34291)
0806 01:03:37.903138 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.903140 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.903173 (+ 33us) server_negotiation.cc:407] Connection header received
0806 01:03:37.903206 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.903207 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.903217 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.903270 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:37.903471 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.904019 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.905078 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.905451 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.905525 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.905533 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.905811 (+ 278us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.905883 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 01:03:37.906056 18954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.902971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:34291 (local address 127.11.88.66:58987)
0806 01:03:37.903050 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:37.903065 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:37.903133 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:37.903286 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:37.903287 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:37.903289 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:37.903370 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.903372 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.904104 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.904106 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.904989 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:37.904993 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.905541 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.905542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:37.905694 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.905699 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 01:03:37.905785 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 01:03:37.905853 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52,"mutex_wait_us":23}
I20260806 01:03:37.906196 18762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67ed2076270b470596b12a61ca5bb3a6" candidate_uuid: "0cc705ff89a7431ba40de3ebe04ff15a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6956eb0902894681952bcdca7d6571b8" is_pre_election: true
I20260806 01:03:37.906404 18762 raft_consensus.cc:2454] T 67ed2076270b470596b12a61ca5bb3a6 P 6956eb0902894681952bcdca7d6571b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cc705ff89a7431ba40de3ebe04ff15a in term 0.
I20260806 01:03:37.906602 19043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67ed2076270b470596b12a61ca5bb3a6" candidate_uuid: "0cc705ff89a7431ba40de3ebe04ff15a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c" is_pre_election: true
I20260806 01:03:37.906737 18837 leader_election.cc:302] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cc705ff89a7431ba40de3ebe04ff15a, 6956eb0902894681952bcdca7d6571b8; no voters:
I20260806 01:03:37.906785 19043 raft_consensus.cc:2454] T 67ed2076270b470596b12a61ca5bb3a6 P 54c1154a37dc44bdb3e437b8a43a9d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cc705ff89a7431ba40de3ebe04ff15a in term 0.
I20260806 01:03:37.906903 19129 raft_consensus.cc:2781] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:03:37.906976 19129 raft_consensus.cc:482] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:03:37.907017 19129 raft_consensus.cc:3037] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:37.907932 19129 raft_consensus.cc:504] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34291 } } peers { permanent_uuid: "0cc705ff89a7431ba40de3ebe04ff15a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 41757 } } peers { permanent_uuid: "6956eb0902894681952bcdca7d6571b8" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43511 } }
I20260806 01:03:37.908085 19129 leader_election.cc:288] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a [CANDIDATE]: Term 1 election: Requested vote from peers 54c1154a37dc44bdb3e437b8a43a9d9c (127.11.88.67:34291), 6956eb0902894681952bcdca7d6571b8 (127.11.88.65:43511)
I20260806 01:03:37.908282 19043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67ed2076270b470596b12a61ca5bb3a6" candidate_uuid: "0cc705ff89a7431ba40de3ebe04ff15a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c"
I20260806 01:03:37.908365 19043 raft_consensus.cc:3037] T 67ed2076270b470596b12a61ca5bb3a6 P 54c1154a37dc44bdb3e437b8a43a9d9c [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:37.908324 18762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67ed2076270b470596b12a61ca5bb3a6" candidate_uuid: "0cc705ff89a7431ba40de3ebe04ff15a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6956eb0902894681952bcdca7d6571b8"
I20260806 01:03:37.908459 18762 raft_consensus.cc:3037] T 67ed2076270b470596b12a61ca5bb3a6 P 6956eb0902894681952bcdca7d6571b8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:37.909508 18762 raft_consensus.cc:2454] T 67ed2076270b470596b12a61ca5bb3a6 P 6956eb0902894681952bcdca7d6571b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cc705ff89a7431ba40de3ebe04ff15a in term 1.
I20260806 01:03:37.909735 18837 leader_election.cc:302] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cc705ff89a7431ba40de3ebe04ff15a, 6956eb0902894681952bcdca7d6571b8; no voters:
I20260806 01:03:37.909881 19043 raft_consensus.cc:2454] T 67ed2076270b470596b12a61ca5bb3a6 P 54c1154a37dc44bdb3e437b8a43a9d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cc705ff89a7431ba40de3ebe04ff15a in term 1.
I20260806 01:03:37.910830 19129 raft_consensus.cc:2781] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:37.911022 19129 raft_consensus.cc:686] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a [term 1 LEADER]: Becoming Leader. State: Replica: 0cc705ff89a7431ba40de3ebe04ff15a, State: Running, Role: LEADER
I20260806 01:03:37.911144 19129 consensus_queue.cc:237] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34291 } } peers { permanent_uuid: "0cc705ff89a7431ba40de3ebe04ff15a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 41757 } } peers { permanent_uuid: "6956eb0902894681952bcdca7d6571b8" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43511 } }
I20260806 01:03:37.912246 17821 catalog_manager.cc:5495] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cc705ff89a7431ba40de3ebe04ff15a (127.11.88.66). New cstate: current_term: 1 leader_uuid: "0cc705ff89a7431ba40de3ebe04ff15a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cc705ff89a7431ba40de3ebe04ff15a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 41757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6956eb0902894681952bcdca7d6571b8" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43511 } health_report { overall_health: UNKNOWN } } }
I20260806 01:03:37.919823 19122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.917257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39520 (local address 127.11.88.66:41757)
0806 01:03:37.917320 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.917321 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.917329 (+ 8us) server_negotiation.cc:407] Connection header received
0806 01:03:37.917365 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.917366 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.917382 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.917459 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:03:37.917567 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.918201 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.919031 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.919231 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.919309 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.919482 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:03:37.919599 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:03:37.919686 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.919726 (+ 40us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.919745 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 01:03:37.921998 19043 raft_consensus.cc:1261] T 67ed2076270b470596b12a61ca5bb3a6 P 54c1154a37dc44bdb3e437b8a43a9d9c [term 1 FOLLOWER]: Refusing update from remote peer 0cc705ff89a7431ba40de3ebe04ff15a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:37.922004 18762 raft_consensus.cc:1261] T 67ed2076270b470596b12a61ca5bb3a6 P 6956eb0902894681952bcdca7d6571b8 [term 1 FOLLOWER]: Refusing update from remote peer 0cc705ff89a7431ba40de3ebe04ff15a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:37.922384 19129 consensus_queue.cc:1035] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a [LEADER]: Connected to new peer: Peer: permanent_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:37.922581 19132 consensus_queue.cc:1035] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6956eb0902894681952bcdca7d6571b8" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:37.925866 19138 mvcc.cc:205] Tried to move back new op lower bound from 7315366780605157376 to 7315366780564611072. Current Snapshot: MvccSnapshot[applied={T|T < 7315366780605157376}]
I20260806 01:03:37.928877 17821 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50368:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:37.928973 17821 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50368:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:37.930323 17821 catalog_manager.cc:5782] T 00000000000000000000000000000000 P acc5d4a82f92474e873513845cc9550c: Sending DeleteTablet for 3 replicas of tablet 67ed2076270b470596b12a61ca5bb3a6
I20260806 01:03:37.930720 18882 tablet_service.cc:1514] Processing DeleteTablet for tablet 67ed2076270b470596b12a61ca5bb3a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:37 UTC) from {username='oryx', principal='oryx/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:39508
I20260806 01:03:37.930691 18742 tablet_service.cc:1514] Processing DeleteTablet for tablet 67ed2076270b470596b12a61ca5bb3a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:37 UTC) from {username='oryx', principal='oryx/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:42796
I20260806 01:03:37.931253 19147 tablet_replica.cc:330] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a: stopping tablet replica
I20260806 01:03:37.931458 19147 raft_consensus.cc:2229] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a [term 1 LEADER]: Raft consensus shutting down.
I20260806 01:03:37.931697 19147 raft_consensus.cc:2258] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:37.931988 19022 tablet_service.cc:1514] Processing DeleteTablet for tablet 67ed2076270b470596b12a61ca5bb3a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:37 UTC) from {username='oryx', principal='oryx/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:40224
I20260806 01:03:37.932350 19149 tablet_replica.cc:330] T 67ed2076270b470596b12a61ca5bb3a6 P 54c1154a37dc44bdb3e437b8a43a9d9c: stopping tablet replica
I20260806 01:03:37.932528 19149 raft_consensus.cc:2229] T 67ed2076270b470596b12a61ca5bb3a6 P 54c1154a37dc44bdb3e437b8a43a9d9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:03:37.932818 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 17790
I20260806 01:03:37.932832 19146 tablet_replica.cc:330] T 67ed2076270b470596b12a61ca5bb3a6 P 6956eb0902894681952bcdca7d6571b8: stopping tablet replica
I20260806 01:03:37.932932 19146 raft_consensus.cc:2229] T 67ed2076270b470596b12a61ca5bb3a6 P 6956eb0902894681952bcdca7d6571b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:03:37.933022 19146 raft_consensus.cc:2258] T 67ed2076270b470596b12a61ca5bb3a6 P 6956eb0902894681952bcdca7d6571b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:37.933495 19146 ts_tablet_manager.cc:1905] T 67ed2076270b470596b12a61ca5bb3a6 P 6956eb0902894681952bcdca7d6571b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:37.935702 19146 ts_tablet_manager.cc:1918] T 67ed2076270b470596b12a61ca5bb3a6 P 6956eb0902894681952bcdca7d6571b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:03:37.935791 19146 log.cc:1196] T 67ed2076270b470596b12a61ca5bb3a6 P 6956eb0902894681952bcdca7d6571b8: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-0/wal/wals/67ed2076270b470596b12a61ca5bb3a6
I20260806 01:03:37.936151 19146 ts_tablet_manager.cc:1939] T 67ed2076270b470596b12a61ca5bb3a6 P 6956eb0902894681952bcdca7d6571b8: Deleting consensus metadata
I20260806 01:03:37.939908 18814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.931459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39106 (local address 127.11.88.124:34625)
0806 01:03:37.931502 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.931504 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.931512 (+ 8us) server_negotiation.cc:407] Connection header received
0806 01:03:37.931532 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.931532 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.931542 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.931594 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:37.932724 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.933477 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.934861 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.935136 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.935195 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.937087 (+ 1892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:37.937089 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:37.937089 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:37.937098 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:37.938719 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.939075 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.939077 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.939077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.939136 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.939366 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.939367 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.939367 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.939488 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:37.939591 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.939715 (+ 124us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.939798 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 01:03:37.942365 19147 ts_tablet_manager.cc:1905] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:37.932711 19149 raft_consensus.cc:2258] T 67ed2076270b470596b12a61ca5bb3a6 P 54c1154a37dc44bdb3e437b8a43a9d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:37.944087 19147 ts_tablet_manager.cc:1918] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:03:37.944204 19147 log.cc:1196] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/wal/wals/67ed2076270b470596b12a61ca5bb3a6
I20260806 01:03:37.944554 19147 ts_tablet_manager.cc:1939] T 67ed2076270b470596b12a61ca5bb3a6 P 0cc705ff89a7431ba40de3ebe04ff15a: Deleting consensus metadata
W20260806 01:03:37.944546 18695 connection.cc:535] server connection from 127.0.0.1:42796 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260806 01:03:37.944998 18835 connection.cc:441] server connection from 127.0.0.1:39508 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39508 (request call id 1) could send its response
I20260806 01:03:37.945395 19149 ts_tablet_manager.cc:1905] T 67ed2076270b470596b12a61ca5bb3a6 P 54c1154a37dc44bdb3e437b8a43a9d9c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:37.947245 19149 ts_tablet_manager.cc:1918] T 67ed2076270b470596b12a61ca5bb3a6 P 54c1154a37dc44bdb3e437b8a43a9d9c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:03:37.947351 19149 log.cc:1196] T 67ed2076270b470596b12a61ca5bb3a6 P 54c1154a37dc44bdb3e437b8a43a9d9c: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/wal/wals/67ed2076270b470596b12a61ca5bb3a6
I20260806 01:03:37.947706 19149 ts_tablet_manager.cc:1939] T 67ed2076270b470596b12a61ca5bb3a6 P 54c1154a37dc44bdb3e437b8a43a9d9c: Deleting consensus metadata
W20260806 01:03:37.948993 18978 connection.cc:441] server connection from 127.0.0.1:40224 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40224 (request call id 1) could send its response
I20260806 01:03:37.955729 18814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.946858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39118 (local address 127.11.88.124:34625)
0806 01:03:37.946906 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.946908 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.947088 (+ 180us) server_negotiation.cc:407] Connection header received
0806 01:03:37.947195 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.947196 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.947256 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.947287 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:37.948093 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.948891 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.950155 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.950508 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.950629 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.952509 (+ 1880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:37.952511 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:37.952511 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:37.952520 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:37.954367 (+ 1847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.954788 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.954789 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.954790 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.954849 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.955040 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.955040 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.955041 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.955165 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:37.955245 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.955493 (+ 248us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.955607 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 01:03:37.956363 19107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:37.947264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34914 (local address 127.11.88.125:38547)
0806 01:03:37.947315 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:37.947317 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:37.947613 (+ 296us) server_negotiation.cc:407] Connection header received
0806 01:03:37.947735 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:37.947737 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:37.947755 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:37.947798 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:37.949153 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.949678 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.951004 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:37.951352 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:37.951422 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:37.953194 (+ 1772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:37.953196 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:37.953196 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:37.953210 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:37.955046 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.955468 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.955470 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.955470 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.955536 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:37.955776 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:37.955778 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:37.955778 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:37.955918 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:37.956020 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:37.956172 (+ 152us) server_negotiation.cc:299] Negotiation successful
0806 01:03:37.956268 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 01:03:38.927630 19156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:38.927307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.11.88.67:42059)
0806 01:03:38.927470 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:38.927566 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":72,"threads_started":1}
I20260806 01:03:38.927676 19157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:38.927309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.11.88.66:35163)
0806 01:03:38.927471 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:38.927613 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":69,"threads_started":1}
W20260806 01:03:38.927994 18950 heartbeater.cc:644] Failed to heartbeat to 127.11.88.126:45409 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
W20260806 01:03:38.928110 19091 heartbeater.cc:644] Failed to heartbeat to 127.11.88.126:45409 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
I20260806 01:03:38.928926 19158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:38.928696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.11.88.65:39331)
0806 01:03:38.928821 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:38.928889 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":70,"threads_started":1}
W20260806 01:03:38.929126 18810 heartbeater.cc:644] Failed to heartbeat to 127.11.88.126:45409 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
I20260806 01:03:39.431221 19159 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader acc5d4a82f92474e873513845cc9550c)
I20260806 01:03:39.431427 19159 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: false } }
I20260806 01:03:39.431833 19159 leader_election.cc:288] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers acc5d4a82f92474e873513845cc9550c (127.11.88.126:45409), 92cdedeae7ad4a7ca6ce1891eecf885b (127.11.88.125:38547)
I20260806 01:03:39.432153 19160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.431929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.0.0.1:46240)
0806 01:03:39.432048 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.432098 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":62,"threads_started":1}
I20260806 01:03:39.432199 19161 raft_consensus.cc:482] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader acc5d4a82f92474e873513845cc9550c)
W20260806 01:03:39.432377 18611 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
I20260806 01:03:39.432345 19161 raft_consensus.cc:504] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: false } }
I20260806 01:03:39.432888 19161 leader_election.cc:288] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers acc5d4a82f92474e873513845cc9550c (127.11.88.126:45409), 4cb70d80d509438eacfbbd231d7d0589 (127.11.88.124:34625)
I20260806 01:03:39.432895 19164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.432671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.0.0.1:46256)
0806 01:03:39.432793 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.432849 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":64,"threads_started":1}
W20260806 01:03:39.433192 18418 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
I20260806 01:03:39.433388 19166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.432746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.0.0.1:46264)
0806 01:03:39.433326 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.433357 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":51,"threads_started":1}
W20260806 01:03:39.433468 18611 leader_election.cc:334] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer acc5d4a82f92474e873513845cc9550c (127.11.88.126:45409): Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
I20260806 01:03:39.434221 19164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.434092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.0.0.1:46272)
0806 01:03:39.434150 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.434193 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260806 01:03:39.434360 18418 leader_election.cc:334] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer acc5d4a82f92474e873513845cc9550c (127.11.88.126:45409): Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
I20260806 01:03:39.435894 19162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.432323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36266 (local address 127.11.88.125:38547)
0806 01:03:39.432428 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:39.432430 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:39.432889 (+ 459us) server_negotiation.cc:407] Connection header received
0806 01:03:39.433013 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:39.433014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:39.433026 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:39.433064 (+ 38us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:39.433298 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.434082 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.435181 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.435546 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.435629 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:39.435641 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:39.435788 (+ 147us) server_negotiation.cc:299] Negotiation successful
0806 01:03:39.435828 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83,"thread_start_us":51,"threads_started":1}
I20260806 01:03:39.435892 19160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.432246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:38547 (local address 127.0.0.1:36266)
0806 01:03:39.432829 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.432839 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:39.432923 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:39.433136 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:39.433137 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:39.433140 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:39.433193 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:39.433194 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.434172 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.434173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:39.435067 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:39.435070 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.435629 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.435630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:39.435702 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:39.435706 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:03:39.435783 (+ 77us) client_negotiation.cc:240] Negotiation successful
0806 01:03:39.435828 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569}
I20260806 01:03:39.436110 18444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4cb70d80d509438eacfbbd231d7d0589" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" is_pre_election: true
I20260806 01:03:39.436235 18444 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cb70d80d509438eacfbbd231d7d0589 in term 1.
I20260806 01:03:39.436237 19165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.432707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:34625 (local address 127.0.0.1:52160)
0806 01:03:39.432999 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.433010 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:39.433072 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:39.433363 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:39.433364 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:39.433366 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:39.433425 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:39.433427 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.434511 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.434512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:39.435343 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:39.435346 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.435988 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.435989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:39.436075 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:39.436080 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 01:03:39.436112 (+ 32us) client_negotiation.cc:240] Negotiation successful
0806 01:03:39.436153 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":38,"threads_started":1}
I20260806 01:03:39.436465 18612 leader_election.cc:302] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cb70d80d509438eacfbbd231d7d0589, 92cdedeae7ad4a7ca6ce1891eecf885b; no voters: acc5d4a82f92474e873513845cc9550c
I20260806 01:03:39.436535 19167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.432921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52160 (local address 127.11.88.124:34625)
0806 01:03:39.433178 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:39.433180 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:39.433188 (+ 8us) server_negotiation.cc:407] Connection header received
0806 01:03:39.433238 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:39.433239 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:39.433251 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:39.433522 (+ 271us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:39.433566 (+ 44us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.434389 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.435460 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.435873 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.436288 (+ 415us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:39.436303 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:39.436326 (+ 23us) server_negotiation.cc:299] Negotiation successful
0806 01:03:39.436451 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":82,"threads_started":1}
I20260806 01:03:39.436609 19159 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260806 01:03:39.436686 19159 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [term 1 FOLLOWER]: Starting leader election (detected failure of leader acc5d4a82f92474e873513845cc9550c)
I20260806 01:03:39.436712 19159 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [term 1 FOLLOWER]: Advancing to term 2
I20260806 01:03:39.436810 18627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "4cb70d80d509438eacfbbd231d7d0589" is_pre_election: true
I20260806 01:03:39.437654 19159 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: false } }
I20260806 01:03:39.437849 18627 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92cdedeae7ad4a7ca6ce1891eecf885b in current term 2: Already voted for candidate 4cb70d80d509438eacfbbd231d7d0589 in this term.
I20260806 01:03:39.437862 19159 leader_election.cc:288] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [CANDIDATE]: Term 2 election: Requested vote from peers acc5d4a82f92474e873513845cc9550c (127.11.88.126:45409), 92cdedeae7ad4a7ca6ce1891eecf885b (127.11.88.125:38547)
I20260806 01:03:39.438058 19160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.437952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.0.0.1:46288)
0806 01:03:39.437988 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.438018 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260806 01:03:39.438007 18444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4cb70d80d509438eacfbbd231d7d0589" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b"
I20260806 01:03:39.438117 18444 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [term 1 FOLLOWER]: Advancing to term 2
I20260806 01:03:39.438524 18417 leader_election.cc:302] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92cdedeae7ad4a7ca6ce1891eecf885b; no voters: 4cb70d80d509438eacfbbd231d7d0589, acc5d4a82f92474e873513845cc9550c
I20260806 01:03:39.438927 18444 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cb70d80d509438eacfbbd231d7d0589 in term 2.
I20260806 01:03:39.439092 19161 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 01:03:39.439108 18612 leader_election.cc:302] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cb70d80d509438eacfbbd231d7d0589, 92cdedeae7ad4a7ca6ce1891eecf885b; no voters:
I20260806 01:03:39.439204 19159 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 01:03:39.439352 19160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.439240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.0.0.1:46298)
0806 01:03:39.439286 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.439323 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260806 01:03:39.439356 19159 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [term 2 LEADER]: Becoming Leader. State: Replica: 4cb70d80d509438eacfbbd231d7d0589, State: Running, Role: LEADER
W20260806 01:03:39.439435 18611 leader_election.cc:334] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer acc5d4a82f92474e873513845cc9550c (127.11.88.126:45409): Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
I20260806 01:03:39.439471 19159 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: false } }
I20260806 01:03:39.439857 19169 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4cb70d80d509438eacfbbd231d7d0589. Latest consensus state: current_term: 2 leader_uuid: "4cb70d80d509438eacfbbd231d7d0589" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: false } } }
I20260806 01:03:39.439957 19169 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:39.440153 19171 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:03:39.440676 19171 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:03:39.440778 19171 catalog_manager.cc:1259] Loaded cluster ID: f9a0b39ee4ba48bca7246ff8cb183476
I20260806 01:03:39.440834 19171 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:03:39.441020 19171 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:03:39.441110 19171 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589: Loaded TSK: 0
I20260806 01:03:39.441267 19171 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:03:39.496411 18625 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39118:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 01:03:39.498232 18625 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:03:39.499392 19160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.499258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.0.0.1:46318)
0806 01:03:39.499321 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.499362 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260806 01:03:39.499435 18444 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [term 2 FOLLOWER]: Refusing update from remote peer 4cb70d80d509438eacfbbd231d7d0589: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260806 01:03:39.499693 19159 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260806 01:03:39.499814 19160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.499698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.0.0.1:46330)
0806 01:03:39.499754 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.499781 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260806 01:03:39.499969 18611 consensus_peers.cc:487] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 -> Peer acc5d4a82f92474e873513845cc9550c (127.11.88.126:45409): Couldn't send request to peer acc5d4a82f92474e873513845cc9550c. Status: Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260806 01:03:39.500517 19161 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4cb70d80d509438eacfbbd231d7d0589. Latest consensus state: current_term: 2 leader_uuid: "4cb70d80d509438eacfbbd231d7d0589" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: false } } }
I20260806 01:03:39.500660 19161 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [sys.catalog]: This master's current role is: FOLLOWER
I20260806 01:03:39.501077 19159 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "4cb70d80d509438eacfbbd231d7d0589" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: false } } }
I20260806 01:03:39.501166 19159 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589 [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:39.501279 19161 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "4cb70d80d509438eacfbbd231d7d0589" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "acc5d4a82f92474e873513845cc9550c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45409 } } peers { permanent_uuid: "92cdedeae7ad4a7ca6ce1891eecf885b" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38547 } attrs { promote: false } } peers { permanent_uuid: "4cb70d80d509438eacfbbd231d7d0589" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34625 } attrs { promote: false } } }
I20260806 01:03:39.501365 19161 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92cdedeae7ad4a7ca6ce1891eecf885b [sys.catalog]: This master's current role is: FOLLOWER
I20260806 01:03:39.506702 19178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.503389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58576 (local address 127.11.88.65:43511)
0806 01:03:39.503624 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:39.503626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:39.503636 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:03:39.503664 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:39.503665 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:39.503676 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:39.503776 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:39.503930 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.504512 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.505883 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.506312 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.506455 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:39.506497 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:39.506597 (+ 100us) server_negotiation.cc:299] Negotiation successful
0806 01:03:39.506634 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":70,"threads_started":1}
I20260806 01:03:39.506700 19160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.503322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:43511 (local address 127.0.0.1:58576)
0806 01:03:39.503355 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.503366 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:39.503409 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:39.503783 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:39.503784 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:39.503786 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:39.503840 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:39.503842 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.504614 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.504614 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:39.505760 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:39.505762 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.506454 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.506455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:39.506518 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:39.506523 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 01:03:39.506588 (+ 65us) client_negotiation.cc:240] Negotiation successful
0806 01:03:39.506629 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16,"mutex_wait_us":2}
I20260806 01:03:39.506882 19166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.503368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:34291 (local address 127.0.0.1:49014)
0806 01:03:39.503476 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.503484 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:39.503520 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:39.503783 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:39.503784 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:39.503786 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:39.503846 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:39.503848 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.504800 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.504800 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:39.505892 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:39.505894 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.506626 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.506627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:39.506715 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:39.506720 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 01:03:39.506751 (+ 31us) client_negotiation.cc:240] Negotiation successful
0806 01:03:39.506800 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"mutex_wait_us":23}
I20260806 01:03:39.507050 19181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.503613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47542 (local address 127.11.88.66:41757)
0806 01:03:39.503728 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:39.503730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:39.503738 (+ 8us) server_negotiation.cc:407] Connection header received
0806 01:03:39.503938 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:39.503940 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:39.503951 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:39.504014 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:39.504149 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.504856 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.505873 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.506586 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.506645 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:39.506659 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:39.506911 (+ 252us) server_negotiation.cc:299] Negotiation successful
0806 01:03:39.506961 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":59,"threads_started":1}
I20260806 01:03:39.506886 19179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.503434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:41757 (local address 127.0.0.1:47542)
0806 01:03:39.503544 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.503555 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:39.503851 (+ 296us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:39.504032 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:39.504033 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:39.504035 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:39.504074 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:39.504076 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.504944 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.504945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:39.505770 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:39.505773 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.506688 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.506689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:39.506740 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:39.506744 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:03:39.506790 (+ 46us) client_negotiation.cc:240] Negotiation successful
0806 01:03:39.506820 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87,"mutex_wait_us":2,"thread_start_us":65,"threads_started":1}
I20260806 01:03:39.507242 19180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.503474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49014 (local address 127.11.88.67:34291)
0806 01:03:39.503624 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:39.503626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:39.503635 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:03:39.503664 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:39.503665 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:39.503676 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:39.503915 (+ 239us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:39.503956 (+ 41us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.504722 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.505971 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.506522 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.507072 (+ 550us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:39.507089 (+ 17us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:39.507110 (+ 21us) server_negotiation.cc:299] Negotiation successful
0806 01:03:39.507157 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":55,"threads_started":1}
I20260806 01:03:39.507279 18742 tablet_service.cc:1467] Processing CreateTablet for tablet 1446bc2a7cbe44a68c8ad4c6718abe72 (DEFAULT_TABLE table=test-table [id=eefc4b2836a24849871ff608b5c6aa6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:39.507426 18742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1446bc2a7cbe44a68c8ad4c6718abe72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:39.507506 19022 tablet_service.cc:1467] Processing CreateTablet for tablet 1446bc2a7cbe44a68c8ad4c6718abe72 (DEFAULT_TABLE table=test-table [id=eefc4b2836a24849871ff608b5c6aa6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:39.507637 19022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1446bc2a7cbe44a68c8ad4c6718abe72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:39.508873 19182 tablet_bootstrap.cc:492] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 6956eb0902894681952bcdca7d6571b8: Bootstrap starting.
I20260806 01:03:39.508859 18882 tablet_service.cc:1467] Processing CreateTablet for tablet 1446bc2a7cbe44a68c8ad4c6718abe72 (DEFAULT_TABLE table=test-table [id=eefc4b2836a24849871ff608b5c6aa6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:39.508976 18882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1446bc2a7cbe44a68c8ad4c6718abe72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:39.509250 19182 tablet_bootstrap.cc:654] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 6956eb0902894681952bcdca7d6571b8: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:39.509963 19182 tablet_bootstrap.cc:492] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 6956eb0902894681952bcdca7d6571b8: No bootstrap required, opened a new log
I20260806 01:03:39.509955 19183 tablet_bootstrap.cc:492] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c: Bootstrap starting.
I20260806 01:03:39.510021 19182 ts_tablet_manager.cc:1397] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 6956eb0902894681952bcdca7d6571b8: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:39.510169 19182 raft_consensus.cc:348] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 6956eb0902894681952bcdca7d6571b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6956eb0902894681952bcdca7d6571b8" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43511 } } peers { permanent_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34291 } } peers { permanent_uuid: "0cc705ff89a7431ba40de3ebe04ff15a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 41757 } }
I20260806 01:03:39.510246 19182 raft_consensus.cc:374] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 6956eb0902894681952bcdca7d6571b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:39.510272 19182 raft_consensus.cc:729] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 6956eb0902894681952bcdca7d6571b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6956eb0902894681952bcdca7d6571b8, State: Initialized, Role: FOLLOWER
I20260806 01:03:39.510345 19182 consensus_queue.cc:260] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 6956eb0902894681952bcdca7d6571b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6956eb0902894681952bcdca7d6571b8" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43511 } } peers { permanent_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34291 } } peers { permanent_uuid: "0cc705ff89a7431ba40de3ebe04ff15a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 41757 } }
I20260806 01:03:39.510432 19183 tablet_bootstrap.cc:654] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:39.510537 19182 ts_tablet_manager.cc:1428] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 6956eb0902894681952bcdca7d6571b8: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260806 01:03:39.510680 19186 tablet_bootstrap.cc:492] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 0cc705ff89a7431ba40de3ebe04ff15a: Bootstrap starting.
I20260806 01:03:39.511050 19186 tablet_bootstrap.cc:654] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 0cc705ff89a7431ba40de3ebe04ff15a: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:39.511548 18809 heartbeater.cc:503] Master 127.11.88.124:34625 was elected leader, sending a full tablet report...
I20260806 01:03:39.511689 19188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.510839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.11.88.65:47095)
0806 01:03:39.511602 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.511644 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":740,"thread_start_us":82,"threads_started":1}
I20260806 01:03:39.512072 19188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.511909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.11.88.65:59369)
0806 01:03:39.512018 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.512043 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":73,"threads_started":1}
I20260806 01:03:39.512151 19186 tablet_bootstrap.cc:492] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 0cc705ff89a7431ba40de3ebe04ff15a: No bootstrap required, opened a new log
I20260806 01:03:39.512207 19186 ts_tablet_manager.cc:1397] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 0cc705ff89a7431ba40de3ebe04ff15a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 01:03:39.512331 19186 raft_consensus.cc:348] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 0cc705ff89a7431ba40de3ebe04ff15a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6956eb0902894681952bcdca7d6571b8" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43511 } } peers { permanent_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34291 } } peers { permanent_uuid: "0cc705ff89a7431ba40de3ebe04ff15a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 41757 } }
I20260806 01:03:39.512418 19186 raft_consensus.cc:374] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 0cc705ff89a7431ba40de3ebe04ff15a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:39.512441 19186 raft_consensus.cc:729] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 0cc705ff89a7431ba40de3ebe04ff15a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cc705ff89a7431ba40de3ebe04ff15a, State: Initialized, Role: FOLLOWER
I20260806 01:03:39.512490 19183 tablet_bootstrap.cc:492] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c: No bootstrap required, opened a new log
I20260806 01:03:39.512511 19186 consensus_queue.cc:260] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 0cc705ff89a7431ba40de3ebe04ff15a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6956eb0902894681952bcdca7d6571b8" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43511 } } peers { permanent_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34291 } } peers { permanent_uuid: "0cc705ff89a7431ba40de3ebe04ff15a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 41757 } }
I20260806 01:03:39.512539 19183 ts_tablet_manager.cc:1397] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260806 01:03:39.512665 19186 ts_tablet_manager.cc:1428] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 0cc705ff89a7431ba40de3ebe04ff15a: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260806 01:03:39.512681 19183 raft_consensus.cc:348] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6956eb0902894681952bcdca7d6571b8" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43511 } } peers { permanent_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34291 } } peers { permanent_uuid: "0cc705ff89a7431ba40de3ebe04ff15a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 41757 } }
I20260806 01:03:39.512753 19183 raft_consensus.cc:374] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:39.512779 19183 raft_consensus.cc:729] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54c1154a37dc44bdb3e437b8a43a9d9c, State: Initialized, Role: FOLLOWER
I20260806 01:03:39.512820 19183 consensus_queue.cc:260] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6956eb0902894681952bcdca7d6571b8" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43511 } } peers { permanent_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34291 } } peers { permanent_uuid: "0cc705ff89a7431ba40de3ebe04ff15a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 41757 } }
I20260806 01:03:39.512986 19183 ts_tablet_manager.cc:1428] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260806 01:03:39.513335 18949 heartbeater.cc:503] Master 127.11.88.124:34625 was elected leader, sending a full tablet report...
I20260806 01:03:39.513582 19090 heartbeater.cc:503] Master 127.11.88.124:34625 was elected leader, sending a full tablet report...
I20260806 01:03:39.513896 19194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.513647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.11.88.66:33687)
0806 01:03:39.513774 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.513859 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":85,"threads_started":1}
I20260806 01:03:39.513926 19193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.513184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.11.88.67:53079)
0806 01:03:39.513850 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.513888 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":95,"threads_started":1}
I20260806 01:03:39.514227 19193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.514150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.11.88.67:57551)
0806 01:03:39.514184 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.514203 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260806 01:03:39.688517 19192 raft_consensus.cc:482] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:03:39.688670 19192 raft_consensus.cc:504] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6956eb0902894681952bcdca7d6571b8" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43511 } } peers { permanent_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34291 } } peers { permanent_uuid: "0cc705ff89a7431ba40de3ebe04ff15a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 41757 } }
I20260806 01:03:39.689078 19192 leader_election.cc:288] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6956eb0902894681952bcdca7d6571b8 (127.11.88.65:43511), 0cc705ff89a7431ba40de3ebe04ff15a (127.11.88.66:41757)
I20260806 01:03:39.692616 19193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.689290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:41757 (local address 127.11.88.67:47573)
0806 01:03:39.689342 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.689363 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:39.689428 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:39.689632 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:39.689634 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:39.689637 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:39.689771 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:39.689773 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.690639 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.690640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:39.691628 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:39.691630 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.692333 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.692334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:39.692405 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:39.692410 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 01:03:39.692478 (+ 68us) client_negotiation.cc:240] Negotiation successful
0806 01:03:39.692526 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29,"mutex_wait_us":51}
I20260806 01:03:39.692677 19181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.689390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:47573 (local address 127.11.88.66:41757)
0806 01:03:39.689443 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:39.689445 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:39.689456 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:03:39.689492 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:39.689493 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:39.689504 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:39.689592 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:39.689925 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.690538 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.691733 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.692251 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.692312 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:39.692320 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:39.692500 (+ 180us) server_negotiation.cc:299] Negotiation successful
0806 01:03:39.692545 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 01:03:39.692826 19195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.689290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:43511 (local address 127.11.88.67:51913)
0806 01:03:39.689533 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.689545 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:39.689607 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:39.689779 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:39.689780 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:39.689783 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:39.689880 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:39.689883 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.690669 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.690671 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:39.691719 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:39.691722 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.692530 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.692531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:39.692596 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:39.692601 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 01:03:39.692668 (+ 67us) client_negotiation.cc:240] Negotiation successful
0806 01:03:39.692715 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"mutex_wait_us":56,"thread_start_us":124,"threads_started":1}
I20260806 01:03:39.692852 19178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.689390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:51913 (local address 127.11.88.65:43511)
0806 01:03:39.689443 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:39.689445 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:39.689626 (+ 181us) server_negotiation.cc:407] Connection header received
0806 01:03:39.689663 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:39.689664 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:39.689677 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:39.689764 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:39.689999 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.690529 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.691861 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.692407 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.692490 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:39.692500 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:39.692687 (+ 187us) server_negotiation.cc:299] Negotiation successful
0806 01:03:39.692740 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 01:03:39.692911 18902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1446bc2a7cbe44a68c8ad4c6718abe72" candidate_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cc705ff89a7431ba40de3ebe04ff15a" is_pre_election: true
I20260806 01:03:39.693063 18902 raft_consensus.cc:2454] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 0cc705ff89a7431ba40de3ebe04ff15a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54c1154a37dc44bdb3e437b8a43a9d9c in term 0.
I20260806 01:03:39.693341 18976 leader_election.cc:302] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cc705ff89a7431ba40de3ebe04ff15a, 54c1154a37dc44bdb3e437b8a43a9d9c; no voters:
I20260806 01:03:39.693506 19192 raft_consensus.cc:2781] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:03:39.693575 19192 raft_consensus.cc:482] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:03:39.693602 19192 raft_consensus.cc:3037] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:39.693603 18762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1446bc2a7cbe44a68c8ad4c6718abe72" candidate_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6956eb0902894681952bcdca7d6571b8" is_pre_election: true
I20260806 01:03:39.693734 18762 raft_consensus.cc:2454] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 6956eb0902894681952bcdca7d6571b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54c1154a37dc44bdb3e437b8a43a9d9c in term 0.
I20260806 01:03:39.694468 19192 raft_consensus.cc:504] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6956eb0902894681952bcdca7d6571b8" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43511 } } peers { permanent_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34291 } } peers { permanent_uuid: "0cc705ff89a7431ba40de3ebe04ff15a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 41757 } }
I20260806 01:03:39.694643 19192 leader_election.cc:288] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c [CANDIDATE]: Term 1 election: Requested vote from peers 6956eb0902894681952bcdca7d6571b8 (127.11.88.65:43511), 0cc705ff89a7431ba40de3ebe04ff15a (127.11.88.66:41757)
I20260806 01:03:39.694849 18762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1446bc2a7cbe44a68c8ad4c6718abe72" candidate_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6956eb0902894681952bcdca7d6571b8"
I20260806 01:03:39.694937 18762 raft_consensus.cc:3037] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 6956eb0902894681952bcdca7d6571b8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:39.694881 18902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1446bc2a7cbe44a68c8ad4c6718abe72" candidate_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cc705ff89a7431ba40de3ebe04ff15a"
I20260806 01:03:39.694998 18902 raft_consensus.cc:3037] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 0cc705ff89a7431ba40de3ebe04ff15a [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:39.695567 18762 raft_consensus.cc:2454] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 6956eb0902894681952bcdca7d6571b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54c1154a37dc44bdb3e437b8a43a9d9c in term 1.
I20260806 01:03:39.695739 18902 raft_consensus.cc:2454] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 0cc705ff89a7431ba40de3ebe04ff15a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54c1154a37dc44bdb3e437b8a43a9d9c in term 1.
I20260806 01:03:39.695809 18978 leader_election.cc:302] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54c1154a37dc44bdb3e437b8a43a9d9c, 6956eb0902894681952bcdca7d6571b8; no voters:
I20260806 01:03:39.695904 19192 raft_consensus.cc:2781] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:39.696105 19192 raft_consensus.cc:686] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c [term 1 LEADER]: Becoming Leader. State: Replica: 54c1154a37dc44bdb3e437b8a43a9d9c, State: Running, Role: LEADER
I20260806 01:03:39.696178 19192 consensus_queue.cc:237] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6956eb0902894681952bcdca7d6571b8" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43511 } } peers { permanent_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34291 } } peers { permanent_uuid: "0cc705ff89a7431ba40de3ebe04ff15a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 41757 } }
I20260806 01:03:39.696790 19195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.696440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.11.88.67:50877)
0806 01:03:39.696717 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.696755 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":242}
I20260806 01:03:39.697028 18626 catalog_manager.cc:5495] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 54c1154a37dc44bdb3e437b8a43a9d9c (127.11.88.67). New cstate: current_term: 1 leader_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6956eb0902894681952bcdca7d6571b8" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54c1154a37dc44bdb3e437b8a43a9d9c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cc705ff89a7431ba40de3ebe04ff15a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 41757 } health_report { overall_health: UNKNOWN } } }
I20260806 01:03:39.734155 19180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.731560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49018 (local address 127.11.88.67:34291)
0806 01:03:39.731613 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:39.731615 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:39.731668 (+ 53us) server_negotiation.cc:407] Connection header received
0806 01:03:39.731729 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:39.731730 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:39.731752 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:39.731838 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:03:39.732001 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.732503 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.733364 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:39.733556 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:39.733617 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:39.733789 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:03:39.733913 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:03:39.733969 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:39.734012 (+ 43us) server_negotiation.cc:299] Negotiation successful
0806 01:03:39.734031 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 01:03:39.735368 18762 raft_consensus.cc:1261] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 6956eb0902894681952bcdca7d6571b8 [term 1 FOLLOWER]: Refusing update from remote peer 54c1154a37dc44bdb3e437b8a43a9d9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:39.735605 18902 raft_consensus.cc:1261] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 0cc705ff89a7431ba40de3ebe04ff15a [term 1 FOLLOWER]: Refusing update from remote peer 54c1154a37dc44bdb3e437b8a43a9d9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:39.735663 19192 consensus_queue.cc:1035] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6956eb0902894681952bcdca7d6571b8" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:39.735957 19192 consensus_queue.cc:1035] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cc705ff89a7431ba40de3ebe04ff15a" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 41757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:39.736595 19190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.736335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.11.88.65:54989)
0806 01:03:39.736495 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.736545 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131}
I20260806 01:03:39.737937 19194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.737807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.11.88.66:33055)
0806 01:03:39.737870 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.737899 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260806 01:03:39.738197 19195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.737799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.11.88.67:47463)
0806 01:03:39.738127 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.738162 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":309}
I20260806 01:03:39.738523 19190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.738430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.11.88.65:53687)
0806 01:03:39.738468 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.738494 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260806 01:03:39.738746 19200 mvcc.cc:205] Tried to move back new op lower bound from 7315366788033802240 to 7315366787876392960. Current Snapshot: MvccSnapshot[applied={T|T < 7315366788033802240 or (T in {7315366788033802240})}]
I20260806 01:03:39.739023 19202 mvcc.cc:205] Tried to move back new op lower bound from 7315366788033802240 to 7315366787876392960. Current Snapshot: MvccSnapshot[applied={T|T < 7315366788033802240}]
I20260806 01:03:39.739337 19195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.739234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.11.88.67:55493)
0806 01:03:39.739286 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.739309 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260806 01:03:39.739337 19194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.739247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45409 (local address 127.11.88.66:38855)
0806 01:03:39.739285 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.739309 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:45409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260806 01:03:39.741236 18625 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39118:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:39.741350 18625 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39118:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:39.743286 18625 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4cb70d80d509438eacfbbd231d7d0589: Sending DeleteTablet for 3 replicas of tablet 1446bc2a7cbe44a68c8ad4c6718abe72
I20260806 01:03:39.743685 18742 tablet_service.cc:1514] Processing DeleteTablet for tablet 1446bc2a7cbe44a68c8ad4c6718abe72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:39 UTC) from {username='oryx', principal='oryx/127.11.88.124@KRBTEST.COM'} at 127.0.0.1:58576
I20260806 01:03:39.743745 19022 tablet_service.cc:1514] Processing DeleteTablet for tablet 1446bc2a7cbe44a68c8ad4c6718abe72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:39 UTC) from {username='oryx', principal='oryx/127.11.88.124@KRBTEST.COM'} at 127.0.0.1:49014
I20260806 01:03:39.743953 19210 tablet_replica.cc:330] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c: stopping tablet replica
I20260806 01:03:39.744014 19210 raft_consensus.cc:2229] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c [term 1 LEADER]: Raft consensus shutting down.
I20260806 01:03:39.744114 19210 raft_consensus.cc:2258] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:39.744172 18882 tablet_service.cc:1514] Processing DeleteTablet for tablet 1446bc2a7cbe44a68c8ad4c6718abe72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:39 UTC) from {username='oryx', principal='oryx/127.11.88.124@KRBTEST.COM'} at 127.0.0.1:47542
I20260806 01:03:39.744482 19210 ts_tablet_manager.cc:1905] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:39.744620 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 18586
I20260806 01:03:39.748172 19211 tablet_replica.cc:330] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 0cc705ff89a7431ba40de3ebe04ff15a: stopping tablet replica
I20260806 01:03:39.748319 19211 raft_consensus.cc:2229] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 0cc705ff89a7431ba40de3ebe04ff15a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:03:39.748379 19211 raft_consensus.cc:2258] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 0cc705ff89a7431ba40de3ebe04ff15a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:39.748622 19210 ts_tablet_manager.cc:1918] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:03:39.748755 19210 log.cc:1196] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-2/wal/wals/1446bc2a7cbe44a68c8ad4c6718abe72
I20260806 01:03:39.748832 19211 ts_tablet_manager.cc:1905] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 0cc705ff89a7431ba40de3ebe04ff15a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:39.749145 19210 ts_tablet_manager.cc:1939] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 54c1154a37dc44bdb3e437b8a43a9d9c: Deleting consensus metadata
I20260806 01:03:39.749588 18610 catalog_manager.cc:4841] TS 54c1154a37dc44bdb3e437b8a43a9d9c (127.11.88.67:34291): tablet 1446bc2a7cbe44a68c8ad4c6718abe72 (table test-table [id=eefc4b2836a24849871ff608b5c6aa6f]) successfully deleted
I20260806 01:03:39.750618 19211 ts_tablet_manager.cc:1918] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 0cc705ff89a7431ba40de3ebe04ff15a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:03:39.750695 19211 log.cc:1196] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 0cc705ff89a7431ba40de3ebe04ff15a: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785978186227899-11617-0/minicluster-data/ts-1/wal/wals/1446bc2a7cbe44a68c8ad4c6718abe72
I20260806 01:03:39.750953 19211 ts_tablet_manager.cc:1939] T 1446bc2a7cbe44a68c8ad4c6718abe72 P 0cc705ff89a7431ba40de3ebe04ff15a: Deleting consensus metadata
I20260806 01:03:39.751348 18612 catalog_manager.cc:4841] TS 0cc705ff89a7431ba40de3ebe04ff15a (127.11.88.66:41757): tablet 1446bc2a7cbe44a68c8ad4c6718abe72 (table test-table [id=eefc4b2836a24849871ff608b5c6aa6f]) successfully deleted
I20260806 01:03:39.752774 19179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:39.752609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:43511 (local address 127.0.0.1:58592)
0806 01:03:39.752692 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:39.752744 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.65:43511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260806 01:03:39.752980 18613 catalog_manager.cc:4584] TS 6956eb0902894681952bcdca7d6571b8 (127.11.88.65:43511): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1446bc2a7cbe44a68c8ad4c6718abe72: Network error: Client connection negotiation failed: client connection to 127.11.88.65:43511: connect: Connection refused (error 111)
I20260806 01:03:39.753191 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 18817
I20260806 01:03:39.761081 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 18956
I20260806 01:03:39.767200 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 18294
I20260806 01:03:39.772722 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 18491
2026-08-06T01:03:39Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5049 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:03:39 dist-test-slave-69rg krb5kdc[19215](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:03:39 dist-test-slave-69rg krb5kdc[19215](info): set up 2 sockets
Aug 06 01:03:39 dist-test-slave-69rg krb5kdc[19215](info): commencing operation
krb5kdc: starting...
W20260806 01:03:40.847391 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.051s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:03:40 dist-test-slave-69rg krb5kdc[19215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978220, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:03:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:03:40Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.126.keytab.
Entry for principal oryx/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.126.keytab.
I20260806 01:03:40.994035 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:39593
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.126.keytab
--principal=oryx/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:45935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:39593
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:41.086300 19229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:41.086535 19229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:41.086560 19229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:41.087761 19229 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:03:41.087801 19229 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 01:03:41.087815 19229 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:41.087828 19229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:41.087841 19229 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:03:41.087853 19229 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:03:41.089432 19229 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:45935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:39593
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.126.keytab
--principal=oryx/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:39593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19229
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:41.089651 19229 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:41.089964 19229 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:41.095239 19239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:41.095283 19237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:41.095419 19229 server_base.cc:1034] running on GCE node
W20260806 01:03:41.095283 19236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:41.095908 19229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:41.096314 19229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:41.097505 19229 hybrid_clock.cc:648] HybridClock initialized: now 1785978221097480 us; error 35 us; skew 500 ppm
Aug 06 01:03:41 dist-test-slave-69rg krb5kdc[19215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978221, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:41.100522 19229 init.cc:377] Logged in from keytab as oryx/127.11.88.126@KRBTEST.COM (short username oryx)
I20260806 01:03:41.101068 19229 webserver.cc:460] Webserver started at http://127.11.88.126:45563/ using document root <none> and password file <none>
I20260806 01:03:41.101333 19229 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:41.101405 19229 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:41.101567 19229 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:41.102829 19229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "efe4b41870f94ce792e7ad7110438c0e"
format_stamp: "Formatted at 2026-08-06 01:03:41 on dist-test-slave-69rg"
server_key: "cf5eaf35306a0d511c741054d28fade8"
server_key_iv: "728649327805544e1da79b0c6877b35c"
server_key_version: "encryptionkey@0"
I20260806 01:03:41.103229 19229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "efe4b41870f94ce792e7ad7110438c0e"
format_stamp: "Formatted at 2026-08-06 01:03:41 on dist-test-slave-69rg"
server_key: "cf5eaf35306a0d511c741054d28fade8"
server_key_iv: "728649327805544e1da79b0c6877b35c"
server_key_version: "encryptionkey@0"
I20260806 01:03:41.104802 19229 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 01:03:41.105681 19246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:41.105958 19229 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:03:41.106083 19229 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "efe4b41870f94ce792e7ad7110438c0e"
format_stamp: "Formatted at 2026-08-06 01:03:41 on dist-test-slave-69rg"
server_key: "cf5eaf35306a0d511c741054d28fade8"
server_key_iv: "728649327805544e1da79b0c6877b35c"
server_key_version: "encryptionkey@0"
I20260806 01:03:41.106172 19229 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:41.123895 19229 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:41.126464 19229 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:41.126670 19229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:41.132001 19229 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:39593
I20260806 01:03:41.132051 19311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:39593 every 8 connection(s)
I20260806 01:03:41.132423 19229 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:03:41.133123 19312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:41.135644 19312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efe4b41870f94ce792e7ad7110438c0e: Bootstrap starting.
I20260806 01:03:41.136334 19312 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P efe4b41870f94ce792e7ad7110438c0e: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:41.136643 19312 log.cc:824] T 00000000000000000000000000000000 P efe4b41870f94ce792e7ad7110438c0e: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:41.137404 19312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efe4b41870f94ce792e7ad7110438c0e: No bootstrap required, opened a new log
I20260806 01:03:41.139618 19312 raft_consensus.cc:348] T 00000000000000000000000000000000 P efe4b41870f94ce792e7ad7110438c0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efe4b41870f94ce792e7ad7110438c0e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39593 } }
I20260806 01:03:41.139786 19312 raft_consensus.cc:374] T 00000000000000000000000000000000 P efe4b41870f94ce792e7ad7110438c0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:41.139833 19312 raft_consensus.cc:729] T 00000000000000000000000000000000 P efe4b41870f94ce792e7ad7110438c0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efe4b41870f94ce792e7ad7110438c0e, State: Initialized, Role: FOLLOWER
I20260806 01:03:41.140026 19312 consensus_queue.cc:260] T 00000000000000000000000000000000 P efe4b41870f94ce792e7ad7110438c0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efe4b41870f94ce792e7ad7110438c0e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39593 } }
I20260806 01:03:41.140133 19312 raft_consensus.cc:388] T 00000000000000000000000000000000 P efe4b41870f94ce792e7ad7110438c0e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:03:41.140182 19312 raft_consensus.cc:482] T 00000000000000000000000000000000 P efe4b41870f94ce792e7ad7110438c0e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:03:41.140240 19312 raft_consensus.cc:3037] T 00000000000000000000000000000000 P efe4b41870f94ce792e7ad7110438c0e [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:41.140790 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 19229
I20260806 01:03:41.140812 19312 raft_consensus.cc:504] T 00000000000000000000000000000000 P efe4b41870f94ce792e7ad7110438c0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efe4b41870f94ce792e7ad7110438c0e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39593 } }
I20260806 01:03:41.140880 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:03:41.140935 19312 leader_election.cc:302] T 00000000000000000000000000000000 P efe4b41870f94ce792e7ad7110438c0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: efe4b41870f94ce792e7ad7110438c0e; no voters:
I20260806 01:03:41.141136 11617 external_mini_cluster.cc:1428] Setting key e574851f1a40277b365e3a7ef8a587c2
I20260806 01:03:41.141149 19312 leader_election.cc:288] T 00000000000000000000000000000000 P efe4b41870f94ce792e7ad7110438c0e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:03:41.141187 19315 raft_consensus.cc:2781] T 00000000000000000000000000000000 P efe4b41870f94ce792e7ad7110438c0e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:41.141316 19315 raft_consensus.cc:686] T 00000000000000000000000000000000 P efe4b41870f94ce792e7ad7110438c0e [term 1 LEADER]: Becoming Leader. State: Replica: efe4b41870f94ce792e7ad7110438c0e, State: Running, Role: LEADER
I20260806 01:03:41.141397 19315 consensus_queue.cc:237] T 00000000000000000000000000000000 P efe4b41870f94ce792e7ad7110438c0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efe4b41870f94ce792e7ad7110438c0e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39593 } }
I20260806 01:03:41.141430 19312 sys_catalog.cc:564] T 00000000000000000000000000000000 P efe4b41870f94ce792e7ad7110438c0e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:03:41.141903 19317 sys_catalog.cc:455] T 00000000000000000000000000000000 P efe4b41870f94ce792e7ad7110438c0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader efe4b41870f94ce792e7ad7110438c0e. Latest consensus state: current_term: 1 leader_uuid: "efe4b41870f94ce792e7ad7110438c0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efe4b41870f94ce792e7ad7110438c0e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39593 } } }
I20260806 01:03:41.141923 19316 sys_catalog.cc:455] T 00000000000000000000000000000000 P efe4b41870f94ce792e7ad7110438c0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "efe4b41870f94ce792e7ad7110438c0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efe4b41870f94ce792e7ad7110438c0e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39593 } } }
I20260806 01:03:41.142115 19316 sys_catalog.cc:458] T 00000000000000000000000000000000 P efe4b41870f94ce792e7ad7110438c0e [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:41.142367 19317 sys_catalog.cc:458] T 00000000000000000000000000000000 P efe4b41870f94ce792e7ad7110438c0e [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:41.142391 19327 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:03:41.143247 19327 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:03:41.145576 19327 catalog_manager.cc:1347] Generated new cluster ID: 2b34d93f5cdd4a4e93755249706332cd
I20260806 01:03:41.145639 19327 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 01:03:41 dist-test-slave-69rg krb5kdc[19215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978220, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM
I20260806 01:03:41.154322 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:41.141848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60030 (local address 127.11.88.126:39593)
0806 01:03:41.143031 (+ 1183us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:41.143040 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:41.143075 (+ 35us) server_negotiation.cc:407] Connection header received
0806 01:03:41.143197 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:41.143205 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:41.143263 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:41.143996 (+ 733us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:41.144246 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.145398 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.146510 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.147148 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.147561 (+ 413us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:41.150161 (+ 2600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:41.150166 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:41.150166 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:41.150179 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:41.152297 (+ 2118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:41.152700 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:41.152712 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:41.152712 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:41.152828 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:41.153018 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:41.153019 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:41.153019 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:41.153324 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:41.153843 (+ 519us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:41.153914 (+ 71us) server_negotiation.cc:299] Negotiation successful
0806 01:03:41.154053 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1132,"thread_start_us":105,"threads_started":1}
I20260806 01:03:41.157195 19327 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:03:41.157759 19327 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:03:41.163296 19327 catalog_manager.cc:5868] T 00000000000000000000000000000000 P efe4b41870f94ce792e7ad7110438c0e: Generated new TSK 0
I20260806 01:03:41.163503 19327 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.88.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.88.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.88.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.65.keytab.
Entry for principal oryx/127.11.88.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.65.keytab.
I20260806 01:03:41.198371 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:0
--local_ip_for_outbound_sockets=127.11.88.65
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:39593
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.65.keytab
--principal=oryx/127.11.88.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:45935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:41.283466 19340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:41.283689 19340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:41.283712 19340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:41.285197 19340 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:41.285252 19340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:41.285288 19340 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 01:03:41.285319 19340 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:03:41.287570 19340 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:45935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.65.keytab
--principal=oryx/127.11.88.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.88.126:39593
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19340
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:41.287894 19340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:41.288143 19340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:41.293303 19346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:41.293437 19340 server_base.cc:1034] running on GCE node
W20260806 01:03:41.293509 19345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:41.293304 19348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:41.293802 19340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:41.294104 19340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:41.295301 19340 hybrid_clock.cc:648] HybridClock initialized: now 1785978221295291 us; error 32 us; skew 500 ppm
Aug 06 01:03:41 dist-test-slave-69rg krb5kdc[19215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978221, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:41.298003 19340 init.cc:377] Logged in from keytab as oryx/127.11.88.65@KRBTEST.COM (short username oryx)
I20260806 01:03:41.298560 19340 webserver.cc:460] Webserver started at http://127.11.88.65:40479/ using document root <none> and password file <none>
I20260806 01:03:41.298830 19340 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:41.298906 19340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:41.299095 19340 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:41.300244 19340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-0/data/instance:
uuid: "36835ca743ae4072a6c22883036de3cb"
format_stamp: "Formatted at 2026-08-06 01:03:41 on dist-test-slave-69rg"
server_key: "965839242e6a341d6f7d330ec3aa4bdb"
server_key_iv: "0bcaae41027a563051596f21ea5e6331"
server_key_version: "encryptionkey@0"
I20260806 01:03:41.300626 19340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance:
uuid: "36835ca743ae4072a6c22883036de3cb"
format_stamp: "Formatted at 2026-08-06 01:03:41 on dist-test-slave-69rg"
server_key: "965839242e6a341d6f7d330ec3aa4bdb"
server_key_iv: "0bcaae41027a563051596f21ea5e6331"
server_key_version: "encryptionkey@0"
I20260806 01:03:41.302304 19340 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 01:03:41.303133 19356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:41.303359 19340 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:41.303471 19340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "36835ca743ae4072a6c22883036de3cb"
format_stamp: "Formatted at 2026-08-06 01:03:41 on dist-test-slave-69rg"
server_key: "965839242e6a341d6f7d330ec3aa4bdb"
server_key_iv: "0bcaae41027a563051596f21ea5e6331"
server_key_version: "encryptionkey@0"
I20260806 01:03:41.303550 19340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:41.316143 19340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:41.318506 19340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:41.318687 19340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:41.319249 19340 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:41.319325 19340 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:41.319370 19340 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:41.319413 19340 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:41.326625 19340 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:37319
I20260806 01:03:41.326763 19476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:37319 every 8 connection(s)
I20260806 01:03:41.327088 19340 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
Aug 06 01:03:41 dist-test-slave-69rg krb5kdc[19215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978221, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM
I20260806 01:03:41.330731 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:41.319879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:33225 (local address 127.11.88.126:39593)
0806 01:03:41.319940 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:41.319942 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:41.320232 (+ 290us) server_negotiation.cc:407] Connection header received
0806 01:03:41.320954 (+ 722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:41.320956 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:41.320972 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:41.321049 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:41.322117 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.322993 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.324799 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.325167 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.325256 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:41.328197 (+ 2941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:41.328198 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:41.328199 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:41.328208 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:41.329405 (+ 1197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:41.329805 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:41.329806 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:41.329806 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:41.329926 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:41.330178 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:41.330178 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:41.330179 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:41.330295 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:41.330350 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:41.330584 (+ 234us) server_negotiation.cc:299] Negotiation successful
0806 01:03:41.330656 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260806 01:03:41.330984 19366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:41.319818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:39593 (local address 127.11.88.65:33225)
0806 01:03:41.320036 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:41.320078 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:41.320799 (+ 721us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:41.321156 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:41.321161 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:41.321621 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:41.321983 (+ 362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:41.321993 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.323119 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.323120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:41.324679 (+ 1559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:41.324683 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.325296 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.325297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:41.325465 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:41.326165 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:41.326174 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:41.328093 (+ 1919us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:41.329480 (+ 1387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:41.329487 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:41.329489 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:41.329733 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:41.330001 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:41.330002 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:41.330002 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:41.330108 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:41.330360 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:41.330365 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:41.330488 (+ 123us) client_negotiation.cc:769] Sending connection context
0806 01:03:41.330574 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 01:03:41.330705 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":94,"threads_started":1}
I20260806 01:03:41.331559 19477 heartbeater.cc:347] Connected to a master server at 127.11.88.126:39593
I20260806 01:03:41.331653 19477 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:41.331895 19477 heartbeater.cc:511] Master 127.11.88.126:39593 requested a full tablet report, sending...
I20260806 01:03:41.332449 19264 ts_manager.cc:194] Registered new tserver with Master: 36835ca743ae4072a6c22883036de3cb (127.11.88.65:37319)
I20260806 01:03:41.333312 19264 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.88.65@KRBTEST.COM'} at 127.11.88.65:33225
I20260806 01:03:41.334297 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 19340
I20260806 01:03:41.334420 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance
I20260806 01:03:41.334631 11617 external_mini_cluster.cc:1428] Setting key bc72130e04401e3745571924e98061f1
I20260806 01:03:41.339198 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:41.332773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:34361 (local address 127.11.88.126:39593)
0806 01:03:41.332816 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:41.332818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:41.332890 (+ 72us) server_negotiation.cc:407] Connection header received
0806 01:03:41.332952 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:41.332952 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:41.332962 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:41.333015 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:41.333317 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.334012 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.334951 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.335217 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.335281 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:41.336305 (+ 1024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:41.336306 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:41.336306 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:41.336313 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:41.338000 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:41.338470 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:41.338471 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:41.338471 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:41.338525 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:41.338750 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:41.338751 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:41.338751 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:41.338854 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:41.338906 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:41.339068 (+ 162us) server_negotiation.cc:299] Negotiation successful
0806 01:03:41.339132 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 01:03:41.339346 19484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:41.332699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:39593 (local address 127.11.88.65:34361)
0806 01:03:41.332829 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:41.332840 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:41.332899 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:41.333018 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:41.333019 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:41.333172 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:41.333247 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:41.333248 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.334111 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.334112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:41.334830 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:41.334832 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.335295 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.335296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:41.335370 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:41.335879 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:41.335884 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:41.336183 (+ 299us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:41.338113 (+ 1930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:41.338114 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:41.338114 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:41.338394 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:41.338593 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:41.338594 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:41.338594 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:41.338668 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:41.338920 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:41.338920 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:41.338975 (+ 55us) client_negotiation.cc:769] Sending connection context
0806 01:03:41.339052 (+ 77us) client_negotiation.cc:240] Negotiation successful
0806 01:03:41.339179 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":77,"threads_started":1}
WARNING: no policy specified for oryx/127.11.88.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.88.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.88.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.66.keytab.
Entry for principal oryx/127.11.88.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.66.keytab.
I20260806 01:03:41.366106 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:0
--local_ip_for_outbound_sockets=127.11.88.66
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:39593
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.66.keytab
--principal=oryx/127.11.88.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:45935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:41.450234 19487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:41.450438 19487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:41.450462 19487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:41.451679 19487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:41.451720 19487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:41.451740 19487 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 01:03:41.451786 19487 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:03:41.453348 19487 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:45935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.66.keytab
--principal=oryx/127.11.88.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.88.126:39593
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19487
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:41.453583 19487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:41.453866 19487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:41.459059 19495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:41.459062 19492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:41.459168 19493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:41.459415 19487 server_base.cc:1034] running on GCE node
I20260806 01:03:41.459623 19487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:41.459892 19487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:41.461064 19487 hybrid_clock.cc:648] HybridClock initialized: now 1785978221461058 us; error 37 us; skew 500 ppm
Aug 06 01:03:41 dist-test-slave-69rg krb5kdc[19215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978221, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:41.463637 19487 init.cc:377] Logged in from keytab as oryx/127.11.88.66@KRBTEST.COM (short username oryx)
I20260806 01:03:41.464089 19487 webserver.cc:460] Webserver started at http://127.11.88.66:44721/ using document root <none> and password file <none>
I20260806 01:03:41.464319 19487 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:41.464388 19487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:41.464543 19487 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:41.465590 19487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-1/data/instance:
uuid: "3b8027a4bc0a4e35ac6aab073f21d476"
format_stamp: "Formatted at 2026-08-06 01:03:41 on dist-test-slave-69rg"
server_key: "38dfa394edaf32afa37cc638ce9dad6f"
server_key_iv: "fa11aa2874d86b5d6fa60c2085224c8a"
server_key_version: "encryptionkey@0"
I20260806 01:03:41.465986 19487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance:
uuid: "3b8027a4bc0a4e35ac6aab073f21d476"
format_stamp: "Formatted at 2026-08-06 01:03:41 on dist-test-slave-69rg"
server_key: "38dfa394edaf32afa37cc638ce9dad6f"
server_key_iv: "fa11aa2874d86b5d6fa60c2085224c8a"
server_key_version: "encryptionkey@0"
I20260806 01:03:41.467326 19487 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:03:41.468103 19503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:41.468272 19487 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 01:03:41.468374 19487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "3b8027a4bc0a4e35ac6aab073f21d476"
format_stamp: "Formatted at 2026-08-06 01:03:41 on dist-test-slave-69rg"
server_key: "38dfa394edaf32afa37cc638ce9dad6f"
server_key_iv: "fa11aa2874d86b5d6fa60c2085224c8a"
server_key_version: "encryptionkey@0"
I20260806 01:03:41.468456 19487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:41.487743 19487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:41.489972 19487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:41.490147 19487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:41.490808 19487 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:41.490862 19487 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:41.490899 19487 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:41.490952 19487 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 01:03:41 dist-test-slave-69rg krb5kdc[19215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978221, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM
I20260806 01:03:41.498381 19487 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:34641
I20260806 01:03:41.498696 19623 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:34641 every 8 connection(s)
I20260806 01:03:41.498905 19487 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
I20260806 01:03:41.500886 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:41.491259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:37525 (local address 127.11.88.126:39593)
0806 01:03:41.491336 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:41.491338 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:41.491578 (+ 240us) server_negotiation.cc:407] Connection header received
0806 01:03:41.492132 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:41.492133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:41.492147 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:41.492194 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:41.493011 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.493860 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.494866 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.495083 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.495158 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:41.497918 (+ 2760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:41.497920 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:41.497921 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:41.497929 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:41.499711 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:41.500083 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:41.500084 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:41.500084 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:41.500137 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:41.500372 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:41.500373 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:41.500373 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:41.500482 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:41.500535 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:41.500758 (+ 223us) server_negotiation.cc:299] Negotiation successful
0806 01:03:41.500821 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 01:03:41.501101 19512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:41.491254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:39593 (local address 127.11.88.66:37525)
0806 01:03:41.491422 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:41.491484 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:41.492016 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:41.492267 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:41.492271 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:41.492544 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:41.492855 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:41.492861 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.493942 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.493943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:41.494771 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:41.494773 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.495181 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.495182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:41.495313 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:41.495859 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:41.495869 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:41.497773 (+ 1904us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:41.499792 (+ 2019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:41.499798 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:41.499799 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:41.500014 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:41.500196 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:41.500196 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:41.500196 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:41.500315 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:41.500537 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:41.500541 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:41.500655 (+ 114us) client_negotiation.cc:769] Sending connection context
0806 01:03:41.500737 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 01:03:41.500856 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":99,"threads_started":1}
I20260806 01:03:41.501592 19624 heartbeater.cc:347] Connected to a master server at 127.11.88.126:39593
I20260806 01:03:41.501691 19624 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:41.501909 19624 heartbeater.cc:511] Master 127.11.88.126:39593 requested a full tablet report, sending...
I20260806 01:03:41.502038 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 19487
I20260806 01:03:41.502158 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance
I20260806 01:03:41.502400 11617 external_mini_cluster.cc:1428] Setting key 12f589bec78518858956ec12e4b78745
I20260806 01:03:41.502815 19263 ts_manager.cc:194] Registered new tserver with Master: 3b8027a4bc0a4e35ac6aab073f21d476 (127.11.88.66:34641)
I20260806 01:03:41.503310 19263 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.88.66@KRBTEST.COM'} at 127.11.88.66:37525
I20260806 01:03:41.510915 19630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:41.502662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:39593 (local address 127.11.88.66:60389)
0806 01:03:41.503066 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:41.503077 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:41.503135 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:41.504921 (+ 1786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:41.504922 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:41.505102 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:41.505153 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:41.505154 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.505933 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.505934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:41.506584 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:41.506587 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.507112 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.507113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:41.507175 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:41.507693 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:41.507699 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:41.507991 (+ 292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:41.509802 (+ 1811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:41.509803 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:41.509803 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:41.510050 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:41.510267 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:41.510268 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:41.510268 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:41.510323 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:41.510674 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:41.510674 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:41.510713 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 01:03:41.510764 (+ 51us) client_negotiation.cc:240] Negotiation successful
0806 01:03:41.510845 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":89,"threads_started":1}
I20260806 01:03:41.510989 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:41.502727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:60389 (local address 127.11.88.126:39593)
0806 01:03:41.502767 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:41.502769 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:41.503122 (+ 353us) server_negotiation.cc:407] Connection header received
0806 01:03:41.504814 (+ 1692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:41.504815 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:41.504825 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:41.504901 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:41.505231 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.505840 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.506676 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.507024 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.507106 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:41.508082 (+ 976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:41.508084 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:41.508085 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:41.508093 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:41.509718 (+ 1625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:41.510126 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:41.510127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:41.510128 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:41.510194 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:41.510390 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:41.510391 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:41.510391 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:41.510604 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:41.510682 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:41.510792 (+ 110us) server_negotiation.cc:299] Negotiation successful
0806 01:03:41.510866 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
WARNING: no policy specified for oryx/127.11.88.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.88.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.88.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.67.keytab.
Entry for principal oryx/127.11.88.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.67.keytab.
I20260806 01:03:41.533174 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:0
--local_ip_for_outbound_sockets=127.11.88.67
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:39593
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.67.keytab
--principal=oryx/127.11.88.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:45935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:41.618427 19634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:41.618664 19634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:41.618707 19634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:41.619927 19634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:41.619997 19634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:41.620036 19634 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 01:03:41.620095 19634 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:03:41.621662 19634 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:45935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.67.keytab
--principal=oryx/127.11.88.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.88.126:39593
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19634
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:41.621971 19634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:41.622228 19634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:41.627388 19640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:41.627386 19643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:41.627430 19641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:41.627482 19634 server_base.cc:1034] running on GCE node
I20260806 01:03:41.627951 19634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:41.628309 19634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:41.629501 19634 hybrid_clock.cc:648] HybridClock initialized: now 1785978221629473 us; error 44 us; skew 500 ppm
Aug 06 01:03:41 dist-test-slave-69rg krb5kdc[19215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978221, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:41.632352 19634 init.cc:377] Logged in from keytab as oryx/127.11.88.67@KRBTEST.COM (short username oryx)
I20260806 01:03:41.632843 19634 webserver.cc:460] Webserver started at http://127.11.88.67:42691/ using document root <none> and password file <none>
I20260806 01:03:41.633061 19634 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:41.633104 19634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:41.633198 19634 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:41.634316 19634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-2/data/instance:
uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f"
format_stamp: "Formatted at 2026-08-06 01:03:41 on dist-test-slave-69rg"
server_key: "ac81cf63fe53b445219eac9cc92baeb1"
server_key_iv: "0c77bb3d855b36e74cc51029fa9198a7"
server_key_version: "encryptionkey@0"
I20260806 01:03:41.634621 19634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance:
uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f"
format_stamp: "Formatted at 2026-08-06 01:03:41 on dist-test-slave-69rg"
server_key: "ac81cf63fe53b445219eac9cc92baeb1"
server_key_iv: "0c77bb3d855b36e74cc51029fa9198a7"
server_key_version: "encryptionkey@0"
I20260806 01:03:41.635967 19634 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 01:03:41.636808 19650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:41.637025 19634 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:41.637115 19634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f"
format_stamp: "Formatted at 2026-08-06 01:03:41 on dist-test-slave-69rg"
server_key: "ac81cf63fe53b445219eac9cc92baeb1"
server_key_iv: "0c77bb3d855b36e74cc51029fa9198a7"
server_key_version: "encryptionkey@0"
I20260806 01:03:41.637198 19634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:41.644587 19634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:41.647039 19634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:41.647223 19634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:41.647790 19634 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:41.647859 19634 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:41.647925 19634 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:41.647956 19634 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:41.655596 19634 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:40765
I20260806 01:03:41.656029 19634 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
Aug 06 01:03:41 dist-test-slave-69rg krb5kdc[19215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978221, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM
I20260806 01:03:41.656306 19770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:40765 every 8 connection(s)
I20260806 01:03:41.658906 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 19634
I20260806 01:03:41.659031 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance
I20260806 01:03:41.659238 11617 external_mini_cluster.cc:1428] Setting key 86abe549d4799e6f0bb486b6e301849b
I20260806 01:03:41.660126 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:41.648335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:33415 (local address 127.11.88.126:39593)
0806 01:03:41.648416 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:41.648419 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:41.648708 (+ 289us) server_negotiation.cc:407] Connection header received
0806 01:03:41.649306 (+ 598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:41.649308 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:41.649321 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:41.649379 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:41.650400 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.651245 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.653020 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.653265 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.653329 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:41.656757 (+ 3428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:41.656759 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:41.656759 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:41.656767 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:41.658362 (+ 1595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:41.658867 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:41.658869 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:41.658870 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:41.658946 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:41.659296 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:41.659297 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:41.659298 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:41.659460 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:41.659566 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:41.659915 (+ 349us) server_negotiation.cc:299] Negotiation successful
0806 01:03:41.660010 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 01:03:41.660300 19660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:41.648287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:39593 (local address 127.11.88.67:33415)
0806 01:03:41.648591 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:41.648623 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:41.649180 (+ 557us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:41.649503 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:41.649509 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:41.649945 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:41.650279 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:41.650286 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.651362 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.651363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:41.652902 (+ 1539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:41.652906 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.653369 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.653371 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:41.653690 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:41.654658 (+ 968us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:41.654673 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:41.656633 (+ 1960us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:41.658448 (+ 1815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:41.658455 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:41.658457 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:41.658737 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:41.659045 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:41.659046 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:41.659047 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:41.659208 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:41.659563 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:41.659572 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:41.659759 (+ 187us) client_negotiation.cc:769] Sending connection context
0806 01:03:41.659878 (+ 119us) client_negotiation.cc:240] Negotiation successful
0806 01:03:41.660033 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":103,"threads_started":1}
I20260806 01:03:41.660758 19771 heartbeater.cc:347] Connected to a master server at 127.11.88.126:39593
I20260806 01:03:41.660842 19771 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:41.661052 19771 heartbeater.cc:511] Master 127.11.88.126:39593 requested a full tablet report, sending...
I20260806 01:03:41.661474 19264 ts_manager.cc:194] Registered new tserver with Master: 0e7a527ca03d4c9ea9e0f9c37d81405f (127.11.88.67:40765)
I20260806 01:03:41.661978 19264 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.88.67@KRBTEST.COM'} at 127.11.88.67:33415
I20260806 01:03:41.667677 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:41.661913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:48539 (local address 127.11.88.126:39593)
0806 01:03:41.661956 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:41.661958 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:41.662122 (+ 164us) server_negotiation.cc:407] Connection header received
0806 01:03:41.662171 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:41.662172 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:41.662183 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:41.662238 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:41.662552 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.663090 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.663886 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.664076 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.664135 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:41.665161 (+ 1026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:41.665162 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:41.665163 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:41.665170 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:41.666586 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:41.666939 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:41.666940 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:41.666940 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:41.666991 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:41.667152 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:41.667152 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:41.667152 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:41.667262 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:41.667317 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:41.667535 (+ 218us) server_negotiation.cc:299] Negotiation successful
0806 01:03:41.667609 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 01:03:41.667732 19777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:41.661855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:39593 (local address 127.11.88.67:48539)
0806 01:03:41.662021 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:41.662031 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:41.662114 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:41.662249 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:41.662249 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:41.662409 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:41.662468 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:41.662469 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.663244 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.663245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:41.663804 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:41.663806 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.664169 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.664170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:41.664250 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:41.664776 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:41.664781 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:41.665076 (+ 295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:41.666665 (+ 1589us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:41.666666 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:41.666666 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:41.666874 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:41.667049 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:41.667050 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:41.667050 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:41.667101 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:41.667366 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:41.667367 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:41.667420 (+ 53us) client_negotiation.cc:769] Sending connection context
0806 01:03:41.667498 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 01:03:41.667630 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":72,"threads_started":1}
I20260806 01:03:41.671474 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 01:03:41 dist-test-slave-69rg krb5kdc[19215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978221, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 01:03:41 dist-test-slave-69rg krb5kdc[19215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:41 dist-test-slave-69rg krb5kdc[19215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
W20260806 01:03:41.694640 19321 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:41.688748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60042 (local address 127.11.88.126:39593)
0806 01:03:41.688825 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:41.688827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:41.688837 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:03:41.688875 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:41.688876 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:41.688886 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:41.688938 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:41.689529 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.690141 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.690961 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.691210 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.691281 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:41.694531 (+ 3250us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60042: BlockingRecv error: recv got EOF from 127.0.0.1:60042 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 06 01:03:41 dist-test-slave-69rg krb5kdc[19215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978221, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM
I20260806 01:03:41.702445 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:41.695457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60056 (local address 127.11.88.126:39593)
0806 01:03:41.695532 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:41.695534 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:41.695689 (+ 155us) server_negotiation.cc:407] Connection header received
0806 01:03:41.695720 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:41.695721 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:41.695731 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:41.695794 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:41.696293 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.696788 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.697463 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.697642 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.697696 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:41.699850 (+ 2154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:41.699852 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:41.699852 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:41.699860 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:41.701149 (+ 1289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:41.701526 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:41.701528 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:41.701528 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:41.701655 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:41.701950 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:41.701951 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:41.701951 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:41.702073 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:41.702173 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:41.702285 (+ 112us) server_negotiation.cc:299] Negotiation successful
0806 01:03:41.702356 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 01:03:41.704195 19264 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60056:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 01:03:41.706074 19264 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:03:41.713735 19794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:41.709099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41570 (local address 127.11.88.65:37319)
0806 01:03:41.709342 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:41.709348 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:41.709410 (+ 62us) server_negotiation.cc:407] Connection header received
0806 01:03:41.709451 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:41.709454 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:41.709501 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:41.709577 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:41.709834 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.710958 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.712705 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.713269 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.713368 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:41.713459 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:41.713580 (+ 121us) server_negotiation.cc:299] Negotiation successful
0806 01:03:41.713628 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":122,"threads_started":1}
I20260806 01:03:41.713726 19793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:41.708863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:37319 (local address 127.0.0.1:41570)
0806 01:03:41.709003 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:41.709042 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:41.709134 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:41.709634 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:41.709637 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:41.709640 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:41.709739 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:41.709741 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.711052 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.711053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:41.712625 (+ 1572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:41.712628 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.713367 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.713368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:41.713462 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:41.713478 (+ 16us) client_negotiation.cc:769] Sending connection context
0806 01:03:41.713562 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 01:03:41.713628 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":74,"threads_started":1}
I20260806 01:03:41.714567 19409 tablet_service.cc:1467] Processing CreateTablet for tablet acedb0ee552c46119c80852eda196405 (DEFAULT_TABLE table=test-table [id=033ebe3bda6242ca9ecaed6c9b79d299]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:41.714994 19409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acedb0ee552c46119c80852eda196405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:41.715008 19797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:41.710257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:40765 (local address 127.0.0.1:41624)
0806 01:03:41.710590 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:41.710601 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:41.710651 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:41.711149 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:41.711149 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:41.711151 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:41.711216 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:41.711217 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.712301 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.712302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:41.713475 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:41.713477 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.714743 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.714744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:41.714815 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:41.714819 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:03:41.714871 (+ 52us) client_negotiation.cc:240] Negotiation successful
0806 01:03:41.714911 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"mutex_wait_us":3,"thread_start_us":94,"threads_started":1}
I20260806 01:03:41.715116 19795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:41.710466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:34641 (local address 127.0.0.1:40450)
0806 01:03:41.710787 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:41.710799 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:41.710848 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:41.711141 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:41.711142 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:41.711144 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:41.711206 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:41.711208 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.712596 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.712597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:41.713626 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:41.713628 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.714880 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.714881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:41.714929 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:41.714932 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:03:41.714985 (+ 53us) client_negotiation.cc:240] Negotiation successful
0806 01:03:41.715018 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"mutex_wait_us":6,"thread_start_us":83,"threads_started":1}
I20260806 01:03:41.715412 19796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:41.710387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41624 (local address 127.11.88.67:40765)
0806 01:03:41.710937 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:41.710941 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:41.710951 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:03:41.711020 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:41.711023 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:41.711041 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:41.711146 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:41.711299 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.712179 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.713571 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.714557 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.714628 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:41.714704 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:41.715261 (+ 557us) server_negotiation.cc:299] Negotiation successful
0806 01:03:41.715321 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":101,"threads_started":1}
I20260806 01:03:41.715672 19798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:41.710616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40450 (local address 127.11.88.66:34641)
0806 01:03:41.710830 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:41.710835 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:41.710847 (+ 12us) server_negotiation.cc:407] Connection header received
0806 01:03:41.710950 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:41.710954 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:41.710972 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:41.711047 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:41.711277 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.712503 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.713722 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.714700 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.714775 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:41.714847 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:41.715026 (+ 179us) server_negotiation.cc:299] Negotiation successful
0806 01:03:41.715390 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":84,"threads_started":1}
I20260806 01:03:41.715953 19700 tablet_service.cc:1467] Processing CreateTablet for tablet acedb0ee552c46119c80852eda196405 (DEFAULT_TABLE table=test-table [id=033ebe3bda6242ca9ecaed6c9b79d299]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:41.716215 19700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acedb0ee552c46119c80852eda196405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:41.716465 19553 tablet_service.cc:1467] Processing CreateTablet for tablet acedb0ee552c46119c80852eda196405 (DEFAULT_TABLE table=test-table [id=033ebe3bda6242ca9ecaed6c9b79d299]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:41.716823 19553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acedb0ee552c46119c80852eda196405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:41.718946 19799 tablet_bootstrap.cc:492] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f: Bootstrap starting.
I20260806 01:03:41.719355 19800 tablet_bootstrap.cc:492] T acedb0ee552c46119c80852eda196405 P 36835ca743ae4072a6c22883036de3cb: Bootstrap starting.
I20260806 01:03:41.719753 19799 tablet_bootstrap.cc:654] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:41.719990 19800 tablet_bootstrap.cc:654] T acedb0ee552c46119c80852eda196405 P 36835ca743ae4072a6c22883036de3cb: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:41.720098 19799 log.cc:824] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:41.720338 19800 log.cc:824] T acedb0ee552c46119c80852eda196405 P 36835ca743ae4072a6c22883036de3cb: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:41.720975 19799 tablet_bootstrap.cc:492] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f: No bootstrap required, opened a new log
I20260806 01:03:41.721063 19799 ts_tablet_manager.cc:1397] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 01:03:41.721136 19800 tablet_bootstrap.cc:492] T acedb0ee552c46119c80852eda196405 P 36835ca743ae4072a6c22883036de3cb: No bootstrap required, opened a new log
I20260806 01:03:41.721226 19800 ts_tablet_manager.cc:1397] T acedb0ee552c46119c80852eda196405 P 36835ca743ae4072a6c22883036de3cb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 01:03:41.722028 19803 tablet_bootstrap.cc:492] T acedb0ee552c46119c80852eda196405 P 3b8027a4bc0a4e35ac6aab073f21d476: Bootstrap starting.
I20260806 01:03:41.722689 19803 tablet_bootstrap.cc:654] T acedb0ee552c46119c80852eda196405 P 3b8027a4bc0a4e35ac6aab073f21d476: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:41.722856 19799 raft_consensus.cc:348] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } } peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } }
I20260806 01:03:41.723016 19799 raft_consensus.cc:374] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:41.723059 19799 raft_consensus.cc:729] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e7a527ca03d4c9ea9e0f9c37d81405f, State: Initialized, Role: FOLLOWER
I20260806 01:03:41.723039 19803 log.cc:824] T acedb0ee552c46119c80852eda196405 P 3b8027a4bc0a4e35ac6aab073f21d476: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:41.723169 19799 consensus_queue.cc:260] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } } peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } }
I20260806 01:03:41.723472 19799 ts_tablet_manager.cc:1428] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260806 01:03:41.723714 19771 heartbeater.cc:503] Master 127.11.88.126:39593 was elected leader, sending a full tablet report...
I20260806 01:03:41.723722 19800 raft_consensus.cc:348] T acedb0ee552c46119c80852eda196405 P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } } peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } }
I20260806 01:03:41.723881 19803 tablet_bootstrap.cc:492] T acedb0ee552c46119c80852eda196405 P 3b8027a4bc0a4e35ac6aab073f21d476: No bootstrap required, opened a new log
I20260806 01:03:41.723922 19800 raft_consensus.cc:374] T acedb0ee552c46119c80852eda196405 P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:41.723945 19803 ts_tablet_manager.cc:1397] T acedb0ee552c46119c80852eda196405 P 3b8027a4bc0a4e35ac6aab073f21d476: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 01:03:41.723973 19800 raft_consensus.cc:729] T acedb0ee552c46119c80852eda196405 P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36835ca743ae4072a6c22883036de3cb, State: Initialized, Role: FOLLOWER
I20260806 01:03:41.724105 19800 consensus_queue.cc:260] T acedb0ee552c46119c80852eda196405 P 36835ca743ae4072a6c22883036de3cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } } peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } }
I20260806 01:03:41.724368 19800 ts_tablet_manager.cc:1428] T acedb0ee552c46119c80852eda196405 P 36835ca743ae4072a6c22883036de3cb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 01:03:41.724488 19477 heartbeater.cc:503] Master 127.11.88.126:39593 was elected leader, sending a full tablet report...
I20260806 01:03:41.726048 19803 raft_consensus.cc:348] T acedb0ee552c46119c80852eda196405 P 3b8027a4bc0a4e35ac6aab073f21d476 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } } peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } }
I20260806 01:03:41.726171 19803 raft_consensus.cc:374] T acedb0ee552c46119c80852eda196405 P 3b8027a4bc0a4e35ac6aab073f21d476 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:41.726193 19803 raft_consensus.cc:729] T acedb0ee552c46119c80852eda196405 P 3b8027a4bc0a4e35ac6aab073f21d476 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b8027a4bc0a4e35ac6aab073f21d476, State: Initialized, Role: FOLLOWER
I20260806 01:03:41.726312 19803 consensus_queue.cc:260] T acedb0ee552c46119c80852eda196405 P 3b8027a4bc0a4e35ac6aab073f21d476 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } } peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } }
I20260806 01:03:41.726589 19803 ts_tablet_manager.cc:1428] T acedb0ee552c46119c80852eda196405 P 3b8027a4bc0a4e35ac6aab073f21d476: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 01:03:41.726616 19624 heartbeater.cc:503] Master 127.11.88.126:39593 was elected leader, sending a full tablet report...
W20260806 01:03:41.749543 19625 tablet.cc:2369] T acedb0ee552c46119c80852eda196405 P 3b8027a4bc0a4e35ac6aab073f21d476: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 01:03:41.828008 19478 tablet.cc:2369] T acedb0ee552c46119c80852eda196405 P 36835ca743ae4072a6c22883036de3cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 01:03:41.906814 19772 tablet.cc:2369] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 01:03:41.974073 19805 raft_consensus.cc:482] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:03:41.974251 19805 raft_consensus.cc:504] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } } peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } }
I20260806 01:03:41.974663 19805 leader_election.cc:288] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36835ca743ae4072a6c22883036de3cb (127.11.88.65:37319), 3b8027a4bc0a4e35ac6aab073f21d476 (127.11.88.66:34641)
I20260806 01:03:41.977923 19808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:41.974906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:37319 (local address 127.11.88.67:51271)
0806 01:03:41.975264 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:41.975273 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:41.975346 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:41.975499 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:41.975500 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:41.975501 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:41.975586 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:41.975587 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.976303 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.976304 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:41.977033 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:41.977035 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.977605 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.977606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:41.977685 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:41.977689 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:03:41.977771 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 01:03:41.977811 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"mutex_wait_us":163,"thread_start_us":107,"threads_started":1}
I20260806 01:03:41.977916 19794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:41.974972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:51271 (local address 127.11.88.65:37319)
0806 01:03:41.975039 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:41.975041 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:41.975344 (+ 303us) server_negotiation.cc:407] Connection header received
0806 01:03:41.975403 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:41.975405 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:41.975417 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:41.975484 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:41.975690 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.976164 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.977148 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.977516 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.977604 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:41.977613 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:41.977787 (+ 174us) server_negotiation.cc:299] Negotiation successful
0806 01:03:41.977855 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 01:03:41.978103 19798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:41.974963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:48311 (local address 127.11.88.66:34641)
0806 01:03:41.975041 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:41.975043 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:41.975053 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:03:41.975092 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:41.975093 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:41.975101 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:41.975172 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:41.975387 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.975876 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.976807 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.977237 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.977330 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:41.977340 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:41.977964 (+ 624us) server_negotiation.cc:299] Negotiation successful
0806 01:03:41.978015 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 01:03:41.978132 19660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:41.974897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:34641 (local address 127.11.88.67:48311)
0806 01:03:41.974949 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:41.974961 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:41.975010 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:41.975209 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:41.975210 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:41.975213 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:41.975283 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:41.975285 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.975967 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.975968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:41.976712 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:41.976714 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:41.977329 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:41.977330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:41.977858 (+ 528us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:41.977862 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:03:41.977954 (+ 92us) client_negotiation.cc:240] Negotiation successful
0806 01:03:41.978051 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260806 01:03:41.978503 19576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acedb0ee552c46119c80852eda196405" candidate_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" is_pre_election: true
I20260806 01:03:41.978502 19431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acedb0ee552c46119c80852eda196405" candidate_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36835ca743ae4072a6c22883036de3cb" is_pre_election: true
I20260806 01:03:41.978667 19576 raft_consensus.cc:2454] T acedb0ee552c46119c80852eda196405 P 3b8027a4bc0a4e35ac6aab073f21d476 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e7a527ca03d4c9ea9e0f9c37d81405f in term 0.
I20260806 01:03:41.978674 19431 raft_consensus.cc:2454] T acedb0ee552c46119c80852eda196405 P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e7a527ca03d4c9ea9e0f9c37d81405f in term 0.
I20260806 01:03:41.978960 19653 leader_election.cc:302] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e7a527ca03d4c9ea9e0f9c37d81405f, 3b8027a4bc0a4e35ac6aab073f21d476; no voters:
I20260806 01:03:41.979102 19805 raft_consensus.cc:2781] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:03:41.979161 19805 raft_consensus.cc:482] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:03:41.979178 19805 raft_consensus.cc:3037] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:41.979869 19805 raft_consensus.cc:504] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } } peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } }
I20260806 01:03:41.980007 19805 leader_election.cc:288] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f [CANDIDATE]: Term 1 election: Requested vote from peers 36835ca743ae4072a6c22883036de3cb (127.11.88.65:37319), 3b8027a4bc0a4e35ac6aab073f21d476 (127.11.88.66:34641)
I20260806 01:03:41.980185 19576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acedb0ee552c46119c80852eda196405" candidate_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b8027a4bc0a4e35ac6aab073f21d476"
I20260806 01:03:41.980201 19431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acedb0ee552c46119c80852eda196405" candidate_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36835ca743ae4072a6c22883036de3cb"
I20260806 01:03:41.980268 19576 raft_consensus.cc:3037] T acedb0ee552c46119c80852eda196405 P 3b8027a4bc0a4e35ac6aab073f21d476 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:41.980291 19431 raft_consensus.cc:3037] T acedb0ee552c46119c80852eda196405 P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:41.980975 19576 raft_consensus.cc:2454] T acedb0ee552c46119c80852eda196405 P 3b8027a4bc0a4e35ac6aab073f21d476 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e7a527ca03d4c9ea9e0f9c37d81405f in term 1.
I20260806 01:03:41.981145 19431 raft_consensus.cc:2454] T acedb0ee552c46119c80852eda196405 P 36835ca743ae4072a6c22883036de3cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e7a527ca03d4c9ea9e0f9c37d81405f in term 1.
I20260806 01:03:41.981148 19653 leader_election.cc:302] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e7a527ca03d4c9ea9e0f9c37d81405f, 3b8027a4bc0a4e35ac6aab073f21d476; no voters:
I20260806 01:03:41.981253 19805 raft_consensus.cc:2781] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:41.981410 19805 raft_consensus.cc:686] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 1 LEADER]: Becoming Leader. State: Replica: 0e7a527ca03d4c9ea9e0f9c37d81405f, State: Running, Role: LEADER
I20260806 01:03:41.981489 19805 consensus_queue.cc:237] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } } peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } }
I20260806 01:03:41.982460 19263 catalog_manager.cc:5495] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e7a527ca03d4c9ea9e0f9c37d81405f (127.11.88.67). New cstate: current_term: 1 leader_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260806 01:03:42.005015 19796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:42.002446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41634 (local address 127.11.88.67:40765)
0806 01:03:42.002525 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:42.002527 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:42.002537 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:03:42.002635 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:42.002636 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:42.002666 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:42.002746 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:03:42.002900 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.003424 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.004205 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.004408 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.004489 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:42.004670 (+ 181us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:03:42.004782 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:03:42.004878 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:42.004898 (+ 20us) server_negotiation.cc:299] Negotiation successful
0806 01:03:42.004920 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 01:03:42.007339 19431 raft_consensus.cc:1261] T acedb0ee552c46119c80852eda196405 P 36835ca743ae4072a6c22883036de3cb [term 1 FOLLOWER]: Refusing update from remote peer 0e7a527ca03d4c9ea9e0f9c37d81405f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:42.007459 19576 raft_consensus.cc:1261] T acedb0ee552c46119c80852eda196405 P 3b8027a4bc0a4e35ac6aab073f21d476 [term 1 FOLLOWER]: Refusing update from remote peer 0e7a527ca03d4c9ea9e0f9c37d81405f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:42.007788 19805 consensus_queue.cc:1035] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f [LEADER]: Connected to new peer: Peer: permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:42.007958 19809 consensus_queue.cc:1035] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:42.010584 19812 mvcc.cc:205] Tried to move back new op lower bound from 7315366797338537984 to 7315366797236727808. Current Snapshot: MvccSnapshot[applied={T|T < 7315366797338537984}]
I20260806 01:03:42.010937 19814 mvcc.cc:205] Tried to move back new op lower bound from 7315366797338537984 to 7315366797236727808. Current Snapshot: MvccSnapshot[applied={T|T < 7315366797338537984}]
I20260806 01:03:42.011122 19813 mvcc.cc:205] Tried to move back new op lower bound from 7315366797338537984 to 7315366797236727808. Current Snapshot: MvccSnapshot[applied={T|T < 7315366797338537984}]
I20260806 01:03:42.013698 19264 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60056:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:42.013835 19264 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60056:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:42.014694 19264 catalog_manager.cc:5782] T 00000000000000000000000000000000 P efe4b41870f94ce792e7ad7110438c0e: Sending DeleteTablet for 3 replicas of tablet acedb0ee552c46119c80852eda196405
I20260806 01:03:42.015106 19409 tablet_service.cc:1514] Processing DeleteTablet for tablet acedb0ee552c46119c80852eda196405 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:42 UTC) from {username='oryx', principal='oryx/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:41570
I20260806 01:03:42.015133 19700 tablet_service.cc:1514] Processing DeleteTablet for tablet acedb0ee552c46119c80852eda196405 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:42 UTC) from {username='oryx', principal='oryx/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:41624
I20260806 01:03:42.015162 19553 tablet_service.cc:1514] Processing DeleteTablet for tablet acedb0ee552c46119c80852eda196405 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:42 UTC) from {username='oryx', principal='oryx/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:40450
I20260806 01:03:42.015403 19823 tablet_replica.cc:330] T acedb0ee552c46119c80852eda196405 P 36835ca743ae4072a6c22883036de3cb: stopping tablet replica
I20260806 01:03:42.015403 19824 tablet_replica.cc:330] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f: stopping tablet replica
I20260806 01:03:42.015527 19824 raft_consensus.cc:2229] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 1 LEADER]: Raft consensus shutting down.
I20260806 01:03:42.015527 19823 raft_consensus.cc:2229] T acedb0ee552c46119c80852eda196405 P 36835ca743ae4072a6c22883036de3cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:03:42.015643 19823 raft_consensus.cc:2258] T acedb0ee552c46119c80852eda196405 P 36835ca743ae4072a6c22883036de3cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:42.015663 19824 raft_consensus.cc:2258] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:42.016026 19264 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60056:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260806 01:03:42.016155 19823 ts_tablet_manager.cc:1905] T acedb0ee552c46119c80852eda196405 P 36835ca743ae4072a6c22883036de3cb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260806 01:03:42.016206 19264 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:03:42.016441 19824 ts_tablet_manager.cc:1905] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:42.017621 19553 tablet_service.cc:1467] Processing CreateTablet for tablet 29087e95c203482e8bd456c852c1168a (DEFAULT_TABLE table=test-table [id=06b766957ca9420a8ff9b1d11d0457dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:42.017684 19409 tablet_service.cc:1467] Processing CreateTablet for tablet 29087e95c203482e8bd456c852c1168a (DEFAULT_TABLE table=test-table [id=06b766957ca9420a8ff9b1d11d0457dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:42.017776 19553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29087e95c203482e8bd456c852c1168a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:42.017779 19409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29087e95c203482e8bd456c852c1168a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:42.018421 19823 ts_tablet_manager.cc:1918] T acedb0ee552c46119c80852eda196405 P 36835ca743ae4072a6c22883036de3cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:03:42.018502 19823 log.cc:1196] T acedb0ee552c46119c80852eda196405 P 36835ca743ae4072a6c22883036de3cb: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-0/wal/wals/acedb0ee552c46119c80852eda196405
I20260806 01:03:42.018776 19823 ts_tablet_manager.cc:1939] T acedb0ee552c46119c80852eda196405 P 36835ca743ae4072a6c22883036de3cb: Deleting consensus metadata
I20260806 01:03:42.018911 19822 tablet_replica.cc:330] T acedb0ee552c46119c80852eda196405 P 3b8027a4bc0a4e35ac6aab073f21d476: stopping tablet replica
I20260806 01:03:42.019040 19822 raft_consensus.cc:2229] T acedb0ee552c46119c80852eda196405 P 3b8027a4bc0a4e35ac6aab073f21d476 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:03:42.019125 19803 tablet_bootstrap.cc:492] T 29087e95c203482e8bd456c852c1168a P 3b8027a4bc0a4e35ac6aab073f21d476: Bootstrap starting.
I20260806 01:03:42.019215 19700 tablet_service.cc:1467] Processing CreateTablet for tablet 29087e95c203482e8bd456c852c1168a (DEFAULT_TABLE table=test-table [id=06b766957ca9420a8ff9b1d11d0457dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:42.019346 19700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29087e95c203482e8bd456c852c1168a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:42.019469 19800 tablet_bootstrap.cc:492] T 29087e95c203482e8bd456c852c1168a P 36835ca743ae4072a6c22883036de3cb: Bootstrap starting.
I20260806 01:03:42.019531 19803 tablet_bootstrap.cc:654] T 29087e95c203482e8bd456c852c1168a P 3b8027a4bc0a4e35ac6aab073f21d476: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:42.019804 19800 tablet_bootstrap.cc:654] T 29087e95c203482e8bd456c852c1168a P 36835ca743ae4072a6c22883036de3cb: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:42.020227 19803 tablet_bootstrap.cc:492] T 29087e95c203482e8bd456c852c1168a P 3b8027a4bc0a4e35ac6aab073f21d476: No bootstrap required, opened a new log
I20260806 01:03:42.020285 19803 ts_tablet_manager.cc:1397] T 29087e95c203482e8bd456c852c1168a P 3b8027a4bc0a4e35ac6aab073f21d476: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:42.020435 19803 raft_consensus.cc:348] T 29087e95c203482e8bd456c852c1168a P 3b8027a4bc0a4e35ac6aab073f21d476 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.020505 19803 raft_consensus.cc:374] T 29087e95c203482e8bd456c852c1168a P 3b8027a4bc0a4e35ac6aab073f21d476 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:42.020525 19803 raft_consensus.cc:729] T 29087e95c203482e8bd456c852c1168a P 3b8027a4bc0a4e35ac6aab073f21d476 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b8027a4bc0a4e35ac6aab073f21d476, State: Initialized, Role: FOLLOWER
I20260806 01:03:42.020571 19803 consensus_queue.cc:260] T 29087e95c203482e8bd456c852c1168a P 3b8027a4bc0a4e35ac6aab073f21d476 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.020663 19803 ts_tablet_manager.cc:1428] T 29087e95c203482e8bd456c852c1168a P 3b8027a4bc0a4e35ac6aab073f21d476: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260806 01:03:42.020926 19822 raft_consensus.cc:2258] T acedb0ee552c46119c80852eda196405 P 3b8027a4bc0a4e35ac6aab073f21d476 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:42.020939 19250 catalog_manager.cc:4841] TS 36835ca743ae4072a6c22883036de3cb (127.11.88.65:37319): tablet acedb0ee552c46119c80852eda196405 (table test-table [id=033ebe3bda6242ca9ecaed6c9b79d299]) successfully deleted
I20260806 01:03:42.021397 19800 tablet_bootstrap.cc:492] T 29087e95c203482e8bd456c852c1168a P 36835ca743ae4072a6c22883036de3cb: No bootstrap required, opened a new log
I20260806 01:03:42.021445 19822 ts_tablet_manager.cc:1905] T acedb0ee552c46119c80852eda196405 P 3b8027a4bc0a4e35ac6aab073f21d476: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:42.021467 19800 ts_tablet_manager.cc:1397] T 29087e95c203482e8bd456c852c1168a P 36835ca743ae4072a6c22883036de3cb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 01:03:42.021615 19800 raft_consensus.cc:348] T 29087e95c203482e8bd456c852c1168a P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.021709 19800 raft_consensus.cc:374] T 29087e95c203482e8bd456c852c1168a P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:42.021735 19800 raft_consensus.cc:729] T 29087e95c203482e8bd456c852c1168a P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36835ca743ae4072a6c22883036de3cb, State: Initialized, Role: FOLLOWER
I20260806 01:03:42.021785 19800 consensus_queue.cc:260] T 29087e95c203482e8bd456c852c1168a P 36835ca743ae4072a6c22883036de3cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.022105 19800 ts_tablet_manager.cc:1428] T 29087e95c203482e8bd456c852c1168a P 36835ca743ae4072a6c22883036de3cb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:42.023546 19799 tablet_bootstrap.cc:492] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f: Bootstrap starting.
I20260806 01:03:42.023550 19822 ts_tablet_manager.cc:1918] T acedb0ee552c46119c80852eda196405 P 3b8027a4bc0a4e35ac6aab073f21d476: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:03:42.023625 19822 log.cc:1196] T acedb0ee552c46119c80852eda196405 P 3b8027a4bc0a4e35ac6aab073f21d476: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-1/wal/wals/acedb0ee552c46119c80852eda196405
I20260806 01:03:42.023937 19822 ts_tablet_manager.cc:1939] T acedb0ee552c46119c80852eda196405 P 3b8027a4bc0a4e35ac6aab073f21d476: Deleting consensus metadata
I20260806 01:03:42.024031 19799 tablet_bootstrap.cc:654] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:42.024463 19248 catalog_manager.cc:4841] TS 3b8027a4bc0a4e35ac6aab073f21d476 (127.11.88.66:34641): tablet acedb0ee552c46119c80852eda196405 (table test-table [id=033ebe3bda6242ca9ecaed6c9b79d299]) successfully deleted
I20260806 01:03:42.024659 19799 tablet_bootstrap.cc:492] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f: No bootstrap required, opened a new log
I20260806 01:03:42.024711 19799 ts_tablet_manager.cc:1397] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:42.024829 19799 raft_consensus.cc:348] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.024884 19799 raft_consensus.cc:374] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:42.024899 19799 raft_consensus.cc:729] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e7a527ca03d4c9ea9e0f9c37d81405f, State: Initialized, Role: FOLLOWER
I20260806 01:03:42.024969 19799 consensus_queue.cc:260] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.025066 19799 ts_tablet_manager.cc:1428] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:42.025544 19824 ts_tablet_manager.cc:1918] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:03:42.025633 19824 log.cc:1196] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-2/wal/wals/acedb0ee552c46119c80852eda196405
I20260806 01:03:42.025985 19824 ts_tablet_manager.cc:1939] T acedb0ee552c46119c80852eda196405 P 0e7a527ca03d4c9ea9e0f9c37d81405f: Deleting consensus metadata
I20260806 01:03:42.026430 19248 catalog_manager.cc:4841] TS 0e7a527ca03d4c9ea9e0f9c37d81405f (127.11.88.67:40765): tablet acedb0ee552c46119c80852eda196405 (table test-table [id=033ebe3bda6242ca9ecaed6c9b79d299]) successfully deleted
I20260806 01:03:42.050439 19817 raft_consensus.cc:482] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:03:42.050566 19817 raft_consensus.cc:504] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.050748 19817 leader_election.cc:288] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36835ca743ae4072a6c22883036de3cb (127.11.88.65:37319), 3b8027a4bc0a4e35ac6aab073f21d476 (127.11.88.66:34641)
I20260806 01:03:42.051090 19431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29087e95c203482e8bd456c852c1168a" candidate_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36835ca743ae4072a6c22883036de3cb" is_pre_election: true
I20260806 01:03:42.051008 19576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29087e95c203482e8bd456c852c1168a" candidate_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" is_pre_election: true
I20260806 01:03:42.051192 19431 raft_consensus.cc:2454] T 29087e95c203482e8bd456c852c1168a P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e7a527ca03d4c9ea9e0f9c37d81405f in term 0.
I20260806 01:03:42.051192 19576 raft_consensus.cc:2454] T 29087e95c203482e8bd456c852c1168a P 3b8027a4bc0a4e35ac6aab073f21d476 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e7a527ca03d4c9ea9e0f9c37d81405f in term 0.
I20260806 01:03:42.051380 19655 leader_election.cc:302] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e7a527ca03d4c9ea9e0f9c37d81405f, 36835ca743ae4072a6c22883036de3cb; no voters:
I20260806 01:03:42.051527 19817 raft_consensus.cc:2781] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:03:42.051565 19817 raft_consensus.cc:482] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:03:42.051585 19817 raft_consensus.cc:3037] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:42.052359 19817 raft_consensus.cc:504] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.052510 19817 leader_election.cc:288] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f [CANDIDATE]: Term 1 election: Requested vote from peers 36835ca743ae4072a6c22883036de3cb (127.11.88.65:37319), 3b8027a4bc0a4e35ac6aab073f21d476 (127.11.88.66:34641)
I20260806 01:03:42.052665 19576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29087e95c203482e8bd456c852c1168a" candidate_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b8027a4bc0a4e35ac6aab073f21d476"
I20260806 01:03:42.052754 19576 raft_consensus.cc:3037] T 29087e95c203482e8bd456c852c1168a P 3b8027a4bc0a4e35ac6aab073f21d476 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:42.052726 19431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29087e95c203482e8bd456c852c1168a" candidate_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36835ca743ae4072a6c22883036de3cb"
I20260806 01:03:42.052816 19431 raft_consensus.cc:3037] T 29087e95c203482e8bd456c852c1168a P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:42.053426 19431 raft_consensus.cc:2454] T 29087e95c203482e8bd456c852c1168a P 36835ca743ae4072a6c22883036de3cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e7a527ca03d4c9ea9e0f9c37d81405f in term 1.
I20260806 01:03:42.053530 19576 raft_consensus.cc:2454] T 29087e95c203482e8bd456c852c1168a P 3b8027a4bc0a4e35ac6aab073f21d476 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e7a527ca03d4c9ea9e0f9c37d81405f in term 1.
I20260806 01:03:42.053596 19655 leader_election.cc:302] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e7a527ca03d4c9ea9e0f9c37d81405f, 36835ca743ae4072a6c22883036de3cb; no voters:
I20260806 01:03:42.053694 19817 raft_consensus.cc:2781] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:42.053738 19817 raft_consensus.cc:686] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 1 LEADER]: Becoming Leader. State: Replica: 0e7a527ca03d4c9ea9e0f9c37d81405f, State: Running, Role: LEADER
I20260806 01:03:42.053789 19817 consensus_queue.cc:237] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.054545 19263 catalog_manager.cc:5495] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e7a527ca03d4c9ea9e0f9c37d81405f (127.11.88.67). New cstate: current_term: 1 leader_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } health_report { overall_health: HEALTHY } } }
Aug 06 01:03:42 dist-test-slave-69rg krb5kdc[19215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978221, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.126@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM
I20260806 01:03:42.083109 19835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:42.074732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:39593 (local address 127.0.0.1:60070)
0806 01:03:42.074956 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:42.074965 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:42.075052 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:42.075279 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:42.075279 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:42.075611 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:42.075668 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:42.075670 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.076339 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.076340 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:42.076869 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:42.076870 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.077221 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.077222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:42.077273 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:42.077932 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:42.077937 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:42.079651 (+ 1714us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:42.081542 (+ 1891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:42.081550 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:42.081552 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:42.081920 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:42.082356 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:42.082357 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:42.082358 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:42.082441 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:42.082762 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:42.082770 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:42.082821 (+ 51us) client_negotiation.cc:769] Sending connection context
0806 01:03:42.082884 (+ 63us) client_negotiation.cc:240] Negotiation successful
0806 01:03:42.083011 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":110,"threads_started":1}
I20260806 01:03:42.083209 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:42.074802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60070 (local address 127.11.88.126:39593)
0806 01:03:42.074882 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:42.074885 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:42.075031 (+ 146us) server_negotiation.cc:407] Connection header received
0806 01:03:42.075186 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:42.075187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:42.075198 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:42.075274 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:42.075750 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.076256 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.076952 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.077146 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.077223 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:42.079747 (+ 2524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:42.079749 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:42.079749 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:42.079758 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:42.081430 (+ 1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:42.082003 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:42.082005 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:42.082005 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:42.082074 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:42.082521 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:42.082522 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:42.082522 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:42.082675 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:42.082756 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:42.082933 (+ 177us) server_negotiation.cc:299] Negotiation successful
0806 01:03:42.083082 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":47}
I20260806 01:03:42.085651 19263 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:60070:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 01:03:42.085929 19263 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:03:42.087534 19553 tablet_service.cc:1467] Processing CreateTablet for tablet 1032725735e54399a50ac2caf911e1ca (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3332c39820da4983ab0daa56543fe794]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 01:03:42.087579 19409 tablet_service.cc:1467] Processing CreateTablet for tablet 1032725735e54399a50ac2caf911e1ca (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3332c39820da4983ab0daa56543fe794]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 01:03:42.087602 19700 tablet_service.cc:1467] Processing CreateTablet for tablet 1032725735e54399a50ac2caf911e1ca (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3332c39820da4983ab0daa56543fe794]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 01:03:42.087714 19409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1032725735e54399a50ac2caf911e1ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:42.087715 19553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1032725735e54399a50ac2caf911e1ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:42.087770 19700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1032725735e54399a50ac2caf911e1ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:42.089331 19800 tablet_bootstrap.cc:492] T 1032725735e54399a50ac2caf911e1ca P 36835ca743ae4072a6c22883036de3cb: Bootstrap starting.
I20260806 01:03:42.089349 19803 tablet_bootstrap.cc:492] T 1032725735e54399a50ac2caf911e1ca P 3b8027a4bc0a4e35ac6aab073f21d476: Bootstrap starting.
I20260806 01:03:42.089708 19800 tablet_bootstrap.cc:654] T 1032725735e54399a50ac2caf911e1ca P 36835ca743ae4072a6c22883036de3cb: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:42.089800 19803 tablet_bootstrap.cc:654] T 1032725735e54399a50ac2caf911e1ca P 3b8027a4bc0a4e35ac6aab073f21d476: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:42.090193 19799 tablet_bootstrap.cc:492] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f: Bootstrap starting.
I20260806 01:03:42.090507 19799 tablet_bootstrap.cc:654] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:42.090698 19800 tablet_bootstrap.cc:492] T 1032725735e54399a50ac2caf911e1ca P 36835ca743ae4072a6c22883036de3cb: No bootstrap required, opened a new log
I20260806 01:03:42.090768 19800 ts_tablet_manager.cc:1397] T 1032725735e54399a50ac2caf911e1ca P 36835ca743ae4072a6c22883036de3cb: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260806 01:03:42.090934 19800 raft_consensus.cc:348] T 1032725735e54399a50ac2caf911e1ca P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.091020 19800 raft_consensus.cc:374] T 1032725735e54399a50ac2caf911e1ca P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:42.091048 19800 raft_consensus.cc:729] T 1032725735e54399a50ac2caf911e1ca P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36835ca743ae4072a6c22883036de3cb, State: Initialized, Role: FOLLOWER
I20260806 01:03:42.091091 19800 consensus_queue.cc:260] T 1032725735e54399a50ac2caf911e1ca P 36835ca743ae4072a6c22883036de3cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.091212 19800 ts_tablet_manager.cc:1428] T 1032725735e54399a50ac2caf911e1ca P 36835ca743ae4072a6c22883036de3cb: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:42.091225 19803 tablet_bootstrap.cc:492] T 1032725735e54399a50ac2caf911e1ca P 3b8027a4bc0a4e35ac6aab073f21d476: No bootstrap required, opened a new log
I20260806 01:03:42.091274 19803 ts_tablet_manager.cc:1397] T 1032725735e54399a50ac2caf911e1ca P 3b8027a4bc0a4e35ac6aab073f21d476: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260806 01:03:42.091296 19806 tablet_replica.cc:439] T 1032725735e54399a50ac2caf911e1ca P 36835ca743ae4072a6c22883036de3cb: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } } }
I20260806 01:03:42.091391 19806 tablet_replica.cc:442] T 1032725735e54399a50ac2caf911e1ca P 36835ca743ae4072a6c22883036de3cb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 01:03:42.091427 19803 raft_consensus.cc:348] T 1032725735e54399a50ac2caf911e1ca P 3b8027a4bc0a4e35ac6aab073f21d476 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.091493 19803 raft_consensus.cc:374] T 1032725735e54399a50ac2caf911e1ca P 3b8027a4bc0a4e35ac6aab073f21d476 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:42.091512 19803 raft_consensus.cc:729] T 1032725735e54399a50ac2caf911e1ca P 3b8027a4bc0a4e35ac6aab073f21d476 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b8027a4bc0a4e35ac6aab073f21d476, State: Initialized, Role: FOLLOWER
I20260806 01:03:42.091555 19803 consensus_queue.cc:260] T 1032725735e54399a50ac2caf911e1ca P 3b8027a4bc0a4e35ac6aab073f21d476 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.091634 19803 ts_tablet_manager.cc:1428] T 1032725735e54399a50ac2caf911e1ca P 3b8027a4bc0a4e35ac6aab073f21d476: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260806 01:03:42.091777 19807 tablet_replica.cc:439] T 1032725735e54399a50ac2caf911e1ca P 3b8027a4bc0a4e35ac6aab073f21d476: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } } }
I20260806 01:03:42.091843 19807 tablet_replica.cc:442] T 1032725735e54399a50ac2caf911e1ca P 3b8027a4bc0a4e35ac6aab073f21d476: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 01:03:42.091919 19799 tablet_bootstrap.cc:492] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f: No bootstrap required, opened a new log
I20260806 01:03:42.091969 19799 ts_tablet_manager.cc:1397] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 01:03:42.092157 19799 raft_consensus.cc:348] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.092247 19799 raft_consensus.cc:374] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:42.092268 19799 raft_consensus.cc:729] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e7a527ca03d4c9ea9e0f9c37d81405f, State: Initialized, Role: FOLLOWER
I20260806 01:03:42.092306 19799 consensus_queue.cc:260] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.092388 19799 ts_tablet_manager.cc:1428] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260806 01:03:42.092427 19817 tablet_replica.cc:439] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } } }
I20260806 01:03:42.092509 19817 tablet_replica.cc:442] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 01:03:42.114843 19817 raft_consensus.cc:482] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:03:42.114940 19817 raft_consensus.cc:504] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.115101 19817 leader_election.cc:288] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36835ca743ae4072a6c22883036de3cb (127.11.88.65:37319), 3b8027a4bc0a4e35ac6aab073f21d476 (127.11.88.66:34641)
I20260806 01:03:42.115351 19576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1032725735e54399a50ac2caf911e1ca" candidate_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" is_pre_election: true
I20260806 01:03:42.115371 19431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1032725735e54399a50ac2caf911e1ca" candidate_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36835ca743ae4072a6c22883036de3cb" is_pre_election: true
I20260806 01:03:42.115468 19576 raft_consensus.cc:2454] T 1032725735e54399a50ac2caf911e1ca P 3b8027a4bc0a4e35ac6aab073f21d476 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e7a527ca03d4c9ea9e0f9c37d81405f in term 0.
I20260806 01:03:42.115484 19431 raft_consensus.cc:2454] T 1032725735e54399a50ac2caf911e1ca P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e7a527ca03d4c9ea9e0f9c37d81405f in term 0.
I20260806 01:03:42.115640 19653 leader_election.cc:302] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e7a527ca03d4c9ea9e0f9c37d81405f, 3b8027a4bc0a4e35ac6aab073f21d476; no voters:
I20260806 01:03:42.115769 19817 raft_consensus.cc:2781] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:03:42.115824 19817 raft_consensus.cc:482] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:03:42.115846 19817 raft_consensus.cc:3037] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:42.116710 19817 raft_consensus.cc:504] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.116856 19817 leader_election.cc:288] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f [CANDIDATE]: Term 1 election: Requested vote from peers 36835ca743ae4072a6c22883036de3cb (127.11.88.65:37319), 3b8027a4bc0a4e35ac6aab073f21d476 (127.11.88.66:34641)
I20260806 01:03:42.117028 19576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1032725735e54399a50ac2caf911e1ca" candidate_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b8027a4bc0a4e35ac6aab073f21d476"
I20260806 01:03:42.117075 19431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1032725735e54399a50ac2caf911e1ca" candidate_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36835ca743ae4072a6c22883036de3cb"
I20260806 01:03:42.117126 19576 raft_consensus.cc:3037] T 1032725735e54399a50ac2caf911e1ca P 3b8027a4bc0a4e35ac6aab073f21d476 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:42.117154 19431 raft_consensus.cc:3037] T 1032725735e54399a50ac2caf911e1ca P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:42.117949 19576 raft_consensus.cc:2454] T 1032725735e54399a50ac2caf911e1ca P 3b8027a4bc0a4e35ac6aab073f21d476 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e7a527ca03d4c9ea9e0f9c37d81405f in term 1.
I20260806 01:03:42.117949 19431 raft_consensus.cc:2454] T 1032725735e54399a50ac2caf911e1ca P 36835ca743ae4072a6c22883036de3cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e7a527ca03d4c9ea9e0f9c37d81405f in term 1.
I20260806 01:03:42.118151 19655 leader_election.cc:302] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e7a527ca03d4c9ea9e0f9c37d81405f, 36835ca743ae4072a6c22883036de3cb; no voters:
I20260806 01:03:42.118257 19817 raft_consensus.cc:2781] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:42.118305 19817 raft_consensus.cc:686] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 1 LEADER]: Becoming Leader. State: Replica: 0e7a527ca03d4c9ea9e0f9c37d81405f, State: Running, Role: LEADER
I20260806 01:03:42.118376 19817 consensus_queue.cc:237] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.118693 19809 tablet_replica.cc:439] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f: TxnStatusTablet state changed. Reason: New leader 0e7a527ca03d4c9ea9e0f9c37d81405f. Latest consensus state: current_term: 1 leader_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } } }
I20260806 01:03:42.118818 19809 tablet_replica.cc:442] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f: This TxnStatusTablet replica's current role is: LEADER
I20260806 01:03:42.119015 19840 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 01:03:42.119269 19840 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 01:03:42.119297 19263 catalog_manager.cc:5495] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e7a527ca03d4c9ea9e0f9c37d81405f (127.11.88.67). New cstate: current_term: 1 leader_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } health_report { overall_health: HEALTHY } } }
I20260806 01:03:42.131675 19796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:42.128846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41648 (local address 127.11.88.67:40765)
0806 01:03:42.128908 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:42.128911 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:42.128947 (+ 36us) server_negotiation.cc:407] Connection header received
0806 01:03:42.128970 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:42.128971 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:42.128982 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:42.129020 (+ 38us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:03:42.129181 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.129718 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.130846 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.131107 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.131171 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:42.131400 (+ 229us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:03:42.131435 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:03:42.131493 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:42.131582 (+ 89us) server_negotiation.cc:299] Negotiation successful
0806 01:03:42.131608 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 01:03:42.131731 19835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:42.128730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:40765 (local address 127.0.0.1:41648)
0806 01:03:42.128824 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:42.128840 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:42.128898 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:42.129054 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:42.129055 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:42.129057 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 01:03:42.129116 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:42.129119 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.129810 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.129811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:42.130735 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:42.130739 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.131193 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.131194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:42.131265 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:42.131287 (+ 22us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 01:03:42.131514 (+ 227us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 01:03:42.131525 (+ 11us) client_negotiation.cc:769] Sending connection context
0806 01:03:42.131577 (+ 52us) client_negotiation.cc:240] Negotiation successful
0806 01:03:42.131637 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260806 01:03:42.133080 19576 raft_consensus.cc:1261] T 1032725735e54399a50ac2caf911e1ca P 3b8027a4bc0a4e35ac6aab073f21d476 [term 1 FOLLOWER]: Refusing update from remote peer 0e7a527ca03d4c9ea9e0f9c37d81405f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:42.133070 19431 raft_consensus.cc:1261] T 1032725735e54399a50ac2caf911e1ca P 36835ca743ae4072a6c22883036de3cb [term 1 FOLLOWER]: Refusing update from remote peer 0e7a527ca03d4c9ea9e0f9c37d81405f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:42.133340 19817 consensus_queue.cc:1035] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:42.133503 19817 consensus_queue.cc:1035] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f [LEADER]: Connected to new peer: Peer: permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:42.134357 19807 tablet_replica.cc:439] T 1032725735e54399a50ac2caf911e1ca P 3b8027a4bc0a4e35ac6aab073f21d476: TxnStatusTablet state changed. Reason: New leader 0e7a527ca03d4c9ea9e0f9c37d81405f. Latest consensus state: current_term: 1 leader_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } } }
I20260806 01:03:42.134464 19807 tablet_replica.cc:442] T 1032725735e54399a50ac2caf911e1ca P 3b8027a4bc0a4e35ac6aab073f21d476: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 01:03:42.134686 19806 tablet_replica.cc:439] T 1032725735e54399a50ac2caf911e1ca P 36835ca743ae4072a6c22883036de3cb: TxnStatusTablet state changed. Reason: New leader 0e7a527ca03d4c9ea9e0f9c37d81405f. Latest consensus state: current_term: 1 leader_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } } }
I20260806 01:03:42.135026 19806 tablet_replica.cc:442] T 1032725735e54399a50ac2caf911e1ca P 36835ca743ae4072a6c22883036de3cb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 01:03:42.136158 19817 tablet_replica.cc:439] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } } }
I20260806 01:03:42.136264 19817 tablet_replica.cc:442] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f: This TxnStatusTablet replica's current role is: LEADER
I20260806 01:03:42.136523 19807 tablet_replica.cc:439] T 1032725735e54399a50ac2caf911e1ca P 3b8027a4bc0a4e35ac6aab073f21d476: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } } }
I20260806 01:03:42.136652 19807 tablet_replica.cc:442] T 1032725735e54399a50ac2caf911e1ca P 3b8027a4bc0a4e35ac6aab073f21d476: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 01:03:42.137336 19805 tablet_replica.cc:439] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } } }
I20260806 01:03:42.137428 19805 tablet_replica.cc:442] T 1032725735e54399a50ac2caf911e1ca P 0e7a527ca03d4c9ea9e0f9c37d81405f: This TxnStatusTablet replica's current role is: LEADER
I20260806 01:03:42.137898 19806 tablet_replica.cc:439] T 1032725735e54399a50ac2caf911e1ca P 36835ca743ae4072a6c22883036de3cb: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } } }
I20260806 01:03:42.138018 19806 tablet_replica.cc:442] T 1032725735e54399a50ac2caf911e1ca P 36835ca743ae4072a6c22883036de3cb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 01:03:42.142867 19777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:42.139907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:40765 (local address 127.11.88.67:39679)
0806 01:03:42.139992 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:42.140003 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:42.140058 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:42.140178 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:42.140179 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:42.140180 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 01:03:42.140242 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:42.140243 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.141233 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.141234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:42.141915 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:42.141917 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.142370 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.142371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:42.142421 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:42.142435 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 01:03:42.142669 (+ 234us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 01:03:42.142671 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 01:03:42.142705 (+ 34us) client_negotiation.cc:240] Negotiation successful
0806 01:03:42.142789 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260806 01:03:42.142874 19796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:42.139961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:39679 (local address 127.11.88.67:40765)
0806 01:03:42.140002 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:42.140004 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:42.140045 (+ 41us) server_negotiation.cc:407] Connection header received
0806 01:03:42.140101 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:42.140101 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:42.140113 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:42.140177 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:03:42.140305 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.141124 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.141976 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.142292 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.142372 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:42.142515 (+ 143us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:03:42.142550 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:03:42.142660 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:42.142709 (+ 49us) server_negotiation.cc:299] Negotiation successful
0806 01:03:42.142729 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":20}
I20260806 01:03:42.145169 19576 raft_consensus.cc:1261] T 29087e95c203482e8bd456c852c1168a P 3b8027a4bc0a4e35ac6aab073f21d476 [term 1 FOLLOWER]: Refusing update from remote peer 0e7a527ca03d4c9ea9e0f9c37d81405f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:42.145402 19817 consensus_queue.cc:1035] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:42.145650 19431 raft_consensus.cc:1261] T 29087e95c203482e8bd456c852c1168a P 36835ca743ae4072a6c22883036de3cb [term 1 FOLLOWER]: Refusing update from remote peer 0e7a527ca03d4c9ea9e0f9c37d81405f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:42.146328 19817 consensus_queue.cc:1035] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f [LEADER]: Connected to new peer: Peer: permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:42.157378 19264 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60056:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:42.157516 19264 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60056:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:42.158238 19264 catalog_manager.cc:5782] T 00000000000000000000000000000000 P efe4b41870f94ce792e7ad7110438c0e: Sending DeleteTablet for 3 replicas of tablet 29087e95c203482e8bd456c852c1168a
I20260806 01:03:42.158483 19409 tablet_service.cc:1514] Processing DeleteTablet for tablet 29087e95c203482e8bd456c852c1168a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:42 UTC) from {username='oryx', principal='oryx/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:41570
I20260806 01:03:42.158576 19823 tablet_replica.cc:330] T 29087e95c203482e8bd456c852c1168a P 36835ca743ae4072a6c22883036de3cb: stopping tablet replica
I20260806 01:03:42.158617 19823 raft_consensus.cc:2229] T 29087e95c203482e8bd456c852c1168a P 36835ca743ae4072a6c22883036de3cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:03:42.158568 19553 tablet_service.cc:1514] Processing DeleteTablet for tablet 29087e95c203482e8bd456c852c1168a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:42 UTC) from {username='oryx', principal='oryx/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:40450
I20260806 01:03:42.158650 19823 raft_consensus.cc:2258] T 29087e95c203482e8bd456c852c1168a P 36835ca743ae4072a6c22883036de3cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:42.158689 19822 tablet_replica.cc:330] T 29087e95c203482e8bd456c852c1168a P 3b8027a4bc0a4e35ac6aab073f21d476: stopping tablet replica
I20260806 01:03:42.158738 19822 raft_consensus.cc:2229] T 29087e95c203482e8bd456c852c1168a P 3b8027a4bc0a4e35ac6aab073f21d476 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:03:42.158776 19822 raft_consensus.cc:2258] T 29087e95c203482e8bd456c852c1168a P 3b8027a4bc0a4e35ac6aab073f21d476 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:42.158849 19700 tablet_service.cc:1514] Processing DeleteTablet for tablet 29087e95c203482e8bd456c852c1168a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:42 UTC) from {username='oryx', principal='oryx/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:41624
I20260806 01:03:42.158936 19824 tablet_replica.cc:330] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f: stopping tablet replica
I20260806 01:03:42.158941 19823 ts_tablet_manager.cc:1905] T 29087e95c203482e8bd456c852c1168a P 36835ca743ae4072a6c22883036de3cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:42.158980 19824 raft_consensus.cc:2229] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 1 LEADER]: Raft consensus shutting down.
I20260806 01:03:42.159030 19824 raft_consensus.cc:2258] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:42.159551 19822 ts_tablet_manager.cc:1905] T 29087e95c203482e8bd456c852c1168a P 3b8027a4bc0a4e35ac6aab073f21d476: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:42.160887 19823 ts_tablet_manager.cc:1918] T 29087e95c203482e8bd456c852c1168a P 36835ca743ae4072a6c22883036de3cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 01:03:42.160943 19823 log.cc:1196] T 29087e95c203482e8bd456c852c1168a P 36835ca743ae4072a6c22883036de3cb: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-0/wal/wals/29087e95c203482e8bd456c852c1168a
I20260806 01:03:42.161109 19822 ts_tablet_manager.cc:1918] T 29087e95c203482e8bd456c852c1168a P 3b8027a4bc0a4e35ac6aab073f21d476: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 01:03:42.161165 19822 log.cc:1196] T 29087e95c203482e8bd456c852c1168a P 3b8027a4bc0a4e35ac6aab073f21d476: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-1/wal/wals/29087e95c203482e8bd456c852c1168a
I20260806 01:03:42.161181 19823 ts_tablet_manager.cc:1939] T 29087e95c203482e8bd456c852c1168a P 36835ca743ae4072a6c22883036de3cb: Deleting consensus metadata
I20260806 01:03:42.161392 19822 ts_tablet_manager.cc:1939] T 29087e95c203482e8bd456c852c1168a P 3b8027a4bc0a4e35ac6aab073f21d476: Deleting consensus metadata
I20260806 01:03:42.161476 19824 ts_tablet_manager.cc:1905] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:42.161679 19248 catalog_manager.cc:4841] TS 3b8027a4bc0a4e35ac6aab073f21d476 (127.11.88.66:34641): tablet 29087e95c203482e8bd456c852c1168a (table test-table [id=06b766957ca9420a8ff9b1d11d0457dc]) successfully deleted
I20260806 01:03:42.162935 19824 ts_tablet_manager.cc:1918] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 01:03:42.163020 19824 log.cc:1196] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-2/wal/wals/29087e95c203482e8bd456c852c1168a
I20260806 01:03:42.163259 19824 ts_tablet_manager.cc:1939] T 29087e95c203482e8bd456c852c1168a P 0e7a527ca03d4c9ea9e0f9c37d81405f: Deleting consensus metadata
I20260806 01:03:42.163622 19248 catalog_manager.cc:4841] TS 0e7a527ca03d4c9ea9e0f9c37d81405f (127.11.88.67:40765): tablet 29087e95c203482e8bd456c852c1168a (table test-table [id=06b766957ca9420a8ff9b1d11d0457dc]) successfully deleted
I20260806 01:03:42.163769 19250 catalog_manager.cc:4841] TS 36835ca743ae4072a6c22883036de3cb (127.11.88.65:37319): tablet 29087e95c203482e8bd456c852c1168a (table test-table [id=06b766957ca9420a8ff9b1d11d0457dc]) successfully deleted
Aug 06 01:03:42 dist-test-slave-69rg krb5kdc[19215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978222, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 01:03:42 dist-test-slave-69rg krb5kdc[19215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:42 dist-test-slave-69rg krb5kdc[19215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
W20260806 01:03:42.185366 19321 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:42.179716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60084 (local address 127.11.88.126:39593)
0806 01:03:42.179789 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:42.179791 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:42.179898 (+ 107us) server_negotiation.cc:407] Connection header received
0806 01:03:42.179988 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:42.179989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:42.180001 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:42.180075 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:42.180722 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.181225 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.182057 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.182264 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.182342 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:42.185276 (+ 2934us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60084: BlockingRecv error: recv got EOF from 127.0.0.1:60084 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 06 01:03:42 dist-test-slave-69rg krb5kdc[19215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978222, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM
I20260806 01:03:42.193727 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:42.186401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60086 (local address 127.11.88.126:39593)
0806 01:03:42.186447 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:42.186449 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:42.186661 (+ 212us) server_negotiation.cc:407] Connection header received
0806 01:03:42.186745 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:42.186746 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:42.186763 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:42.186826 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:42.187365 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.187856 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.188557 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.188760 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.188836 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:42.191100 (+ 2264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:42.191102 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:42.191102 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:42.191111 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:42.192544 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:42.192911 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:42.192912 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:42.192912 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:42.192976 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:42.193183 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:42.193184 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:42.193185 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:42.193308 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:42.193416 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:42.193515 (+ 99us) server_negotiation.cc:299] Negotiation successful
0806 01:03:42.193604 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 01:03:42.195528 19264 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60086:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 01:03:42.195693 19264 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:03:42.197130 19409 tablet_service.cc:1467] Processing CreateTablet for tablet 9db5b5adfb954fb69703d583623dc117 (DEFAULT_TABLE table=test-table [id=df2b230bc8834e898659fb919eaf0042]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:42.197168 19700 tablet_service.cc:1467] Processing CreateTablet for tablet 9db5b5adfb954fb69703d583623dc117 (DEFAULT_TABLE table=test-table [id=df2b230bc8834e898659fb919eaf0042]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:42.197274 19409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9db5b5adfb954fb69703d583623dc117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:42.197317 19700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9db5b5adfb954fb69703d583623dc117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:42.198000 19553 tablet_service.cc:1467] Processing CreateTablet for tablet 9db5b5adfb954fb69703d583623dc117 (DEFAULT_TABLE table=test-table [id=df2b230bc8834e898659fb919eaf0042]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:42.198154 19553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9db5b5adfb954fb69703d583623dc117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:42.198653 19800 tablet_bootstrap.cc:492] T 9db5b5adfb954fb69703d583623dc117 P 36835ca743ae4072a6c22883036de3cb: Bootstrap starting.
I20260806 01:03:42.198748 19799 tablet_bootstrap.cc:492] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f: Bootstrap starting.
I20260806 01:03:42.199085 19799 tablet_bootstrap.cc:654] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:42.199092 19800 tablet_bootstrap.cc:654] T 9db5b5adfb954fb69703d583623dc117 P 36835ca743ae4072a6c22883036de3cb: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:42.199631 19803 tablet_bootstrap.cc:492] T 9db5b5adfb954fb69703d583623dc117 P 3b8027a4bc0a4e35ac6aab073f21d476: Bootstrap starting.
I20260806 01:03:42.199787 19799 tablet_bootstrap.cc:492] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f: No bootstrap required, opened a new log
I20260806 01:03:42.199843 19799 ts_tablet_manager.cc:1397] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:42.199970 19799 raft_consensus.cc:348] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.200042 19799 raft_consensus.cc:374] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:42.200062 19799 raft_consensus.cc:729] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e7a527ca03d4c9ea9e0f9c37d81405f, State: Initialized, Role: FOLLOWER
I20260806 01:03:42.200074 19803 tablet_bootstrap.cc:654] T 9db5b5adfb954fb69703d583623dc117 P 3b8027a4bc0a4e35ac6aab073f21d476: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:42.200104 19799 consensus_queue.cc:260] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.200189 19799 ts_tablet_manager.cc:1428] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260806 01:03:42.200696 19800 tablet_bootstrap.cc:492] T 9db5b5adfb954fb69703d583623dc117 P 36835ca743ae4072a6c22883036de3cb: No bootstrap required, opened a new log
I20260806 01:03:42.200774 19800 ts_tablet_manager.cc:1397] T 9db5b5adfb954fb69703d583623dc117 P 36835ca743ae4072a6c22883036de3cb: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260806 01:03:42.200989 19800 raft_consensus.cc:348] T 9db5b5adfb954fb69703d583623dc117 P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.201074 19803 tablet_bootstrap.cc:492] T 9db5b5adfb954fb69703d583623dc117 P 3b8027a4bc0a4e35ac6aab073f21d476: No bootstrap required, opened a new log
I20260806 01:03:42.201097 19800 raft_consensus.cc:374] T 9db5b5adfb954fb69703d583623dc117 P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:42.201122 19800 raft_consensus.cc:729] T 9db5b5adfb954fb69703d583623dc117 P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36835ca743ae4072a6c22883036de3cb, State: Initialized, Role: FOLLOWER
I20260806 01:03:42.201121 19803 ts_tablet_manager.cc:1397] T 9db5b5adfb954fb69703d583623dc117 P 3b8027a4bc0a4e35ac6aab073f21d476: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260806 01:03:42.201174 19800 consensus_queue.cc:260] T 9db5b5adfb954fb69703d583623dc117 P 36835ca743ae4072a6c22883036de3cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.201267 19800 ts_tablet_manager.cc:1428] T 9db5b5adfb954fb69703d583623dc117 P 36835ca743ae4072a6c22883036de3cb: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260806 01:03:42.201272 19803 raft_consensus.cc:348] T 9db5b5adfb954fb69703d583623dc117 P 3b8027a4bc0a4e35ac6aab073f21d476 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.201345 19803 raft_consensus.cc:374] T 9db5b5adfb954fb69703d583623dc117 P 3b8027a4bc0a4e35ac6aab073f21d476 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:42.201371 19803 raft_consensus.cc:729] T 9db5b5adfb954fb69703d583623dc117 P 3b8027a4bc0a4e35ac6aab073f21d476 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b8027a4bc0a4e35ac6aab073f21d476, State: Initialized, Role: FOLLOWER
I20260806 01:03:42.201412 19803 consensus_queue.cc:260] T 9db5b5adfb954fb69703d583623dc117 P 3b8027a4bc0a4e35ac6aab073f21d476 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.201501 19803 ts_tablet_manager.cc:1428] T 9db5b5adfb954fb69703d583623dc117 P 3b8027a4bc0a4e35ac6aab073f21d476: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260806 01:03:42.254688 19809 raft_consensus.cc:482] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:03:42.254814 19809 raft_consensus.cc:504] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.255002 19809 leader_election.cc:288] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36835ca743ae4072a6c22883036de3cb (127.11.88.65:37319), 3b8027a4bc0a4e35ac6aab073f21d476 (127.11.88.66:34641)
I20260806 01:03:42.255230 19431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9db5b5adfb954fb69703d583623dc117" candidate_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36835ca743ae4072a6c22883036de3cb" is_pre_election: true
I20260806 01:03:42.255245 19576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9db5b5adfb954fb69703d583623dc117" candidate_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" is_pre_election: true
I20260806 01:03:42.255357 19431 raft_consensus.cc:2454] T 9db5b5adfb954fb69703d583623dc117 P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e7a527ca03d4c9ea9e0f9c37d81405f in term 0.
I20260806 01:03:42.255371 19576 raft_consensus.cc:2454] T 9db5b5adfb954fb69703d583623dc117 P 3b8027a4bc0a4e35ac6aab073f21d476 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e7a527ca03d4c9ea9e0f9c37d81405f in term 0.
I20260806 01:03:42.255559 19655 leader_election.cc:302] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e7a527ca03d4c9ea9e0f9c37d81405f, 36835ca743ae4072a6c22883036de3cb; no voters:
I20260806 01:03:42.255709 19809 raft_consensus.cc:2781] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:03:42.255780 19809 raft_consensus.cc:482] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:03:42.255813 19809 raft_consensus.cc:3037] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:42.256609 19809 raft_consensus.cc:504] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.256767 19809 leader_election.cc:288] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f [CANDIDATE]: Term 1 election: Requested vote from peers 36835ca743ae4072a6c22883036de3cb (127.11.88.65:37319), 3b8027a4bc0a4e35ac6aab073f21d476 (127.11.88.66:34641)
I20260806 01:03:42.256951 19431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9db5b5adfb954fb69703d583623dc117" candidate_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36835ca743ae4072a6c22883036de3cb"
I20260806 01:03:42.256979 19576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9db5b5adfb954fb69703d583623dc117" candidate_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b8027a4bc0a4e35ac6aab073f21d476"
I20260806 01:03:42.257062 19576 raft_consensus.cc:3037] T 9db5b5adfb954fb69703d583623dc117 P 3b8027a4bc0a4e35ac6aab073f21d476 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:42.257063 19431 raft_consensus.cc:3037] T 9db5b5adfb954fb69703d583623dc117 P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:42.257865 19431 raft_consensus.cc:2454] T 9db5b5adfb954fb69703d583623dc117 P 36835ca743ae4072a6c22883036de3cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e7a527ca03d4c9ea9e0f9c37d81405f in term 1.
I20260806 01:03:42.257980 19576 raft_consensus.cc:2454] T 9db5b5adfb954fb69703d583623dc117 P 3b8027a4bc0a4e35ac6aab073f21d476 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e7a527ca03d4c9ea9e0f9c37d81405f in term 1.
I20260806 01:03:42.258073 19655 leader_election.cc:302] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e7a527ca03d4c9ea9e0f9c37d81405f, 36835ca743ae4072a6c22883036de3cb; no voters:
I20260806 01:03:42.258203 19809 raft_consensus.cc:2781] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:42.258275 19809 raft_consensus.cc:686] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 1 LEADER]: Becoming Leader. State: Replica: 0e7a527ca03d4c9ea9e0f9c37d81405f, State: Running, Role: LEADER
I20260806 01:03:42.258337 19809 consensus_queue.cc:237] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.258935 19263 catalog_manager.cc:5495] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e7a527ca03d4c9ea9e0f9c37d81405f (127.11.88.67). New cstate: current_term: 1 leader_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } health_report { overall_health: HEALTHY } } }
I20260806 01:03:42.278601 19796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:42.276153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41654 (local address 127.11.88.67:40765)
0806 01:03:42.276211 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:42.276214 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:42.276228 (+ 14us) server_negotiation.cc:407] Connection header received
0806 01:03:42.276306 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:42.276307 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:42.276318 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:42.276391 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:03:42.276527 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.277007 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.277802 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.278069 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.278150 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:42.278318 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:03:42.278357 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:03:42.278420 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:42.278476 (+ 56us) server_negotiation.cc:299] Negotiation successful
0806 01:03:42.278501 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260806 01:03:42.279541 19431 raft_consensus.cc:1261] T 9db5b5adfb954fb69703d583623dc117 P 36835ca743ae4072a6c22883036de3cb [term 1 FOLLOWER]: Refusing update from remote peer 0e7a527ca03d4c9ea9e0f9c37d81405f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:42.279563 19576 raft_consensus.cc:1261] T 9db5b5adfb954fb69703d583623dc117 P 3b8027a4bc0a4e35ac6aab073f21d476 [term 1 FOLLOWER]: Refusing update from remote peer 0e7a527ca03d4c9ea9e0f9c37d81405f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:42.279801 19817 consensus_queue.cc:1035] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f [LEADER]: Connected to new peer: Peer: permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:42.279927 19809 consensus_queue.cc:1035] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:42.282944 19263 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:42.283068 19263 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:42.283735 19263 catalog_manager.cc:5782] T 00000000000000000000000000000000 P efe4b41870f94ce792e7ad7110438c0e: Sending DeleteTablet for 3 replicas of tablet 9db5b5adfb954fb69703d583623dc117
I20260806 01:03:42.284035 19409 tablet_service.cc:1514] Processing DeleteTablet for tablet 9db5b5adfb954fb69703d583623dc117 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:42 UTC) from {username='oryx', principal='oryx/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:41570
I20260806 01:03:42.284235 19823 tablet_replica.cc:330] T 9db5b5adfb954fb69703d583623dc117 P 36835ca743ae4072a6c22883036de3cb: stopping tablet replica
I20260806 01:03:42.284235 19553 tablet_service.cc:1514] Processing DeleteTablet for tablet 9db5b5adfb954fb69703d583623dc117 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:42 UTC) from {username='oryx', principal='oryx/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:40450
I20260806 01:03:42.284305 19823 raft_consensus.cc:2229] T 9db5b5adfb954fb69703d583623dc117 P 36835ca743ae4072a6c22883036de3cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:03:42.284319 19822 tablet_replica.cc:330] T 9db5b5adfb954fb69703d583623dc117 P 3b8027a4bc0a4e35ac6aab073f21d476: stopping tablet replica
I20260806 01:03:42.284360 19823 raft_consensus.cc:2258] T 9db5b5adfb954fb69703d583623dc117 P 36835ca743ae4072a6c22883036de3cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:42.284361 19822 raft_consensus.cc:2229] T 9db5b5adfb954fb69703d583623dc117 P 3b8027a4bc0a4e35ac6aab073f21d476 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:03:42.284404 19822 raft_consensus.cc:2258] T 9db5b5adfb954fb69703d583623dc117 P 3b8027a4bc0a4e35ac6aab073f21d476 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:42.284444 19700 tablet_service.cc:1514] Processing DeleteTablet for tablet 9db5b5adfb954fb69703d583623dc117 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:42 UTC) from {username='oryx', principal='oryx/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:41624
I20260806 01:03:42.284525 19824 tablet_replica.cc:330] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f: stopping tablet replica
I20260806 01:03:42.284562 19824 raft_consensus.cc:2229] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 1 LEADER]: Raft consensus shutting down.
I20260806 01:03:42.284626 19824 raft_consensus.cc:2258] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:42.284850 19822 ts_tablet_manager.cc:1905] T 9db5b5adfb954fb69703d583623dc117 P 3b8027a4bc0a4e35ac6aab073f21d476: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:42.284924 19823 ts_tablet_manager.cc:1905] T 9db5b5adfb954fb69703d583623dc117 P 36835ca743ae4072a6c22883036de3cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:42.285893 19263 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60086:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 01:03:42.286343 19263 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:03:42.286741 19824 ts_tablet_manager.cc:1905] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:42.286810 19822 ts_tablet_manager.cc:1918] T 9db5b5adfb954fb69703d583623dc117 P 3b8027a4bc0a4e35ac6aab073f21d476: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:03:42.286865 19822 log.cc:1196] T 9db5b5adfb954fb69703d583623dc117 P 3b8027a4bc0a4e35ac6aab073f21d476: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-1/wal/wals/9db5b5adfb954fb69703d583623dc117
I20260806 01:03:42.286875 19823 ts_tablet_manager.cc:1918] T 9db5b5adfb954fb69703d583623dc117 P 36835ca743ae4072a6c22883036de3cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:03:42.286933 19823 log.cc:1196] T 9db5b5adfb954fb69703d583623dc117 P 36835ca743ae4072a6c22883036de3cb: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-0/wal/wals/9db5b5adfb954fb69703d583623dc117
I20260806 01:03:42.287106 19822 ts_tablet_manager.cc:1939] T 9db5b5adfb954fb69703d583623dc117 P 3b8027a4bc0a4e35ac6aab073f21d476: Deleting consensus metadata
I20260806 01:03:42.287147 19823 ts_tablet_manager.cc:1939] T 9db5b5adfb954fb69703d583623dc117 P 36835ca743ae4072a6c22883036de3cb: Deleting consensus metadata
I20260806 01:03:42.287456 19250 catalog_manager.cc:4841] TS 36835ca743ae4072a6c22883036de3cb (127.11.88.65:37319): tablet 9db5b5adfb954fb69703d583623dc117 (table test-table [id=df2b230bc8834e898659fb919eaf0042]) successfully deleted
I20260806 01:03:42.287534 19248 catalog_manager.cc:4841] TS 3b8027a4bc0a4e35ac6aab073f21d476 (127.11.88.66:34641): tablet 9db5b5adfb954fb69703d583623dc117 (table test-table [id=df2b230bc8834e898659fb919eaf0042]) successfully deleted
I20260806 01:03:42.288368 19409 tablet_service.cc:1467] Processing CreateTablet for tablet 1b45927ecc9c4d2eb07c50b32144324e (DEFAULT_TABLE table=test-table [id=8b46c0c942f144c98cea6a643243648b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:42.288492 19409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b45927ecc9c4d2eb07c50b32144324e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:42.288523 19824 ts_tablet_manager.cc:1918] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:03:42.288581 19824 log.cc:1196] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-2/wal/wals/9db5b5adfb954fb69703d583623dc117
I20260806 01:03:42.288801 19824 ts_tablet_manager.cc:1939] T 9db5b5adfb954fb69703d583623dc117 P 0e7a527ca03d4c9ea9e0f9c37d81405f: Deleting consensus metadata
I20260806 01:03:42.289583 19800 tablet_bootstrap.cc:492] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb: Bootstrap starting.
I20260806 01:03:42.289878 19248 catalog_manager.cc:4841] TS 0e7a527ca03d4c9ea9e0f9c37d81405f (127.11.88.67:40765): tablet 9db5b5adfb954fb69703d583623dc117 (table test-table [id=df2b230bc8834e898659fb919eaf0042]) successfully deleted
I20260806 01:03:42.289960 19553 tablet_service.cc:1467] Processing CreateTablet for tablet 1b45927ecc9c4d2eb07c50b32144324e (DEFAULT_TABLE table=test-table [id=8b46c0c942f144c98cea6a643243648b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:42.290051 19800 tablet_bootstrap.cc:654] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:42.290041 19700 tablet_service.cc:1467] Processing CreateTablet for tablet 1b45927ecc9c4d2eb07c50b32144324e (DEFAULT_TABLE table=test-table [id=8b46c0c942f144c98cea6a643243648b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:03:42.290071 19553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b45927ecc9c4d2eb07c50b32144324e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:42.290135 19700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b45927ecc9c4d2eb07c50b32144324e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:42.291406 19799 tablet_bootstrap.cc:492] T 1b45927ecc9c4d2eb07c50b32144324e P 0e7a527ca03d4c9ea9e0f9c37d81405f: Bootstrap starting.
I20260806 01:03:42.291548 19800 tablet_bootstrap.cc:492] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb: No bootstrap required, opened a new log
I20260806 01:03:42.291582 19800 ts_tablet_manager.cc:1397] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260806 01:03:42.291706 19799 tablet_bootstrap.cc:654] T 1b45927ecc9c4d2eb07c50b32144324e P 0e7a527ca03d4c9ea9e0f9c37d81405f: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:42.291698 19800 raft_consensus.cc:348] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.291747 19800 raft_consensus.cc:374] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:42.291761 19800 raft_consensus.cc:729] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36835ca743ae4072a6c22883036de3cb, State: Initialized, Role: FOLLOWER
I20260806 01:03:42.291844 19800 consensus_queue.cc:260] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.291944 19800 ts_tablet_manager.cc:1428] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260806 01:03:42.292236 19799 tablet_bootstrap.cc:492] T 1b45927ecc9c4d2eb07c50b32144324e P 0e7a527ca03d4c9ea9e0f9c37d81405f: No bootstrap required, opened a new log
I20260806 01:03:42.292285 19799 ts_tablet_manager.cc:1397] T 1b45927ecc9c4d2eb07c50b32144324e P 0e7a527ca03d4c9ea9e0f9c37d81405f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:42.292387 19799 raft_consensus.cc:348] T 1b45927ecc9c4d2eb07c50b32144324e P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.292479 19799 raft_consensus.cc:374] T 1b45927ecc9c4d2eb07c50b32144324e P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:42.292502 19799 raft_consensus.cc:729] T 1b45927ecc9c4d2eb07c50b32144324e P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e7a527ca03d4c9ea9e0f9c37d81405f, State: Initialized, Role: FOLLOWER
I20260806 01:03:42.292554 19799 consensus_queue.cc:260] T 1b45927ecc9c4d2eb07c50b32144324e P 0e7a527ca03d4c9ea9e0f9c37d81405f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.292649 19799 ts_tablet_manager.cc:1428] T 1b45927ecc9c4d2eb07c50b32144324e P 0e7a527ca03d4c9ea9e0f9c37d81405f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:42.292858 19803 tablet_bootstrap.cc:492] T 1b45927ecc9c4d2eb07c50b32144324e P 3b8027a4bc0a4e35ac6aab073f21d476: Bootstrap starting.
I20260806 01:03:42.293318 19803 tablet_bootstrap.cc:654] T 1b45927ecc9c4d2eb07c50b32144324e P 3b8027a4bc0a4e35ac6aab073f21d476: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:42.294366 19803 tablet_bootstrap.cc:492] T 1b45927ecc9c4d2eb07c50b32144324e P 3b8027a4bc0a4e35ac6aab073f21d476: No bootstrap required, opened a new log
I20260806 01:03:42.294421 19803 ts_tablet_manager.cc:1397] T 1b45927ecc9c4d2eb07c50b32144324e P 3b8027a4bc0a4e35ac6aab073f21d476: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 01:03:42.294562 19803 raft_consensus.cc:348] T 1b45927ecc9c4d2eb07c50b32144324e P 3b8027a4bc0a4e35ac6aab073f21d476 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.294631 19803 raft_consensus.cc:374] T 1b45927ecc9c4d2eb07c50b32144324e P 3b8027a4bc0a4e35ac6aab073f21d476 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:42.294648 19803 raft_consensus.cc:729] T 1b45927ecc9c4d2eb07c50b32144324e P 3b8027a4bc0a4e35ac6aab073f21d476 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b8027a4bc0a4e35ac6aab073f21d476, State: Initialized, Role: FOLLOWER
I20260806 01:03:42.294694 19803 consensus_queue.cc:260] T 1b45927ecc9c4d2eb07c50b32144324e P 3b8027a4bc0a4e35ac6aab073f21d476 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.294776 19803 ts_tablet_manager.cc:1428] T 1b45927ecc9c4d2eb07c50b32144324e P 3b8027a4bc0a4e35ac6aab073f21d476: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:42.404417 19806 raft_consensus.cc:482] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:03:42.404564 19806 raft_consensus.cc:504] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.404944 19806 leader_election.cc:288] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b8027a4bc0a4e35ac6aab073f21d476 (127.11.88.66:34641), 0e7a527ca03d4c9ea9e0f9c37d81405f (127.11.88.67:40765)
I20260806 01:03:42.408674 19798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:42.405296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:56235 (local address 127.11.88.66:34641)
0806 01:03:42.405358 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:42.405360 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:42.405446 (+ 86us) server_negotiation.cc:407] Connection header received
0806 01:03:42.405513 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:42.405514 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:42.405525 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:42.405603 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:42.405799 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.406509 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.407744 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.408272 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.408383 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:42.408392 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:42.408553 (+ 161us) server_negotiation.cc:299] Negotiation successful
0806 01:03:42.408599 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260806 01:03:42.408704 19874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:42.405436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:40765 (local address 127.11.88.65:42105)
0806 01:03:42.405629 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:42.405640 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:42.405702 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:42.405843 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:42.405844 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:42.405845 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:42.405901 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:42.405902 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.406646 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.406648 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:42.407747 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:42.407749 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.408432 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.408433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:42.408501 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:42.408523 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 01:03:42.408581 (+ 58us) client_negotiation.cc:240] Negotiation successful
0806 01:03:42.408617 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":29,"thread_start_us":93,"threads_started":1}
I20260806 01:03:42.408710 19796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:42.405528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:42105 (local address 127.11.88.67:40765)
0806 01:03:42.405605 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:42.405608 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:42.405712 (+ 104us) server_negotiation.cc:407] Connection header received
0806 01:03:42.405747 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:42.405748 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:42.405762 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:42.405847 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:03:42.406000 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.406536 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.407819 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.408362 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.408436 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:42.408444 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:42.408598 (+ 154us) server_negotiation.cc:299] Negotiation successful
0806 01:03:42.408640 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 01:03:42.408739 19872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:42.405211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:34641 (local address 127.11.88.65:56235)
0806 01:03:42.405361 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:42.405374 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:42.405444 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:42.405619 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:42.405620 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:42.405623 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:03:42.405712 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:42.405714 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.406668 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.406669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:42.407611 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:42.407613 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.408406 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.408407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:42.408471 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:42.408475 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:03:42.408527 (+ 52us) client_negotiation.cc:240] Negotiation successful
0806 01:03:42.408595 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":23,"thread_start_us":101,"threads_started":1}
I20260806 01:03:42.409040 19576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b45927ecc9c4d2eb07c50b32144324e" candidate_uuid: "36835ca743ae4072a6c22883036de3cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" is_pre_election: true
I20260806 01:03:42.409137 19576 raft_consensus.cc:2454] T 1b45927ecc9c4d2eb07c50b32144324e P 3b8027a4bc0a4e35ac6aab073f21d476 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36835ca743ae4072a6c22883036de3cb in term 0.
I20260806 01:03:42.409089 19721 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b45927ecc9c4d2eb07c50b32144324e" candidate_uuid: "36835ca743ae4072a6c22883036de3cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" is_pre_election: true
I20260806 01:03:42.409255 19721 raft_consensus.cc:2454] T 1b45927ecc9c4d2eb07c50b32144324e P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36835ca743ae4072a6c22883036de3cb in term 0.
I20260806 01:03:42.409371 19358 leader_election.cc:302] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36835ca743ae4072a6c22883036de3cb, 3b8027a4bc0a4e35ac6aab073f21d476; no voters:
I20260806 01:03:42.409523 19806 raft_consensus.cc:2781] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:03:42.409557 19806 raft_consensus.cc:482] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:03:42.409582 19806 raft_consensus.cc:3037] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:42.410313 19806 raft_consensus.cc:504] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.410459 19806 leader_election.cc:288] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb [CANDIDATE]: Term 1 election: Requested vote from peers 3b8027a4bc0a4e35ac6aab073f21d476 (127.11.88.66:34641), 0e7a527ca03d4c9ea9e0f9c37d81405f (127.11.88.67:40765)
I20260806 01:03:42.410615 19576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b45927ecc9c4d2eb07c50b32144324e" candidate_uuid: "36835ca743ae4072a6c22883036de3cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b8027a4bc0a4e35ac6aab073f21d476"
I20260806 01:03:42.410646 19721 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b45927ecc9c4d2eb07c50b32144324e" candidate_uuid: "36835ca743ae4072a6c22883036de3cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f"
I20260806 01:03:42.410693 19576 raft_consensus.cc:3037] T 1b45927ecc9c4d2eb07c50b32144324e P 3b8027a4bc0a4e35ac6aab073f21d476 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:42.410750 19721 raft_consensus.cc:3037] T 1b45927ecc9c4d2eb07c50b32144324e P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:42.411345 19576 raft_consensus.cc:2454] T 1b45927ecc9c4d2eb07c50b32144324e P 3b8027a4bc0a4e35ac6aab073f21d476 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36835ca743ae4072a6c22883036de3cb in term 1.
I20260806 01:03:42.411476 19721 raft_consensus.cc:2454] T 1b45927ecc9c4d2eb07c50b32144324e P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36835ca743ae4072a6c22883036de3cb in term 1.
I20260806 01:03:42.411505 19358 leader_election.cc:302] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36835ca743ae4072a6c22883036de3cb, 3b8027a4bc0a4e35ac6aab073f21d476; no voters:
I20260806 01:03:42.411597 19806 raft_consensus.cc:2781] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:42.411759 19806 raft_consensus.cc:686] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb [term 1 LEADER]: Becoming Leader. State: Replica: 36835ca743ae4072a6c22883036de3cb, State: Running, Role: LEADER
I20260806 01:03:42.411854 19806 consensus_queue.cc:237] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } }
I20260806 01:03:42.412546 19263 catalog_manager.cc:5495] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 36835ca743ae4072a6c22883036de3cb (127.11.88.65). New cstate: current_term: 1 leader_uuid: "36835ca743ae4072a6c22883036de3cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36835ca743ae4072a6c22883036de3cb" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 37319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 } health_report { overall_health: UNKNOWN } } }
I20260806 01:03:42.444257 19794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:42.441654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41572 (local address 127.11.88.65:37319)
0806 01:03:42.441701 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:42.441703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:42.441714 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:03:42.441808 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:42.441808 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:42.441878 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:42.441958 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:03:42.442101 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.442673 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.443485 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.443688 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.443747 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:42.443930 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:03:42.444039 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:03:42.444100 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:42.444174 (+ 74us) server_negotiation.cc:299] Negotiation successful
0806 01:03:42.444192 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 01:03:42.449242 19796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:42.447006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:52437 (local address 127.11.88.67:40765)
0806 01:03:42.447054 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:42.447056 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:42.447168 (+ 112us) server_negotiation.cc:407] Connection header received
0806 01:03:42.447232 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:42.447233 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:42.447242 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:42.447285 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:03:42.447474 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.447929 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.448647 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.448821 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.448871 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:42.449045 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:03:42.449070 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:03:42.449139 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:42.449168 (+ 29us) server_negotiation.cc:299] Negotiation successful
0806 01:03:42.449184 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 01:03:42.449270 19879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:42.446938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:40765 (local address 127.11.88.65:52437)
0806 01:03:42.447105 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:42.447116 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:42.447178 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:42.447327 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:42.447328 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:42.447330 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 01:03:42.447405 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:42.447406 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.448000 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.448001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:42.448574 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:42.448576 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.448907 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.448908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:42.448959 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:42.448973 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 01:03:42.449126 (+ 153us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 01:03:42.449128 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 01:03:42.449161 (+ 33us) client_negotiation.cc:240] Negotiation successful
0806 01:03:42.449197 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":96,"threads_started":1}
I20260806 01:03:42.451871 19576 raft_consensus.cc:1261] T 1b45927ecc9c4d2eb07c50b32144324e P 3b8027a4bc0a4e35ac6aab073f21d476 [term 1 FOLLOWER]: Refusing update from remote peer 36835ca743ae4072a6c22883036de3cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:42.451983 19721 raft_consensus.cc:1261] T 1b45927ecc9c4d2eb07c50b32144324e P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 1 FOLLOWER]: Refusing update from remote peer 36835ca743ae4072a6c22883036de3cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:03:42.452142 19875 consensus_queue.cc:1035] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b8027a4bc0a4e35ac6aab073f21d476" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:42.452257 19806 consensus_queue.cc:1035] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e7a527ca03d4c9ea9e0f9c37d81405f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:03:42.460281 19777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:42.457657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:37319 (local address 127.11.88.67:43353)
0806 01:03:42.457705 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:42.457716 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:42.457754 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:42.457912 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:42.457913 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:42.457915 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 01:03:42.457958 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:42.457959 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.458723 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.458724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:42.459267 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:42.459269 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.459859 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.459860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:42.459909 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:42.459914 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 01:03:42.460106 (+ 192us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 01:03:42.460109 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:03:42.460156 (+ 47us) client_negotiation.cc:240] Negotiation successful
0806 01:03:42.460206 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260806 01:03:42.460268 19794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:42.457694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:43353 (local address 127.11.88.65:37319)
0806 01:03:42.457733 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:42.457735 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:42.457744 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:03:42.457806 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:42.457807 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:42.457840 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:42.457895 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:03:42.458073 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.458627 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.459416 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:42.459757 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:42.459863 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:42.460002 (+ 139us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:03:42.460041 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:03:42.460091 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:42.460170 (+ 79us) server_negotiation.cc:299] Negotiation successful
0806 01:03:42.460194 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260806 01:03:42.467020 19263 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:42.467142 19263 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:03:42.467830 19263 catalog_manager.cc:5782] T 00000000000000000000000000000000 P efe4b41870f94ce792e7ad7110438c0e: Sending DeleteTablet for 3 replicas of tablet 1b45927ecc9c4d2eb07c50b32144324e
I20260806 01:03:42.468163 19553 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b45927ecc9c4d2eb07c50b32144324e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:42 UTC) from {username='oryx', principal='oryx/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:40450
I20260806 01:03:42.468206 19700 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b45927ecc9c4d2eb07c50b32144324e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:42 UTC) from {username='oryx', principal='oryx/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:41624
I20260806 01:03:42.468272 19822 tablet_replica.cc:330] T 1b45927ecc9c4d2eb07c50b32144324e P 3b8027a4bc0a4e35ac6aab073f21d476: stopping tablet replica
I20260806 01:03:42.468303 19824 tablet_replica.cc:330] T 1b45927ecc9c4d2eb07c50b32144324e P 0e7a527ca03d4c9ea9e0f9c37d81405f: stopping tablet replica
I20260806 01:03:42.468320 19822 raft_consensus.cc:2229] T 1b45927ecc9c4d2eb07c50b32144324e P 3b8027a4bc0a4e35ac6aab073f21d476 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:03:42.468349 19824 raft_consensus.cc:2229] T 1b45927ecc9c4d2eb07c50b32144324e P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:03:42.468362 19822 raft_consensus.cc:2258] T 1b45927ecc9c4d2eb07c50b32144324e P 3b8027a4bc0a4e35ac6aab073f21d476 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:42.468385 19824 raft_consensus.cc:2258] T 1b45927ecc9c4d2eb07c50b32144324e P 0e7a527ca03d4c9ea9e0f9c37d81405f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:42.468657 19409 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b45927ecc9c4d2eb07c50b32144324e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:03:42 UTC) from {username='oryx', principal='oryx/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:41570
I20260806 01:03:42.468750 19823 tablet_replica.cc:330] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb: stopping tablet replica
I20260806 01:03:42.468745 19822 ts_tablet_manager.cc:1905] T 1b45927ecc9c4d2eb07c50b32144324e P 3b8027a4bc0a4e35ac6aab073f21d476: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:42.468811 19823 raft_consensus.cc:2229] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb [term 1 LEADER]: Raft consensus shutting down.
I20260806 01:03:42.468816 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 19340
I20260806 01:03:42.468885 19823 raft_consensus.cc:2258] T 1b45927ecc9c4d2eb07c50b32144324e P 36835ca743ae4072a6c22883036de3cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:03:42.469686 19824 ts_tablet_manager.cc:1905] T 1b45927ecc9c4d2eb07c50b32144324e P 0e7a527ca03d4c9ea9e0f9c37d81405f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:03:42.470758 19822 ts_tablet_manager.cc:1918] T 1b45927ecc9c4d2eb07c50b32144324e P 3b8027a4bc0a4e35ac6aab073f21d476: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 01:03:42.470824 19822 log.cc:1196] T 1b45927ecc9c4d2eb07c50b32144324e P 3b8027a4bc0a4e35ac6aab073f21d476: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-1/wal/wals/1b45927ecc9c4d2eb07c50b32144324e
I20260806 01:03:42.471052 19822 ts_tablet_manager.cc:1939] T 1b45927ecc9c4d2eb07c50b32144324e P 3b8027a4bc0a4e35ac6aab073f21d476: Deleting consensus metadata
I20260806 01:03:42.471553 19824 ts_tablet_manager.cc:1918] T 1b45927ecc9c4d2eb07c50b32144324e P 0e7a527ca03d4c9ea9e0f9c37d81405f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 01:03:42.471635 19824 log.cc:1196] T 1b45927ecc9c4d2eb07c50b32144324e P 0e7a527ca03d4c9ea9e0f9c37d81405f: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785978186227899-11617-0/minicluster-data/ts-2/wal/wals/1b45927ecc9c4d2eb07c50b32144324e
I20260806 01:03:42.471864 19824 ts_tablet_manager.cc:1939] T 1b45927ecc9c4d2eb07c50b32144324e P 0e7a527ca03d4c9ea9e0f9c37d81405f: Deleting consensus metadata
I20260806 01:03:42.472141 19248 catalog_manager.cc:4841] TS 3b8027a4bc0a4e35ac6aab073f21d476 (127.11.88.66:34641): tablet 1b45927ecc9c4d2eb07c50b32144324e (table test-table [id=8b46c0c942f144c98cea6a643243648b]) successfully deleted
I20260806 01:03:42.472718 19248 catalog_manager.cc:4841] TS 0e7a527ca03d4c9ea9e0f9c37d81405f (127.11.88.67:40765): tablet 1b45927ecc9c4d2eb07c50b32144324e (table test-table [id=8b46c0c942f144c98cea6a643243648b]) successfully deleted
W20260806 01:03:42.478067 19250 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.88.65:37319 (error 108)
I20260806 01:03:42.478291 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 19487
I20260806 01:03:42.480005 19885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:42.478756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:37319 (local address 127.0.0.1:41576)
0806 01:03:42.479869 (+ 1113us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:42.479936 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.65:37319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1085,"thread_start_us":49,"threads_started":1}
W20260806 01:03:42.480676 19250 catalog_manager.cc:4584] TS 36835ca743ae4072a6c22883036de3cb (127.11.88.65:37319): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1b45927ecc9c4d2eb07c50b32144324e: Network error: Client connection negotiation failed: client connection to 127.11.88.65:37319: connect: Connection refused (error 111)
I20260806 01:03:42.484948 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 19634
I20260806 01:03:42.493451 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 19229
2026-08-06T01:03:42Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2721 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:03:42 dist-test-slave-69rg krb5kdc[19889](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:03:42 dist-test-slave-69rg krb5kdc[19889](info): set up 2 sockets
Aug 06 01:03:42 dist-test-slave-69rg krb5kdc[19889](info): commencing operation
krb5kdc: starting...
W20260806 01:03:43.571552 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.054s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:03:43 dist-test-slave-69rg krb5kdc[19889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978223, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:03:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:03:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:03:43.708746 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:43909
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:43269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:43909
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:43.797014 19902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:43.797253 19902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:43.797279 19902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:43.798506 19902 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:03:43.798554 19902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:43.798568 19902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:43.798583 19902 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:03:43.798594 19902 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:03:43.800150 19902 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:43269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:43909
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:43909
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19902
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:43.800374 19902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:43.800580 19902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:43.805696 19908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:43.805685 19909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:43.805912 19902 server_base.cc:1034] running on GCE node
W20260806 01:03:43.805685 19912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:43.806244 19902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:43.806556 19902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:43.807751 19902 hybrid_clock.cc:648] HybridClock initialized: now 1785978223807742 us; error 37 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-06T01:03:43Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1320 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:03:43 dist-test-slave-69rg krb5kdc[19917](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:03:43 dist-test-slave-69rg krb5kdc[19917](info): set up 2 sockets
Aug 06 01:03:43 dist-test-slave-69rg krb5kdc[19917](info): commencing operation
krb5kdc: starting...
W20260806 01:03:44.904999 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.067s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:03:45 dist-test-slave-69rg krb5kdc[19917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978225, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:03:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:03:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:03:45.061446 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:45151
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:44395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:45151
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:45.149706 19930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:45.150094 19930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:45.150138 19930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:45.151749 19930 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:03:45.151875 19930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:45.151904 19930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:45.151927 19930 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:03:45.151957 19930 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:03:45.154456 19930 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:44395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:45151
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:45151
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19930
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:45.154937 19930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:45.155254 19930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 01:03:45.161643 19930 server_base.cc:1034] running on GCE node
W20260806 01:03:45.161631 19935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:45.161614 19938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:45.161598 19936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:45.162431 19930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:45.162757 19930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:45.163936 19930 hybrid_clock.cc:648] HybridClock initialized: now 1785978225163921 us; error 41 us; skew 500 ppm
Aug 06 01:03:45 dist-test-slave-69rg krb5kdc[19917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978225, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:45.173089 19930 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:03:45.173981 19930 webserver.cc:460] Webserver started at http://127.11.88.126:37915/ using document root <none> and password file <none>
I20260806 01:03:45.174319 19930 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:45.174412 19930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:45.174597 19930 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:45.175896 19930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "88bf87eee7d14d0da5af54c2d525fdff"
format_stamp: "Formatted at 2026-08-06 01:03:45 on dist-test-slave-69rg"
server_key: "eee1605b1f9088eacfb7c3b78e677c2a"
server_key_iv: "b7c7e9ab593489c5429d09febed5bd05"
server_key_version: "encryptionkey@0"
I20260806 01:03:45.176319 19930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "88bf87eee7d14d0da5af54c2d525fdff"
format_stamp: "Formatted at 2026-08-06 01:03:45 on dist-test-slave-69rg"
server_key: "eee1605b1f9088eacfb7c3b78e677c2a"
server_key_iv: "b7c7e9ab593489c5429d09febed5bd05"
server_key_version: "encryptionkey@0"
I20260806 01:03:45.177973 19930 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260806 01:03:45.178960 19945 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:45.179229 19930 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:45.179342 19930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "88bf87eee7d14d0da5af54c2d525fdff"
format_stamp: "Formatted at 2026-08-06 01:03:45 on dist-test-slave-69rg"
server_key: "eee1605b1f9088eacfb7c3b78e677c2a"
server_key_iv: "b7c7e9ab593489c5429d09febed5bd05"
server_key_version: "encryptionkey@0"
I20260806 01:03:45.179430 19930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:45.189518 19930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:45.192199 19930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:45.192337 19930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:45.196875 19930 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:45151
I20260806 01:03:45.196923 20000 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:45151 every 8 connection(s)
I20260806 01:03:45.197346 19930 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:03:45.198287 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 19930
I20260806 01:03:45.198419 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:03:45.198648 20001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:03:45.198673 11617 external_mini_cluster.cc:1428] Setting key c4cb4a7135baa2c0e59de99da44d5600
I20260806 01:03:45.202435 20001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff: Bootstrap starting.
I20260806 01:03:45.203241 20001 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff: Neither blocks nor log segments found. Creating new log.
I20260806 01:03:45.203627 20001 log.cc:824] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:45.204571 20001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff: No bootstrap required, opened a new log
Aug 06 01:03:45 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978225, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:45.206717 20001 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88bf87eee7d14d0da5af54c2d525fdff" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45151 } }
I20260806 01:03:45.206970 20001 raft_consensus.cc:374] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:03:45.207057 20001 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88bf87eee7d14d0da5af54c2d525fdff, State: Initialized, Role: FOLLOWER
I20260806 01:03:45.207209 20001 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88bf87eee7d14d0da5af54c2d525fdff" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45151 } }
I20260806 01:03:45.207305 20001 raft_consensus.cc:388] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:03:45.207346 20001 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:03:45.207399 20001 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:03:45.208299 20001 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88bf87eee7d14d0da5af54c2d525fdff" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45151 } }
I20260806 01:03:45.208438 20001 leader_election.cc:302] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 88bf87eee7d14d0da5af54c2d525fdff; no voters:
I20260806 01:03:45.208665 20001 leader_election.cc:288] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:03:45.208786 20006 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:03:45.208989 20001 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:03:45.209028 20006 raft_consensus.cc:686] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [term 1 LEADER]: Becoming Leader. State: Replica: 88bf87eee7d14d0da5af54c2d525fdff, State: Running, Role: LEADER
I20260806 01:03:45.209232 20006 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88bf87eee7d14d0da5af54c2d525fdff" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45151 } }
I20260806 01:03:45.209642 20007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "88bf87eee7d14d0da5af54c2d525fdff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88bf87eee7d14d0da5af54c2d525fdff" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45151 } } }
I20260806 01:03:45.209735 20007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:45.209913 20008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88bf87eee7d14d0da5af54c2d525fdff. Latest consensus state: current_term: 1 leader_uuid: "88bf87eee7d14d0da5af54c2d525fdff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88bf87eee7d14d0da5af54c2d525fdff" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45151 } } }
I20260806 01:03:45.210013 20008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:45.210148 20015 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:03:45.211154 20015 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:03:45.211853 20004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:45.199319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37206 (local address 127.11.88.126:45151)
0806 01:03:45.199497 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:45.199507 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:45.199583 (+ 76us) server_negotiation.cc:407] Connection header received
0806 01:03:45.200034 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:45.200044 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:45.200117 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:45.200287 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:45.201001 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:45.202514 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:45.203566 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:45.204133 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:45.204296 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:45.207354 (+ 3058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:45.207360 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:45.207360 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:45.207376 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:45.209859 (+ 2483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:45.210368 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:45.210372 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:45.210372 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:45.210503 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:45.210771 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:45.210772 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:45.210772 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:45.211146 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:45.211299 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:45.211421 (+ 122us) server_negotiation.cc:299] Negotiation successful
0806 01:03:45.211571 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":85,"threads_started":1}
I20260806 01:03:45.215162 20015 catalog_manager.cc:1347] Generated new cluster ID: a932c18e2e85439c986704e48d24e8eb
I20260806 01:03:45.215247 20015 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:03:45.229417 20015 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:03:45.230123 20015 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:03:45.255237 20015 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff: Generated new TSK 0
I20260806 01:03:45.255527 20015 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.88.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
I20260806 01:03:45.290494 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:0
--local_ip_for_outbound_sockets=127.11.88.65
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:45151
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:44395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:45.392032 20028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:45.392316 20028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:45.392364 20028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:45.393685 20028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:45.393778 20028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:45.393826 20028 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:03:45.395498 20028 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:44395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:45151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20028
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:45.395813 20028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:45.396076 20028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:45.401738 20033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:45.401738 20034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:45.402134 20028 server_base.cc:1034] running on GCE node
W20260806 01:03:45.402149 20036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:45.402410 20028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:45.402670 20028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:45.403843 20028 hybrid_clock.cc:648] HybridClock initialized: now 1785978225403827 us; error 38 us; skew 500 ppm
Aug 06 01:03:45 dist-test-slave-69rg krb5kdc[19917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978225, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:45.407030 20028 init.cc:377] Logged in from keytab as kudu/127.11.88.65@KRBTEST.COM (short username kudu)
I20260806 01:03:45.407683 20028 webserver.cc:460] Webserver started at http://127.11.88.65:36263/ using document root <none> and password file <none>
I20260806 01:03:45.407974 20028 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:45.408047 20028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:45.408214 20028 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:45.409536 20028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/data/instance:
uuid: "8b111e484630456bb37d6ed37f4a6f53"
format_stamp: "Formatted at 2026-08-06 01:03:45 on dist-test-slave-69rg"
server_key: "ab48674f39fee8c90d9bf5d90589ce86"
server_key_iv: "8791af4f99794e1321a822a90bb2edce"
server_key_version: "encryptionkey@0"
I20260806 01:03:45.409981 20028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance:
uuid: "8b111e484630456bb37d6ed37f4a6f53"
format_stamp: "Formatted at 2026-08-06 01:03:45 on dist-test-slave-69rg"
server_key: "ab48674f39fee8c90d9bf5d90589ce86"
server_key_iv: "8791af4f99794e1321a822a90bb2edce"
server_key_version: "encryptionkey@0"
I20260806 01:03:45.411616 20028 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:03:45.412660 20043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:45.412930 20028 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:03:45.413033 20028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "8b111e484630456bb37d6ed37f4a6f53"
format_stamp: "Formatted at 2026-08-06 01:03:45 on dist-test-slave-69rg"
server_key: "ab48674f39fee8c90d9bf5d90589ce86"
server_key_iv: "8791af4f99794e1321a822a90bb2edce"
server_key_version: "encryptionkey@0"
I20260806 01:03:45.413106 20028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:45.428346 20028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:45.430944 20028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:45.431092 20028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:45.431301 20028 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:45.431675 20028 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:45.431715 20028 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:45.431739 20028 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:45.431751 20028 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:45.437955 20028 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:40711
I20260806 01:03:45.438030 20160 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:40711 every 8 connection(s)
I20260806 01:03:45.438476 20028 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
Aug 06 01:03:45 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978225, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:45.448487 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 20028
I20260806 01:03:45.448621 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance
I20260806 01:03:45.448837 11617 external_mini_cluster.cc:1428] Setting key 81624d6513d4c2e327b1dff32fa3e4ac
I20260806 01:03:45.450481 20004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:45.439476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:32777 (local address 127.11.88.126:45151)
0806 01:03:45.439655 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:45.439657 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:45.439850 (+ 193us) server_negotiation.cc:407] Connection header received
0806 01:03:45.440473 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:45.440475 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:45.440488 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:45.440551 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:45.441634 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:45.442260 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:45.443503 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:45.443772 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:45.443862 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:45.446698 (+ 2836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:45.446700 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:45.446701 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:45.446709 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:45.448423 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:45.449078 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:45.449079 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:45.449080 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:45.449192 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:45.449580 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:45.449581 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:45.449581 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:45.449730 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:45.449850 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:45.450233 (+ 383us) server_negotiation.cc:299] Negotiation successful
0806 01:03:45.450334 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137}
I20260806 01:03:45.450512 20163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:45.439362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.65:32777)
0806 01:03:45.439695 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:45.439754 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:45.440352 (+ 598us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:45.440651 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:45.440660 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:45.441284 (+ 624us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:45.441495 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:45.441499 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:45.442384 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:45.442385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:45.443327 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:45.443330 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:45.443884 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:45.443886 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:45.444055 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:45.444716 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:45.444727 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:45.446548 (+ 1821us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:45.448546 (+ 1998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:45.448559 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:45.448562 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:45.448974 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:45.449307 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:45.449308 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:45.449309 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:45.449497 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:45.449881 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:45.449890 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:45.450051 (+ 161us) client_negotiation.cc:769] Sending connection context
0806 01:03:45.450167 (+ 116us) client_negotiation.cc:240] Negotiation successful
0806 01:03:45.450323 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":134,"threads_started":1}
I20260806 01:03:45.451148 20161 heartbeater.cc:347] Connected to a master server at 127.11.88.126:45151
I20260806 01:03:45.451285 20161 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:45.451490 20161 heartbeater.cc:511] Master 127.11.88.126:45151 requested a full tablet report, sending...
I20260806 01:03:45.452098 19964 ts_manager.cc:194] Registered new tserver with Master: 8b111e484630456bb37d6ed37f4a6f53 (127.11.88.65:40711)
I20260806 01:03:45.452749 19964 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.65@KRBTEST.COM'} at 127.11.88.65:32777
WARNING: no policy specified for kudu/127.11.88.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
I20260806 01:03:45.482558 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:0
--local_ip_for_outbound_sockets=127.11.88.66
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:45151
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:44395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:45.571437 20166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:45.571686 20166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:45.571713 20166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:45.573163 20166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:45.573237 20166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:45.573271 20166 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:03:45.575102 20166 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:44395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:45151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:45.575436 20166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:45.575716 20166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:45.581506 20175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:45.581530 20173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:45.581506 20171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:45.582206 20166 server_base.cc:1034] running on GCE node
I20260806 01:03:45.582489 20166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:45.582782 20166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:45.583997 20166 hybrid_clock.cc:648] HybridClock initialized: now 1785978225583978 us; error 36 us; skew 500 ppm
Aug 06 01:03:45 dist-test-slave-69rg krb5kdc[19917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978225, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:45.587250 20166 init.cc:377] Logged in from keytab as kudu/127.11.88.66@KRBTEST.COM (short username kudu)
I20260806 01:03:45.587901 20166 webserver.cc:460] Webserver started at http://127.11.88.66:35657/ using document root <none> and password file <none>
I20260806 01:03:45.588220 20166 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:45.588305 20166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:45.588480 20166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:45.589810 20166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/data/instance:
uuid: "25a18cbc502841be90e6e12832240eae"
format_stamp: "Formatted at 2026-08-06 01:03:45 on dist-test-slave-69rg"
server_key: "a818f9d47002a0f109a3a66f91c5606b"
server_key_iv: "fc85d0f30044a2f512a6a70b0f4ad58a"
server_key_version: "encryptionkey@0"
I20260806 01:03:45.590305 20166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance:
uuid: "25a18cbc502841be90e6e12832240eae"
format_stamp: "Formatted at 2026-08-06 01:03:45 on dist-test-slave-69rg"
server_key: "a818f9d47002a0f109a3a66f91c5606b"
server_key_iv: "fc85d0f30044a2f512a6a70b0f4ad58a"
server_key_version: "encryptionkey@0"
I20260806 01:03:45.591917 20166 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 01:03:45.592914 20182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:45.593233 20166 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:45.593362 20166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "25a18cbc502841be90e6e12832240eae"
format_stamp: "Formatted at 2026-08-06 01:03:45 on dist-test-slave-69rg"
server_key: "a818f9d47002a0f109a3a66f91c5606b"
server_key_iv: "fc85d0f30044a2f512a6a70b0f4ad58a"
server_key_version: "encryptionkey@0"
I20260806 01:03:45.593451 20166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:45.609673 20166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:45.612100 20166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:45.612289 20166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:45.612541 20166 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:45.612892 20166 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:45.612951 20166 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:45.612998 20166 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:45.613022 20166 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:45.619796 20166 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:38055
I20260806 01:03:45.619838 20300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:38055 every 8 connection(s)
I20260806 01:03:45.620191 20166 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
Aug 06 01:03:45 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978225, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:45.629294 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 20166
I20260806 01:03:45.629408 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance
I20260806 01:03:45.629652 11617 external_mini_cluster.cc:1428] Setting key 8232d3fe5a288adb23898c45bbef4a41
I20260806 01:03:45.631387 20004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:45.621013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:40369 (local address 127.11.88.126:45151)
0806 01:03:45.621095 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:45.621097 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:45.621321 (+ 224us) server_negotiation.cc:407] Connection header received
0806 01:03:45.622012 (+ 691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:45.622016 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:45.622054 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:45.622188 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:45.623295 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:45.623856 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:45.625032 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:45.625275 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:45.625346 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:45.627919 (+ 2573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:45.627922 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:45.627922 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:45.627930 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:45.629567 (+ 1637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:45.630190 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:45.630191 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:45.630192 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:45.630254 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:45.630611 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:45.630613 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:45.630613 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:45.630733 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:45.630788 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:45.631205 (+ 417us) server_negotiation.cc:299] Negotiation successful
0806 01:03:45.631317 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 01:03:45.631717 20303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:45.620998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.66:40369)
0806 01:03:45.621175 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:45.621215 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:45.621791 (+ 576us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:45.622259 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:45.622264 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:45.622903 (+ 639us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:45.623125 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:45.623131 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:45.623988 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:45.623989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:45.624907 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:45.624910 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:45.625383 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:45.625384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:45.625503 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:45.626098 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:45.626108 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:45.627781 (+ 1673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:45.629673 (+ 1892us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:45.629686 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:45.629690 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:45.630104 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:45.630327 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:45.630329 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:45.630329 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:45.630501 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:45.630805 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:45.630813 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:45.631022 (+ 209us) client_negotiation.cc:769] Sending connection context
0806 01:03:45.631149 (+ 127us) client_negotiation.cc:240] Negotiation successful
0806 01:03:45.631380 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":106,"threads_started":1}
I20260806 01:03:45.632344 20301 heartbeater.cc:347] Connected to a master server at 127.11.88.126:45151
I20260806 01:03:45.632481 20301 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:45.632732 20301 heartbeater.cc:511] Master 127.11.88.126:45151 requested a full tablet report, sending...
I20260806 01:03:45.633224 19964 ts_manager.cc:194] Registered new tserver with Master: 25a18cbc502841be90e6e12832240eae (127.11.88.66:38055)
I20260806 01:03:45.633663 19964 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.66@KRBTEST.COM'} at 127.11.88.66:40369
WARNING: no policy specified for kudu/127.11.88.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
I20260806 01:03:45.667030 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:0
--local_ip_for_outbound_sockets=127.11.88.67
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:45151
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:44395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:45.764226 20306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:45.764523 20306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:45.764575 20306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:45.766165 20306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:45.766243 20306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:45.766299 20306 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:03:45.768208 20306 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:44395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:45151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20306
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:45.768599 20306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:45.768890 20306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:45.775535 20313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:45.775537 20316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:45.775537 20314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:45.775817 20306 server_base.cc:1034] running on GCE node
I20260806 01:03:45.776181 20306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:45.776466 20306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:45.777653 20306 hybrid_clock.cc:648] HybridClock initialized: now 1785978225777593 us; error 78 us; skew 500 ppm
Aug 06 01:03:45 dist-test-slave-69rg krb5kdc[19917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978225, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:45.781271 20306 init.cc:377] Logged in from keytab as kudu/127.11.88.67@KRBTEST.COM (short username kudu)
I20260806 01:03:45.782104 20306 webserver.cc:460] Webserver started at http://127.11.88.67:46829/ using document root <none> and password file <none>
I20260806 01:03:45.782411 20306 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:45.782495 20306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:45.782713 20306 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:03:45.784303 20306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/data/instance:
uuid: "26a0f8d2005a456f8a22c915f3a9b2e5"
format_stamp: "Formatted at 2026-08-06 01:03:45 on dist-test-slave-69rg"
server_key: "747651bcfd5948e264dd623d8a7c32ca"
server_key_iv: "e5e9e3428bb5aa3d0269bf2843ff089f"
server_key_version: "encryptionkey@0"
I20260806 01:03:45.784811 20306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance:
uuid: "26a0f8d2005a456f8a22c915f3a9b2e5"
format_stamp: "Formatted at 2026-08-06 01:03:45 on dist-test-slave-69rg"
server_key: "747651bcfd5948e264dd623d8a7c32ca"
server_key_iv: "e5e9e3428bb5aa3d0269bf2843ff089f"
server_key_version: "encryptionkey@0"
I20260806 01:03:45.786698 20306 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260806 01:03:45.787746 20323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:45.788139 20306 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:45.788290 20306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "26a0f8d2005a456f8a22c915f3a9b2e5"
format_stamp: "Formatted at 2026-08-06 01:03:45 on dist-test-slave-69rg"
server_key: "747651bcfd5948e264dd623d8a7c32ca"
server_key_iv: "e5e9e3428bb5aa3d0269bf2843ff089f"
server_key_version: "encryptionkey@0"
I20260806 01:03:45.788404 20306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:45.811575 20306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:45.814670 20306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:45.814886 20306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:45.815200 20306 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:45.815642 20306 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:45.815680 20306 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:45.815707 20306 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:45.815819 20306 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:45.823205 20306 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:45973
I20260806 01:03:45.823323 20439 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:45973 every 8 connection(s)
I20260806 01:03:45.823977 20306 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
Aug 06 01:03:45 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978225, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:03:45.834116 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 20306
I20260806 01:03:45.834230 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance
I20260806 01:03:45.834465 11617 external_mini_cluster.cc:1428] Setting key 5e5c7b96d77362c84ef74817a05618e0
I20260806 01:03:45.837621 20004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:45.825120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:58863 (local address 127.11.88.126:45151)
0806 01:03:45.825200 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:45.825202 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:45.825459 (+ 257us) server_negotiation.cc:407] Connection header received
0806 01:03:45.826157 (+ 698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:45.826158 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:45.826174 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:45.826246 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:45.827456 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:45.828043 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:45.829259 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:45.829506 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:45.829604 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:45.832464 (+ 2860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:45.832467 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:45.832467 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:45.832478 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:45.834807 (+ 2329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:45.836177 (+ 1370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:45.836179 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:45.836180 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:45.836298 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:45.836734 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:45.836735 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:45.836736 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:45.836952 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:45.837031 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:45.837457 (+ 426us) server_negotiation.cc:299] Negotiation successful
0806 01:03:45.837547 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 01:03:45.837824 20442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:45.825108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.67:58863)
0806 01:03:45.825311 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:45.825355 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:45.826028 (+ 673us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:45.826339 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:45.826343 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:45.827062 (+ 719us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:45.827316 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:45.827322 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:45.828188 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:45.828190 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:45.829134 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:45.829137 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:45.829623 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:45.829624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:45.829779 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:45.830557 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:45.830567 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:45.832313 (+ 1746us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:03:45.835040 (+ 2727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:45.835058 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:45.835062 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:45.835964 (+ 902us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:45.836456 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:03:45.836457 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:03:45.836457 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:03:45.836612 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:03:45.837055 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:03:45.837064 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:03:45.837262 (+ 198us) client_negotiation.cc:769] Sending connection context
0806 01:03:45.837391 (+ 129us) client_negotiation.cc:240] Negotiation successful
0806 01:03:45.837565 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":102,"threads_started":1}
I20260806 01:03:45.838737 20440 heartbeater.cc:347] Connected to a master server at 127.11.88.126:45151
I20260806 01:03:45.838857 20440 heartbeater.cc:464] Registering TS with master...
I20260806 01:03:45.839208 20440 heartbeater.cc:511] Master 127.11.88.126:45151 requested a full tablet report, sending...
I20260806 01:03:45.839915 19964 ts_manager.cc:194] Registered new tserver with Master: 26a0f8d2005a456f8a22c915f3a9b2e5 (127.11.88.67:45973)
I20260806 01:03:45.840756 19964 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.67@KRBTEST.COM'} at 127.11.88.67:58863
I20260806 01:03:45.848537 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.88.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.88.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.88.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.65.keytab.
Entry for principal oryx/127.11.88.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.65.keytab.
WARNING: no policy specified for oryx/127.11.88.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.88.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.88.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.66.keytab.
Entry for principal oryx/127.11.88.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.66.keytab.
WARNING: no policy specified for oryx/127.11.88.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.88.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.88.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.67.keytab.
Entry for principal oryx/127.11.88.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.67.keytab.
I20260806 01:03:45.980859 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 20028
I20260806 01:03:45.987352 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 20166
I20260806 01:03:45.994181 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 20306
I20260806 01:03:45.999986 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 19930
I20260806 01:03:46.007989 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:45151
--webserver_interface=127.11.88.126
--webserver_port=37915
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:44395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:45151
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:03:46.124902 20449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:46.125157 20449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:46.125188 20449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:46.126885 20449 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:03:46.126971 20449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:46.126987 20449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:46.127002 20449 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:03:46.127014 20449 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:03:46.129525 20449 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:44395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:45151
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:45151
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=37915
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20449
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:46.129935 20449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:46.130244 20449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 01:03:46.136338 20449 server_base.cc:1034] running on GCE node
W20260806 01:03:46.136245 20457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:46.136245 20454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:46.136297 20455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:46.136880 20449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:46.137248 20449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:46.138470 20449 hybrid_clock.cc:648] HybridClock initialized: now 1785978226138472 us; error 81 us; skew 500 ppm
Aug 06 01:03:46 dist-test-slave-69rg krb5kdc[19917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978226, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:46.142144 20449 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:03:46.142707 20449 webserver.cc:460] Webserver started at http://127.11.88.126:37915/ using document root <none> and password file <none>
I20260806 01:03:46.142983 20449 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:46.143086 20449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:46.144747 20449 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 01:03:46.145922 20464 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:46.146205 20449 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:46.146337 20449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "88bf87eee7d14d0da5af54c2d525fdff"
format_stamp: "Formatted at 2026-08-06 01:03:45 on dist-test-slave-69rg"
server_key: "eee1605b1f9088eacfb7c3b78e677c2a"
server_key_iv: "b7c7e9ab593489c5429d09febed5bd05"
server_key_version: "encryptionkey@0"
I20260806 01:03:46.146765 20449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:46.158748 20449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:46.161500 20449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:46.161710 20449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:46.166736 20449 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:45151
I20260806 01:03:46.166815 20518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:45151 every 8 connection(s)
I20260806 01:03:46.167404 20449 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:03:46.168817 20519 sys_catalog.cc:263] Verifying existing consensus state
I20260806 01:03:46.169703 20519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff: Bootstrap starting.
I20260806 01:03:46.175872 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 20449
I20260806 01:03:46.176263 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:40711
--local_ip_for_outbound_sockets=127.11.88.65
--tserver_master_addrs=127.11.88.126:45151
--webserver_port=36263
--webserver_interface=127.11.88.65
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:44395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.88.65
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.65.keytab with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 01:03:46.182677 20519 log.cc:824] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff: Log is configured to *not* fsync() on all Append() calls
I20260806 01:03:46.185889 20519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 01:03:46.186317 20519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff: Bootstrap complete.
I20260806 01:03:46.190984 20519 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88bf87eee7d14d0da5af54c2d525fdff" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45151 } }
I20260806 01:03:46.191453 20519 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88bf87eee7d14d0da5af54c2d525fdff, State: Initialized, Role: FOLLOWER
I20260806 01:03:46.191653 20519 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88bf87eee7d14d0da5af54c2d525fdff" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45151 } }
I20260806 01:03:46.191779 20519 raft_consensus.cc:388] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:03:46.191844 20519 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:03:46.191905 20519 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [term 1 FOLLOWER]: Advancing to term 2
I20260806 01:03:46.193529 20519 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88bf87eee7d14d0da5af54c2d525fdff" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45151 } }
I20260806 01:03:46.193692 20519 leader_election.cc:302] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 88bf87eee7d14d0da5af54c2d525fdff; no voters:
I20260806 01:03:46.193922 20519 leader_election.cc:288] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 01:03:46.194020 20523 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [term 2 FOLLOWER]: Leader election won for term 2
I20260806 01:03:46.194341 20523 raft_consensus.cc:686] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [term 2 LEADER]: Becoming Leader. State: Replica: 88bf87eee7d14d0da5af54c2d525fdff, State: Running, Role: LEADER
I20260806 01:03:46.194406 20519 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:03:46.194531 20523 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88bf87eee7d14d0da5af54c2d525fdff" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45151 } }
I20260806 01:03:46.194952 20524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "88bf87eee7d14d0da5af54c2d525fdff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88bf87eee7d14d0da5af54c2d525fdff" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45151 } } }
I20260806 01:03:46.195047 20524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:46.195215 20525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88bf87eee7d14d0da5af54c2d525fdff. Latest consensus state: current_term: 2 leader_uuid: "88bf87eee7d14d0da5af54c2d525fdff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88bf87eee7d14d0da5af54c2d525fdff" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 45151 } } }
I20260806 01:03:46.195286 20525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff [sys.catalog]: This master's current role is: LEADER
I20260806 01:03:46.195529 20527 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:03:46.196261 20527 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:03:46.196472 20527 catalog_manager.cc:1259] Loaded cluster ID: a932c18e2e85439c986704e48d24e8eb
I20260806 01:03:46.196660 20527 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:03:46.198004 20527 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:03:46.198232 20527 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 88bf87eee7d14d0da5af54c2d525fdff: Loaded TSK: 0
I20260806 01:03:46.198467 20527 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 01:03:46.280468 20521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:46.280867 20521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:46.280922 20521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:46.282764 20521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:46.282897 20521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:46.282958 20521 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:03:46.284936 20521 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:44395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.65.keytab
--principal=oryx/127.11.88.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:40711
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=36263
--tserver_master_addrs=127.11.88.126:45151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20521
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:46.285282 20521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:46.285552 20521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:46.292452 20546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:46.292448 20547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:46.292846 20549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:46.292495 20521 server_base.cc:1034] running on GCE node
I20260806 01:03:46.293136 20521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:46.293622 20521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:46.294862 20521 hybrid_clock.cc:648] HybridClock initialized: now 1785978226294830 us; error 53 us; skew 500 ppm
Aug 06 01:03:46 dist-test-slave-69rg krb5kdc[19917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978226, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:46.298156 20521 init.cc:377] Logged in from keytab as oryx/127.11.88.65@KRBTEST.COM (short username oryx)
I20260806 01:03:46.298801 20521 webserver.cc:460] Webserver started at http://127.11.88.65:36263/ using document root <none> and password file <none>
I20260806 01:03:46.299074 20521 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:46.299170 20521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:46.300822 20521 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 01:03:46.301600 20556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:46.301863 20521 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:46.301960 20521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "8b111e484630456bb37d6ed37f4a6f53"
format_stamp: "Formatted at 2026-08-06 01:03:45 on dist-test-slave-69rg"
server_key: "ab48674f39fee8c90d9bf5d90589ce86"
server_key_iv: "8791af4f99794e1321a822a90bb2edce"
server_key_version: "encryptionkey@0"
I20260806 01:03:46.302533 20521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:46.323524 20521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:46.327129 20521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:46.327430 20521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:46.327934 20521 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:46.328343 20521 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:46.328408 20521 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:46.328454 20521 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:46.328487 20521 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:46.336647 20521 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:40711
I20260806 01:03:46.336705 20679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:40711 every 8 connection(s)
I20260806 01:03:46.337129 20521 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
I20260806 01:03:46.345386 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 20521
I20260806 01:03:46.345748 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:38055
--local_ip_for_outbound_sockets=127.11.88.66
--tserver_master_addrs=127.11.88.126:45151
--webserver_port=35657
--webserver_interface=127.11.88.66
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:44395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.88.66
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.66.keytab with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 01:03:46 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:46 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:46.348598 20682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:46.338345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.65:38913)
0806 01:03:46.338555 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:46.338616 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:46.339210 (+ 594us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:46.339756 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:46.339759 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:46.340525 (+ 766us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:46.340745 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:46.340750 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.342742 (+ 1992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.342744 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:46.343657 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:46.343660 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.344600 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.344602 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:46.344719 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:46.345444 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:46.345456 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:46.348417 (+ 2961us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":105,"threads_started":1}
W20260806 01:03:46.348945 20680 heartbeater.cc:644] Failed to heartbeat to 127.11.88.126:45151 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.88.126:45151: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
W20260806 01:03:46.349578 20683 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:46.338512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:38913 (local address 127.11.88.126:45151)
0806 01:03:46.338805 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:46.338815 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:46.338863 (+ 48us) server_negotiation.cc:407] Connection header received
0806 01:03:46.339456 (+ 593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:46.339464 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:46.339530 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:46.339693 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:46.340905 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.342580 (+ 1675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.343772 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.344463 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.344602 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:46.348647 (+ 4045us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.65:38913: BlockingRecv error: recv got EOF from 127.11.88.65:38913 (error 108)
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":151,"threads_started":1}
Aug 06 01:03:46 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:46 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:46.355085 20682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:46.349208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.65:39533)
0806 01:03:46.349257 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:46.349269 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:46.349310 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:46.349848 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:46.349849 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:46.350013 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:46.350085 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:46.350087 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.350790 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.350792 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:46.351403 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:46.351406 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.351828 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.351830 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:46.351905 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:46.352541 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:46.352547 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:46.354966 (+ 2419us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
W20260806 01:03:46.355261 20685 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:46.349284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:39533 (local address 127.11.88.126:45151)
0806 01:03:46.349475 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:46.349477 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:46.349490 (+ 13us) server_negotiation.cc:407] Connection header received
0806 01:03:46.349526 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:46.349527 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:46.349540 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:46.350157 (+ 617us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:46.350197 (+ 40us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.350687 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.351516 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.351730 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.351831 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:46.355081 (+ 3250us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.65:39533: BlockingRecv error: recv got EOF from 127.11.88.65:39533 (error 108)
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":114,"threads_started":1}
Aug 06 01:03:46 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:46 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:46.360255 20682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:46.355406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.65:54107)
0806 01:03:46.355475 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:46.355488 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:46.355564 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:46.355788 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:46.355788 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:46.355916 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:46.355958 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:46.355959 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.356694 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.356696 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:46.357198 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:46.357199 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.357573 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.357574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:46.357636 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:46.358228 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:46.358233 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:46.360177 (+ 1944us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":46}
W20260806 01:03:46.360447 20683 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:46.355473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:54107 (local address 127.11.88.126:45151)
0806 01:03:46.355517 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:46.355519 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:46.355615 (+ 96us) server_negotiation.cc:407] Connection header received
0806 01:03:46.355640 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:46.355641 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:46.355651 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:46.355715 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:46.356058 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.356597 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.357294 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.357492 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.357573 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:46.360387 (+ 2814us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.65:54107: BlockingRecv error: recv got EOF from 127.11.88.65:54107 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260806 01:03:46.360450 20680 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 01:03:46.447268 20684 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:46.447567 20684 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:46.447613 20684 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:46.449108 20684 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:46.449203 20684 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:46.449266 20684 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:03:46.451188 20684 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:44395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.66.keytab
--principal=oryx/127.11.88.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:38055
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=35657
--tserver_master_addrs=127.11.88.126:45151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20684
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:46.451567 20684 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:46.451850 20684 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:46.457841 20691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:46.457821 20692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:46.458091 20694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:46.458117 20684 server_base.cc:1034] running on GCE node
I20260806 01:03:46.458436 20684 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:46.458760 20684 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:46.459964 20684 hybrid_clock.cc:648] HybridClock initialized: now 1785978226459939 us; error 42 us; skew 500 ppm
Aug 06 01:03:46 dist-test-slave-69rg krb5kdc[19917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978226, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:46.463176 20684 init.cc:377] Logged in from keytab as oryx/127.11.88.66@KRBTEST.COM (short username oryx)
I20260806 01:03:46.463785 20684 webserver.cc:460] Webserver started at http://127.11.88.66:35657/ using document root <none> and password file <none>
I20260806 01:03:46.464063 20684 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:46.464179 20684 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:46.465775 20684 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 01:03:46.466607 20701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:46.466957 20684 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:46.467103 20684 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "25a18cbc502841be90e6e12832240eae"
format_stamp: "Formatted at 2026-08-06 01:03:45 on dist-test-slave-69rg"
server_key: "a818f9d47002a0f109a3a66f91c5606b"
server_key_iv: "fc85d0f30044a2f512a6a70b0f4ad58a"
server_key_version: "encryptionkey@0"
I20260806 01:03:46.467535 20684 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:46.482029 20684 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:46.484634 20684 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:46.484822 20684 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:46.485101 20684 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:46.485437 20684 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:46.485493 20684 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:46.485539 20684 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:46.485563 20684 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:46.492103 20684 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:38055
I20260806 01:03:46.492162 20815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:38055 every 8 connection(s)
I20260806 01:03:46.492597 20684 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
I20260806 01:03:46.494778 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 20684
I20260806 01:03:46.495100 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:45973
--local_ip_for_outbound_sockets=127.11.88.67
--tserver_master_addrs=127.11.88.126:45151
--webserver_port=46829
--webserver_interface=127.11.88.67
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:44395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.88.67
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.67.keytab with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 01:03:46 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:46 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
W20260806 01:03:46.502281 20683 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:46.493473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:52537 (local address 127.11.88.126:45151)
0806 01:03:46.493569 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:46.493571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:46.493873 (+ 302us) server_negotiation.cc:407] Connection header received
0806 01:03:46.494406 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:46.494408 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:46.494423 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:46.494509 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:46.495896 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.496691 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.497918 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.498134 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.498223 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:46.502223 (+ 4000us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.66:52537: BlockingRecv error: recv got EOF from 127.11.88.66:52537 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 01:03:46.502389 20818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:46.493410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.66:52537)
0806 01:03:46.493661 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:46.493724 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:46.494295 (+ 571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:46.494551 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:46.494554 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:46.495483 (+ 929us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:46.495710 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:46.495717 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.496835 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.496836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:46.497729 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:46.497733 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.498242 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.498243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:46.498399 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:46.499002 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:46.499013 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:46.502088 (+ 3075us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":108,"threads_started":1}
W20260806 01:03:46.502696 20816 heartbeater.cc:644] Failed to heartbeat to 127.11.88.126:45151 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.88.126:45151: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Aug 06 01:03:46 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:46 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:46.508409 20818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:46.503001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.66:36255)
0806 01:03:46.503066 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:46.503079 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:46.503142 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:46.503320 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:46.503321 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:46.503490 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:46.503549 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:46.503551 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.504355 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.504357 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:46.504942 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:46.504945 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.505367 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.505368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:46.505460 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:46.506051 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:46.506057 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:46.508343 (+ 2286us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":41}
W20260806 01:03:46.508665 20683 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:46.503086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:36255 (local address 127.11.88.126:45151)
0806 01:03:46.503139 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:46.503141 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:46.503154 (+ 13us) server_negotiation.cc:407] Connection header received
0806 01:03:46.503227 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:46.503228 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:46.503243 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:46.503315 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:46.503648 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.504195 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.505056 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.505277 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.505367 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:46.508497 (+ 3130us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.66:36255: BlockingRecv error: recv got EOF from 127.11.88.66:36255 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 06 01:03:46 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:46 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:46.514495 20818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:46.508844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.66:33617)
0806 01:03:46.508912 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:46.508925 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:46.508975 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:46.509193 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:46.509194 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:46.509480 (+ 286us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:46.509523 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:46.509526 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.510533 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.510534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:46.511165 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:46.511169 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.511714 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.511715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:46.511769 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:46.512294 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:46.512302 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:46.514434 (+ 2132us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":43}
W20260806 01:03:46.514684 20816 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 01:03:46.514796 20683 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:46.508985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:33617 (local address 127.11.88.126:45151)
0806 01:03:46.509024 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:46.509026 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:46.509036 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:03:46.509067 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:46.509067 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:46.509077 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:46.509143 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:46.509605 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.510423 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.511264 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.511579 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.511652 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:46.514559 (+ 2907us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.66:33617: BlockingRecv error: recv got EOF from 127.11.88.66:33617 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260806 01:03:46.588776 20819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:03:46.589026 20819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:03:46.589056 20819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:03:46.590384 20819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:03:46.590431 20819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:03:46.590463 20819 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:03:46.592211 20819 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:44395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/krb5kdc/oryx_127.11.88.67.keytab
--principal=oryx/127.11.88.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:45973
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=46829
--tserver_master_addrs=127.11.88.126:45151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20819
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:03:46.592545 20819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:03:46.592837 20819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:03:46.599720 20825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:46.599697 20827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:03:46.599697 20824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:03:46.599690 20819 server_base.cc:1034] running on GCE node
I20260806 01:03:46.600253 20819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:03:46.600582 20819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:03:46.601795 20819 hybrid_clock.cc:648] HybridClock initialized: now 1785978226601771 us; error 43 us; skew 500 ppm
Aug 06 01:03:46 dist-test-slave-69rg krb5kdc[19917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978226, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.88.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:03:46.605374 20819 init.cc:377] Logged in from keytab as oryx/127.11.88.67@KRBTEST.COM (short username oryx)
I20260806 01:03:46.606029 20819 webserver.cc:460] Webserver started at http://127.11.88.67:46829/ using document root <none> and password file <none>
I20260806 01:03:46.606312 20819 fs_manager.cc:359] Metadata directory not provided
I20260806 01:03:46.606379 20819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:03:46.607946 20819 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:46.608825 20834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:46.609159 20819 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:03:46.609263 20819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "26a0f8d2005a456f8a22c915f3a9b2e5"
format_stamp: "Formatted at 2026-08-06 01:03:45 on dist-test-slave-69rg"
server_key: "747651bcfd5948e264dd623d8a7c32ca"
server_key_iv: "e5e9e3428bb5aa3d0269bf2843ff089f"
server_key_version: "encryptionkey@0"
I20260806 01:03:46.609691 20819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:03:46.646203 20819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:03:46.649283 20819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:03:46.649523 20819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:03:46.649915 20819 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:03:46.650379 20819 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:03:46.650421 20819 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:46.650449 20819 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:03:46.650487 20819 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:03:46.658601 20819 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:45973
I20260806 01:03:46.658794 20952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:45973 every 8 connection(s)
I20260806 01:03:46.659103 20819 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
I20260806 01:03:46.662461 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 20819
Aug 06 01:03:46 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:46 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
W20260806 01:03:46.669353 20683 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:46.659998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:57477 (local address 127.11.88.126:45151)
0806 01:03:46.660092 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:46.660094 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:46.660350 (+ 256us) server_negotiation.cc:407] Connection header received
0806 01:03:46.661194 (+ 844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:46.661195 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:46.661207 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:46.661274 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:46.662948 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.663710 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.665288 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.665497 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.665582 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:46.669285 (+ 3703us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.67:57477: BlockingRecv error: recv got EOF from 127.11.88.67:57477 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 01:03:46.669551 20955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:46.659945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.67:57477)
0806 01:03:46.660165 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:46.660215 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:46.661005 (+ 790us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:46.661397 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:46.661401 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:46.662352 (+ 951us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:46.662703 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:46.662712 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.663841 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.663842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:46.665119 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:46.665123 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.665595 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.665596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:46.665742 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:46.666557 (+ 815us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:46.666566 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:46.669198 (+ 2632us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":133,"threads_started":1}
W20260806 01:03:46.669878 20953 heartbeater.cc:644] Failed to heartbeat to 127.11.88.126:45151 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.88.126:45151: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
I20260806 01:03:46.671372 20685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:46.663133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37220 (local address 127.11.88.126:45151)
0806 01:03:46.663217 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:46.663220 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:46.663263 (+ 43us) server_negotiation.cc:407] Connection header received
0806 01:03:46.663289 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:46.663290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:46.663303 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:46.663379 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:46.664089 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.664579 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.665375 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.665583 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.665662 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:46.667182 (+ 1520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:03:46.667187 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:03:46.667188 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:03:46.667200 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:03:46.669306 (+ 2106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:46.669957 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:46.669961 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:46.669961 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:46.670114 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:03:46.670478 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:03:46.670480 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:03:46.670480 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:03:46.670770 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:03:46.670954 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0806 01:03:46.671111 (+ 157us) server_negotiation.cc:299] Negotiation successful
0806 01:03:46.671272 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Aug 06 01:03:46 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:46 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:46.675985 20955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:46.670164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.67:49523)
0806 01:03:46.670215 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:46.670225 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:46.670307 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:46.670431 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:46.670432 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:46.670586 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:46.670639 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:46.670641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.671454 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.671455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:46.672395 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:46.672398 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.672806 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.672807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:46.672880 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:46.673408 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:46.673414 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:46.675877 (+ 2463us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":32}
W20260806 01:03:46.676056 20683 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:46.670209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:49523 (local address 127.11.88.126:45151)
0806 01:03:46.670280 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:46.670282 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:46.670293 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:03:46.670365 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:46.670367 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:46.670377 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:46.670429 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:46.670724 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.671328 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.672479 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.672727 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.672808 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:46.675986 (+ 3178us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.67:49523: BlockingRecv error: recv got EOF from 127.11.88.67:49523 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 06 01:03:46 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:46 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:46.682672 20955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:46.676449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.67:49633)
0806 01:03:46.676530 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:46.676544 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:46.676612 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:46.676872 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:46.676873 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:46.677039 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:46.677080 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:46.677082 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.678171 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.678172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:46.678766 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:46.678768 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.679185 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.679186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:46.679247 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:46.679806 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:46.679812 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:46.682558 (+ 2746us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":53}
W20260806 01:03:46.682785 20683 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:46.676648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:49633 (local address 127.11.88.126:45151)
0806 01:03:46.676745 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:46.676748 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:46.676755 (+ 7us) server_negotiation.cc:407] Connection header received
0806 01:03:46.676781 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:46.676782 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:46.676790 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:46.676866 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:46.677255 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.678049 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.678868 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:46.679097 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:46.679186 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:46.682713 (+ 3527us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.67:49633: BlockingRecv error: recv got EOF from 127.11.88.67:49633 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260806 01:03:46.682986 20953 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 06 01:03:47 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:47 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:47.366250 20957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:47.360878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.65:35569)
0806 01:03:47.361020 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:47.361033 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:47.361108 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:47.361303 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:47.361304 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:47.361478 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:47.361531 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:47.361532 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:47.362401 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:47.362402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:47.362947 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:47.362949 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:47.363371 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:47.363372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:47.363415 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:47.363935 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:47.363940 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:47.366128 (+ 2188us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":62,"threads_started":1}
W20260806 01:03:47.366339 20958 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:47.360967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:35569 (local address 127.11.88.126:45151)
0806 01:03:47.361165 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:47.361167 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:47.361176 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:03:47.361204 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:47.361204 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:47.361215 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:47.361281 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:47.361666 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:47.362314 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:47.363049 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:47.363290 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:47.363362 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:47.366254 (+ 2892us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.65:35569: BlockingRecv error: recv got EOF from 127.11.88.65:35569 (error 108)
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":75,"threads_started":1}
Aug 06 01:03:47 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:47 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:47.519884 20959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:47.515129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.66:33475)
0806 01:03:47.515285 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:47.515296 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:47.515357 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:47.515497 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:47.515498 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:47.515672 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:47.515726 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:47.515727 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:47.516426 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:47.516427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:47.517018 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:47.517021 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:47.517371 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:47.517372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:47.517413 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:47.517925 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:47.517930 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:47.519811 (+ 1881us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":92,"threads_started":1}
W20260806 01:03:47.519989 20958 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:47.515197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:33475 (local address 127.11.88.126:45151)
0806 01:03:47.515266 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:47.515269 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:47.515358 (+ 89us) server_negotiation.cc:407] Connection header received
0806 01:03:47.515413 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:47.515414 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:47.515425 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:47.515466 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:47.515797 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:47.516314 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:47.517101 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:47.517299 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:47.517352 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:47.519918 (+ 2566us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.66:33475: BlockingRecv error: recv got EOF from 127.11.88.66:33475 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 06 01:03:47 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:47 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:47.688886 20960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:47.683613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.67:42851)
0806 01:03:47.683847 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:47.683862 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:47.683966 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:47.684149 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:47.684150 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:47.684367 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:47.684418 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:47.684420 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:47.685121 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:47.685122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:47.685698 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:47.685700 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:47.686186 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:47.686188 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:47.686251 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:47.686764 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:47.686769 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:47.688768 (+ 1999us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":105,"threads_started":1}
W20260806 01:03:47.688927 20958 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:47.683739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:42851 (local address 127.11.88.126:45151)
0806 01:03:47.683853 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:47.683855 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:47.683945 (+ 90us) server_negotiation.cc:407] Connection header received
0806 01:03:47.684046 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:47.684047 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:47.684063 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:47.684142 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:47.684515 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:47.685030 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:47.685805 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:47.686109 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:47.686189 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:47.688857 (+ 2668us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.67:42851: BlockingRecv error: recv got EOF from 127.11.88.67:42851 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 06 01:03:48 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:48 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:48.371815 20961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:48.366832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.65:56415)
0806 01:03:48.367027 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:48.367038 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:48.367093 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:48.367231 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:48.367232 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:48.367402 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:48.367462 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:48.367463 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:48.368190 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:48.368191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:48.368742 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:48.368744 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:48.369120 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:48.369121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:48.369163 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:48.369708 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:48.369713 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:48.371754 (+ 2041us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":117,"threads_started":1}
W20260806 01:03:48.372037 20962 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:48.366941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:56415 (local address 127.11.88.126:45151)
0806 01:03:48.367090 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:48.367092 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:48.367103 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:03:48.367134 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:48.367134 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:48.367145 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:48.367209 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:48.367537 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:48.368107 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:48.368843 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:48.369046 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:48.369109 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:48.371944 (+ 2835us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.65:56415: BlockingRecv error: recv got EOF from 127.11.88.65:56415 (error 108)
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":68,"threads_started":1}
Aug 06 01:03:48 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:48 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:48.525739 20963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:48.520410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.66:59661)
0806 01:03:48.520582 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:48.520597 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:48.520666 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:48.520844 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:48.520845 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:48.521041 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:48.521131 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:48.521133 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:48.521966 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:48.521967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:48.522569 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:48.522571 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:48.522979 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:48.522980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:48.523053 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:48.523522 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:48.523527 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:48.525626 (+ 2099us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":112,"threads_started":1}
W20260806 01:03:48.525802 20962 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:48.520595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:59661 (local address 127.11.88.126:45151)
0806 01:03:48.520652 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:48.520654 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:48.520666 (+ 12us) server_negotiation.cc:407] Connection header received
0806 01:03:48.520741 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:48.520743 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:48.520758 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:48.520836 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:48.521225 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:48.521862 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:48.522678 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:48.522894 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:48.522979 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:48.525730 (+ 2751us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.66:59661: BlockingRecv error: recv got EOF from 127.11.88.66:59661 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 06 01:03:48 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:48 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:48.694038 20964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:48.689451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.67:46273)
0806 01:03:48.689673 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:48.689690 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:48.689750 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:48.689908 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:48.689909 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:48.690076 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:48.690128 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:48.690130 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:48.690765 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:48.690766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:48.691294 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:48.691295 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:48.691624 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:48.691625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:48.691664 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:48.692154 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:48.692158 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:48.693977 (+ 1819us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":85,"threads_started":1}
W20260806 01:03:48.694142 20962 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:48.689611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:46273 (local address 127.11.88.126:45151)
0806 01:03:48.689689 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:48.689691 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:48.689748 (+ 57us) server_negotiation.cc:407] Connection header received
0806 01:03:48.689827 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:48.689828 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:48.689842 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:48.689885 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:48.690189 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:48.690685 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:48.691373 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:48.691557 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:48.691612 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:48.694071 (+ 2459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.67:46273: BlockingRecv error: recv got EOF from 127.11.88.67:46273 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 06 01:03:49 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:49 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:49.377460 20965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:49.372331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.65:44951)
0806 01:03:49.372480 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:49.372496 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:49.372581 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:49.372738 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:49.372739 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:49.372915 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:49.372969 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:49.372971 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:49.373647 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:49.373647 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:49.374250 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:49.374253 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:49.374654 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:49.374656 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:49.374711 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:49.375312 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:49.375318 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:49.377392 (+ 2074us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":67,"threads_started":1}
W20260806 01:03:49.377653 20966 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:49.372454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:44951 (local address 127.11.88.126:45151)
0806 01:03:49.372607 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:49.372609 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:49.372618 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:03:49.372642 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:49.372642 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:49.372653 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:49.372713 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:49.373038 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:49.373571 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:49.374347 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:49.374545 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:49.374612 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:49.377535 (+ 2923us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.65:44951: BlockingRecv error: recv got EOF from 127.11.88.65:44951 (error 108)
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":78,"threads_started":1}
Aug 06 01:03:49 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:49 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:49.531280 20967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:49.526338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.66:37781)
0806 01:03:49.526519 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:49.526533 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:49.526608 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:49.526812 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:49.526813 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:49.526983 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:49.527040 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:49.527042 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:49.527742 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:49.527743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:49.528273 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:49.528274 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:49.528630 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:49.528631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:49.528681 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:49.529194 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:49.529200 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:49.531181 (+ 1981us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":70,"threads_started":1}
W20260806 01:03:49.531370 20966 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:49.526586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:37781 (local address 127.11.88.126:45151)
0806 01:03:49.526669 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:49.526671 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:49.526681 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:03:49.526717 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:49.526717 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:49.526736 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:49.526788 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:49.527111 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:49.527652 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:49.528361 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:49.528557 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:49.528614 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:49.531296 (+ 2682us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.66:37781: BlockingRecv error: recv got EOF from 127.11.88.66:37781 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 06 01:03:49 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:49 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:49.699528 20968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:49.694619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.67:55543)
0806 01:03:49.694815 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:49.694827 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:49.694938 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:49.695092 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:49.695092 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:49.695291 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:49.695341 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:49.695342 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:49.696096 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:49.696097 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:49.696630 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:49.696632 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:49.696992 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:49.696993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:49.697053 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:49.697532 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:49.697536 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:49.699426 (+ 1890us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":125,"threads_started":1}
W20260806 01:03:49.699575 20966 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:49.694707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:55543 (local address 127.11.88.126:45151)
0806 01:03:49.694787 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:49.694789 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:49.694920 (+ 131us) server_negotiation.cc:407] Connection header received
0806 01:03:49.694998 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:49.694999 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:49.695018 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:49.695085 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:49.695447 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:49.696003 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:49.696723 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:49.696915 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:49.696993 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:49.699508 (+ 2515us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.67:55543: BlockingRecv error: recv got EOF from 127.11.88.67:55543 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 06 01:03:50 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:50 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:50.387879 20969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:50.378124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.65:36919)
0806 01:03:50.378336 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:50.378347 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:50.378410 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:50.378557 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:50.378557 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:50.378740 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:50.378800 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:50.378802 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:50.379496 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:50.379497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:50.380041 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:50.380042 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:50.380438 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:50.380439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:50.380488 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:50.385697 (+ 5209us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:50.385705 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:50.387809 (+ 2104us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":107,"threads_started":1}
W20260806 01:03:50.388058 20971 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:50.378246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:36919 (local address 127.11.88.126:45151)
0806 01:03:50.378381 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:50.378383 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:50.378396 (+ 13us) server_negotiation.cc:407] Connection header received
0806 01:03:50.378469 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:50.378470 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:50.378481 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:50.378531 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:50.378878 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:50.379407 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:50.380135 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:50.380356 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:50.380421 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:50.387969 (+ 7548us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.65:36919: BlockingRecv error: recv got EOF from 127.11.88.65:36919 (error 108)
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":77,"threads_started":1}
Aug 06 01:03:50 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:50 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:50.537086 20972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:50.532035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.66:43819)
0806 01:03:50.532185 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:50.532196 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:50.532254 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:50.532429 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:50.532431 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:50.532606 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:50.532658 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:50.532660 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:50.533385 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:50.533386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:50.534027 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:50.534030 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:50.534395 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:50.534396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:50.534443 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:50.534925 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:50.534929 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:50.537024 (+ 2095us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":93,"threads_started":1}
W20260806 01:03:50.537276 20971 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:50.532100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:43819 (local address 127.11.88.126:45151)
0806 01:03:50.532173 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:50.532175 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:50.532256 (+ 81us) server_negotiation.cc:407] Connection header received
0806 01:03:50.532308 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:50.532309 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:50.532322 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:50.532383 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:50.532776 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:50.533293 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:50.534105 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:50.534305 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:50.534367 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:50.537202 (+ 2835us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.66:43819: BlockingRecv error: recv got EOF from 127.11.88.66:43819 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 06 01:03:50 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:50 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:50.705084 20973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:50.700102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.67:39439)
0806 01:03:50.700261 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:50.700274 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:50.700349 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:50.700493 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:50.700494 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:50.700669 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:50.700729 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:50.700730 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:50.701419 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:50.701420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:50.702016 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:50.702018 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:50.702376 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:50.702377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:50.702422 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:50.702979 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:50.702985 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:50.705013 (+ 2028us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":96,"threads_started":1}
W20260806 01:03:50.705233 20971 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:50.700211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:39439 (local address 127.11.88.126:45151)
0806 01:03:50.700268 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:50.700270 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:50.700326 (+ 56us) server_negotiation.cc:407] Connection header received
0806 01:03:50.700415 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:50.700416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:50.700428 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:50.700472 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:50.700803 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:50.701331 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:50.702112 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:50.702303 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:50.702366 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:50.705146 (+ 2780us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.67:39439: BlockingRecv error: recv got EOF from 127.11.88.67:39439 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 06 01:03:51 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:51 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:51.393213 20974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:51.388458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.65:45969)
0806 01:03:51.388624 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:51.388639 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:51.388699 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:51.388872 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:51.388873 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:51.389048 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:51.389104 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:51.389105 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:51.389797 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:51.389798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:51.390375 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:51.390377 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:51.390712 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:51.390712 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:51.390755 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:51.391268 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:51.391273 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:51.393151 (+ 1878us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":96,"threads_started":1}
W20260806 01:03:51.393317 20975 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:51.388577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:45969 (local address 127.11.88.126:45151)
0806 01:03:51.388733 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:51.388735 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:51.388744 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:03:51.388771 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:51.388772 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:51.388783 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:51.388849 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:51.389177 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:51.389705 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:51.390453 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:51.390645 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:51.390698 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:51.393240 (+ 2542us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.65:45969: BlockingRecv error: recv got EOF from 127.11.88.65:45969 (error 108)
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":81,"threads_started":1}
Aug 06 01:03:51 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:51 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:51.542665 20976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:51.537654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.66:41839)
0806 01:03:51.538024 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:51.538048 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:51.538114 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:51.538288 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:51.538289 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:51.538478 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:51.538531 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:51.538533 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:51.539452 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:51.539453 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:51.540041 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:51.540044 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:51.540370 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:51.540371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:51.540411 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:51.540844 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:51.540848 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:51.542606 (+ 1758us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":283,"threads_started":1}
W20260806 01:03:51.542780 20975 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:51.537953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:41839 (local address 127.11.88.126:45151)
0806 01:03:51.538047 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:51.538049 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:51.538097 (+ 48us) server_negotiation.cc:407] Connection header received
0806 01:03:51.538195 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:51.538196 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:51.538208 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:51.538264 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:51.538614 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:51.539358 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:51.540111 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:51.540304 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:51.540358 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:51.542711 (+ 2353us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.66:41839: BlockingRecv error: recv got EOF from 127.11.88.66:41839 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 06 01:03:51 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:51 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:51.710760 20977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:51.705750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.67:46253)
0806 01:03:51.705899 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:51.705910 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:51.706020 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:51.706213 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:51.706214 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:51.706457 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:51.706514 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:51.706516 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:51.707441 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:51.707442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:51.707970 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:51.707972 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:51.708358 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:51.708359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:51.708403 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:51.708848 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:51.708853 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:51.710697 (+ 1844us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":92,"threads_started":1}
W20260806 01:03:51.710950 20975 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:51.705795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:46253 (local address 127.11.88.126:45151)
0806 01:03:51.705897 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:51.705899 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:51.706002 (+ 103us) server_negotiation.cc:407] Connection header received
0806 01:03:51.706090 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:51.706091 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:51.706107 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:51.706175 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:51.706611 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:51.707350 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:51.708078 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:51.708277 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:51.708345 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:51.710871 (+ 2526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.67:46253: BlockingRecv error: recv got EOF from 127.11.88.67:46253 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 06 01:03:52 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:52 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:52.399165 20978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:52.393922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.65:36515)
0806 01:03:52.394131 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:52.394144 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:52.394215 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:52.394395 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:52.394396 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:52.394595 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:52.394650 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:52.394652 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:52.395552 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:52.395553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:52.396097 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:52.396099 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:52.396515 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:52.396516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:52.396560 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:52.397049 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:52.397054 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:52.399103 (+ 2049us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":93,"threads_started":1}
W20260806 01:03:52.399324 20979 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:52.393965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:36515 (local address 127.11.88.126:45151)
0806 01:03:52.394158 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:52.394161 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:52.394196 (+ 35us) server_negotiation.cc:407] Connection header received
0806 01:03:52.394281 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:52.394282 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:52.394297 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:52.394368 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:52.394727 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:52.395476 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:52.396169 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:52.396443 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:52.396505 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:52.399218 (+ 2713us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.65:36515: BlockingRecv error: recv got EOF from 127.11.88.65:36515 (error 108)
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":55,"threads_started":1}
Aug 06 01:03:52 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:52 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:52.548517 20980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:52.543303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.66:54415)
0806 01:03:52.543537 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:52.543549 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:52.543658 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:52.543857 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:52.543858 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:52.544052 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:52.544106 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:52.544108 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:52.544798 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:52.544799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:52.545355 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:52.545357 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:52.545725 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:52.545726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:52.545788 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:52.546384 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:52.546389 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:52.548453 (+ 2064us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":109,"threads_started":1}
W20260806 01:03:52.548673 20979 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:52.543415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:54415 (local address 127.11.88.126:45151)
0806 01:03:52.543515 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:52.543518 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:52.543634 (+ 116us) server_negotiation.cc:407] Connection header received
0806 01:03:52.543749 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:52.543750 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:52.543774 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:52.543848 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:52.544196 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:52.544710 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:52.545445 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:52.545642 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:52.545722 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:52.548582 (+ 2860us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.66:54415: BlockingRecv error: recv got EOF from 127.11.88.66:54415 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 06 01:03:52 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:52 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:52.716536 20981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:52.711432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.67:56461)
0806 01:03:52.711644 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:52.711669 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:52.711760 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:52.711942 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:52.711943 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:52.712137 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:52.712191 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:52.712193 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:52.712897 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:52.712898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:52.713505 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:52.713508 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:52.713943 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:52.713944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:52.714013 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:52.714510 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:52.714515 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:52.716434 (+ 1919us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":96,"threads_started":1}
W20260806 01:03:52.716594 20979 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:52.711546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:56461 (local address 127.11.88.126:45151)
0806 01:03:52.711618 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:52.711620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:52.711741 (+ 121us) server_negotiation.cc:407] Connection header received
0806 01:03:52.711841 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:52.711842 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:52.711859 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:52.711935 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:52.712279 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:52.712801 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:52.713601 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:52.713796 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:52.713923 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:52.716525 (+ 2602us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.67:56461: BlockingRecv error: recv got EOF from 127.11.88.67:56461 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 06 01:03:53 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:53 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:53.404927 20982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:53.399800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.65:42179)
0806 01:03:53.399995 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:53.400010 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:53.400096 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:53.400300 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:53.400302 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:53.400486 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:53.400541 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:53.400542 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:53.401288 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:53.401290 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:53.401995 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:53.401998 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:53.402432 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:53.402433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:53.402486 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:53.402948 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:53.402954 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:53.404867 (+ 1913us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":82,"threads_started":1}
W20260806 01:03:53.405057 20983 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:53.399932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:42179 (local address 127.11.88.126:45151)
0806 01:03:53.400104 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:53.400106 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:53.400118 (+ 12us) server_negotiation.cc:407] Connection header received
0806 01:03:53.400147 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:53.400147 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:53.400159 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:53.400225 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:53.400646 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:53.401155 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:53.402171 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:53.402366 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:53.402416 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:53.404968 (+ 2552us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.65:42179: BlockingRecv error: recv got EOF from 127.11.88.65:42179 (error 108)
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":86,"threads_started":1}
Aug 06 01:03:53 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:53 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:53.554489 20984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:53.549055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.66:51955)
0806 01:03:53.549227 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:53.549238 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:53.549302 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:53.549439 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:53.549440 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:53.549602 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:53.549662 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:53.549664 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:53.550778 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:53.550779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:53.551418 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:53.551421 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:53.551855 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:53.551856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:53.551918 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:53.552392 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:53.552396 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:53.554397 (+ 2001us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":113,"threads_started":1}
W20260806 01:03:53.554567 20983 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:53.549209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:51955 (local address 127.11.88.126:45151)
0806 01:03:53.549302 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:53.549304 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:53.549336 (+ 32us) server_negotiation.cc:407] Connection header received
0806 01:03:53.549366 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:53.549368 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:53.549378 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:53.549422 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:53.549762 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:53.550673 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:53.551524 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:53.551766 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:53.551854 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:53.554502 (+ 2648us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.66:51955: BlockingRecv error: recv got EOF from 127.11.88.66:51955 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 06 01:03:53 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:53 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:53.721922 20985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:53.717101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.67:41831)
0806 01:03:53.717295 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:53.717307 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:53.717357 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:53.717491 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:53.717491 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:53.717690 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:53.717744 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:53.717746 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:53.718492 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:53.718493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:53.719024 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:53.719025 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:53.719405 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:53.719406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:53.719446 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:53.719984 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:53.719989 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:53.721798 (+ 1809us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":94,"threads_started":1}
W20260806 01:03:53.722126 20983 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:53.717238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:41831 (local address 127.11.88.126:45151)
0806 01:03:53.717332 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:53.717334 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:53.717365 (+ 31us) server_negotiation.cc:407] Connection header received
0806 01:03:53.717408 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:53.717409 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:53.717422 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:53.717470 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:53.717890 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:53.718410 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:53.719119 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:53.719332 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:53.719395 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:53.722025 (+ 2630us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.67:41831: BlockingRecv error: recv got EOF from 127.11.88.67:41831 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 06 01:03:54 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:54 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:54.410245 20986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:54.405421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.65:58185)
0806 01:03:54.405603 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:54.405617 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:54.405680 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:54.405935 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:54.405936 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:54.406140 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:54.406195 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:54.406196 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:54.406851 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:54.406852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:54.407481 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:54.407483 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:54.407830 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:54.407831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:54.407874 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:54.408324 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:54.408328 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:54.410176 (+ 1848us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":84,"threads_started":1}
W20260806 01:03:54.410403 20987 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:54.405545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:58185 (local address 127.11.88.126:45151)
0806 01:03:54.405710 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:54.405712 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:54.405719 (+ 7us) server_negotiation.cc:407] Connection header received
0806 01:03:54.405774 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:54.405775 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:54.405789 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:54.405909 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:54.406262 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:54.406780 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:54.407554 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:54.407759 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:54.407813 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:54.410304 (+ 2491us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.65:58185: BlockingRecv error: recv got EOF from 127.11.88.65:58185 (error 108)
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":97,"threads_started":1}
Aug 06 01:03:54 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:54 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:54.560441 20988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:54.555109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.66:57695)
0806 01:03:54.555285 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:54.555302 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:54.555394 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:54.555564 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:54.555565 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:54.555762 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:54.555814 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:54.555816 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:54.556670 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:54.556671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:54.557509 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:54.557512 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:54.557934 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:54.557934 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:54.557995 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:54.558487 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:54.558491 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:54.560378 (+ 1887us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":91,"threads_started":1}
W20260806 01:03:54.560591 20987 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:54.555235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:57695 (local address 127.11.88.126:45151)
0806 01:03:54.555307 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:54.555310 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:54.555374 (+ 64us) server_negotiation.cc:407] Connection header received
0806 01:03:54.555480 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:54.555481 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:54.555493 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:54.555554 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:54.555898 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:54.556558 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:54.557592 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:54.557796 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:54.557919 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:54.560487 (+ 2568us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.66:57695: BlockingRecv error: recv got EOF from 127.11.88.66:57695 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 06 01:03:54 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:54 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:54.727188 20989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:54.722439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.67:48669)
0806 01:03:54.722624 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:54.722635 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:54.722715 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:54.722870 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:54.722871 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:54.723043 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:54.723094 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:54.723096 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:54.723788 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:54.723789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:54.724331 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:54.724333 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:54.724680 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:54.724680 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:54.724724 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:54.725176 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:54.725181 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:54.727115 (+ 1934us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":103,"threads_started":1}
W20260806 01:03:54.727360 20987 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:54.722488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:48669 (local address 127.11.88.126:45151)
0806 01:03:54.722572 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:54.722575 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:54.722696 (+ 121us) server_negotiation.cc:407] Connection header received
0806 01:03:54.722789 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:54.722790 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:54.722803 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:54.722851 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:54.723159 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:54.723657 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:54.724422 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:54.724609 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:54.724668 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:54.727256 (+ 2588us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.67:48669: BlockingRecv error: recv got EOF from 127.11.88.67:48669 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 06 01:03:55 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:55 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:55.420152 20990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:55.410783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.65:37543)
0806 01:03:55.410958 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:55.410971 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:55.411031 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:55.411193 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:55.411193 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:55.411366 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:55.411422 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:55.411424 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:55.412117 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:55.412118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:55.412685 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:55.412687 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:55.413198 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:55.413199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:55.413248 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:55.417969 (+ 4721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:55.417975 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:55.420037 (+ 2062us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":112,"threads_started":1}
W20260806 01:03:55.420217 20992 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:55.410926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:37543 (local address 127.11.88.126:45151)
0806 01:03:55.411054 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:55.411056 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:55.411073 (+ 17us) server_negotiation.cc:407] Connection header received
0806 01:03:55.411118 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:55.411119 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:55.411130 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:55.411187 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:55.411484 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:55.412003 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:55.412845 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:55.413064 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:55.413178 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:55.420157 (+ 6979us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.65:37543: BlockingRecv error: recv got EOF from 127.11.88.65:37543 (error 108)
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":81,"threads_started":1}
Aug 06 01:03:55 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:55 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:55.566279 20993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:55.561046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.66:37797)
0806 01:03:55.561200 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:55.561214 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:55.561282 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:55.561504 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:55.561505 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:55.561699 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:55.561751 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:55.561753 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:55.562468 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:55.562469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:55.563181 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:55.563184 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:55.563602 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:55.563603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:55.563655 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:55.564128 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:55.564132 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:55.566200 (+ 2068us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":92,"threads_started":1}
W20260806 01:03:55.566388 20992 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:55.561280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:37797 (local address 127.11.88.126:45151)
0806 01:03:55.561364 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:55.561366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:55.561374 (+ 8us) server_negotiation.cc:407] Connection header received
0806 01:03:55.561409 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:55.561410 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:55.561421 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:55.561491 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:55.561862 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:55.562384 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:55.563268 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:55.563526 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:55.563599 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:55.566317 (+ 2718us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.66:37797: BlockingRecv error: recv got EOF from 127.11.88.66:37797 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 06 01:03:55 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:55 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:55.732980 20994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:55.727816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.67:34165)
0806 01:03:55.727997 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:55.728009 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:55.728091 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:55.728292 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:55.728293 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:55.728505 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:55.728620 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:55.728623 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:55.729404 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:55.729404 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:55.730046 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:55.730049 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:55.730420 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:55.730421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:55.730472 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:55.730948 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:55.730953 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:55.732905 (+ 1952us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":107,"threads_started":1}
W20260806 01:03:55.733165 20992 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:55.727963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:34165 (local address 127.11.88.126:45151)
0806 01:03:55.728017 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:55.728019 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:55.728070 (+ 51us) server_negotiation.cc:407] Connection header received
0806 01:03:55.728191 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:55.728192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:55.728203 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:55.728274 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:55.728704 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:55.729321 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:55.730156 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:55.730345 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:55.730412 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:55.733049 (+ 2637us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.67:34165: BlockingRecv error: recv got EOF from 127.11.88.67:34165 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 06 01:03:56 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:56 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:56.426368 20995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:56.420826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.65:44443)
0806 01:03:56.420995 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:56.421007 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:56.421066 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:56.421284 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:56.421285 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:56.421461 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:56.421519 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:56.421520 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:56.422365 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:56.422366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:56.422907 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:56.422908 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:56.423319 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:56.423321 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:56.423372 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:56.423967 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:56.423972 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:56.426303 (+ 2331us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":97,"threads_started":1}
W20260806 01:03:56.426573 20996 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:56.420937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:44443 (local address 127.11.88.126:45151)
0806 01:03:56.421114 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:56.421117 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:56.421127 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:03:56.421156 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:56.421156 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:56.421179 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:56.421267 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:56.421650 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:56.422278 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:56.422997 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:56.423218 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:56.423283 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:56.426482 (+ 3199us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.65:44443: BlockingRecv error: recv got EOF from 127.11.88.65:44443 (error 108)
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":157,"threads_started":1}
Aug 06 01:03:56 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:56 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:56.572418 20997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:56.566806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.66:48837)
0806 01:03:56.567138 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:56.567149 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:56.567334 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:56.567552 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:56.567553 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:56.567767 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:56.567821 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:56.567824 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:56.568594 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:56.568595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:56.569183 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:56.569185 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:56.569610 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:56.569611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:56.569684 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:56.570246 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:56.570251 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:56.572357 (+ 2106us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":133,"threads_started":1}
W20260806 01:03:56.572606 20996 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:56.566913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:48837 (local address 127.11.88.126:45151)
0806 01:03:56.567062 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:56.567064 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:56.567288 (+ 224us) server_negotiation.cc:407] Connection header received
0806 01:03:56.567435 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:56.567436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:56.567452 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:56.567541 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:56.567911 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:56.568490 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:56.569278 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:56.569505 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:56.569608 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:56.572476 (+ 2868us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.66:48837: BlockingRecv error: recv got EOF from 127.11.88.66:48837 (error 108)
Metrics: {"server-negotiator.queue_time_us":111}
Aug 06 01:03:56 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:56 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:56.738616 20998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:56.733610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.67:49255)
0806 01:03:56.733799 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:56.733858 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:56.733923 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:56.734033 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:56.734034 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:56.734204 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:56.734257 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:56.734258 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:56.734989 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:56.734990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:56.735589 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:56.735592 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:56.735961 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:56.735962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:56.736009 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:56.736484 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:56.736488 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:56.738496 (+ 2008us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":78,"threads_started":1}
W20260806 01:03:56.738662 20996 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:56.733867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:49255 (local address 127.11.88.126:45151)
0806 01:03:56.733916 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:56.733919 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:56.733936 (+ 17us) server_negotiation.cc:407] Connection header received
0806 01:03:56.733964 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:56.733964 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:56.733976 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:56.734021 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:56.734363 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:56.734883 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:56.735687 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:56.735881 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:56.735941 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:56.738591 (+ 2650us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.67:49255: BlockingRecv error: recv got EOF from 127.11.88.67:49255 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 06 01:03:57 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:57 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:57.431944 20999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:57.426966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.65:39203)
0806 01:03:57.427155 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:57.427166 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:57.427226 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:57.427397 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:57.427397 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:57.427589 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:57.427659 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:57.427660 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:57.428338 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:57.428339 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:57.428904 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:57.428906 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:57.429274 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:57.429275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:57.429338 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:57.429846 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:57.429851 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:57.431843 (+ 1992us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":95,"threads_started":1}
W20260806 01:03:57.432145 21000 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:57.427084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:39203 (local address 127.11.88.126:45151)
0806 01:03:57.427215 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:57.427218 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:57.427228 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:03:57.427297 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:57.427297 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:57.427307 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:57.427371 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:57.427731 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:57.428234 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:57.428983 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:57.429180 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:57.429232 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:57.431998 (+ 2766us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.65:39203: BlockingRecv error: recv got EOF from 127.11.88.65:39203 (error 108)
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":55,"threads_started":1}
Aug 06 01:03:57 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:57 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:57.578488 21001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:57.572962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.66:33601)
0806 01:03:57.573128 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:57.573140 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:57.573220 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:57.573385 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:57.573386 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:57.573590 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:57.573647 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:57.573649 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:57.574366 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:57.574367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:57.575240 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:57.575243 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:57.575700 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:57.575701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:57.575768 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:57.576312 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:57.576316 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:57.578405 (+ 2089us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":87,"threads_started":1}
W20260806 01:03:57.578630 21000 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:57.573076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:33601 (local address 127.11.88.126:45151)
0806 01:03:57.573132 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:57.573134 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:57.573218 (+ 84us) server_negotiation.cc:407] Connection header received
0806 01:03:57.573297 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:57.573298 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:57.573309 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:57.573359 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:57.573724 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:57.574244 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:57.575354 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:57.575567 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:57.575663 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:57.578535 (+ 2872us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.66:33601: BlockingRecv error: recv got EOF from 127.11.88.66:33601 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 06 01:03:57 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:57 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:57.744671 21002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:57.739267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.67:36207)
0806 01:03:57.739434 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:57.739447 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:57.739548 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:57.739733 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:57.739734 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:57.739951 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:57.740000 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:57.740002 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:57.740749 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:57.740750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:57.741343 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:57.741344 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:57.741757 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:57.741758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:57.741858 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:57.742391 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:57.742396 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:57.744571 (+ 2175us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":95,"threads_started":1}
W20260806 01:03:57.744848 21000 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:57.739310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:36207 (local address 127.11.88.126:45151)
0806 01:03:57.739371 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:57.739374 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:57.739527 (+ 153us) server_negotiation.cc:407] Connection header received
0806 01:03:57.739625 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:57.739627 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:57.739643 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:57.739726 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:57.740098 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:57.740652 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:57.741447 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:57.741671 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:57.741759 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:57.744752 (+ 2993us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.67:36207: BlockingRecv error: recv got EOF from 127.11.88.67:36207 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 06 01:03:58 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:58 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:58.437695 21003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:58.432636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.65:40709)
0806 01:03:58.432831 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:58.432841 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:58.432899 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:58.433127 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:58.433128 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:58.433302 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:58.433355 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:58.433356 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:58.434147 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:58.434148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:58.434687 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:58.434689 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:58.435069 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:58.435069 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:58.435109 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:58.435577 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:58.435582 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:58.437581 (+ 1999us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":114,"threads_started":1}
W20260806 01:03:58.437825 21004 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:58.432760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:40709 (local address 127.11.88.126:45151)
0806 01:03:58.432940 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:58.432942 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:58.432951 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:03:58.432975 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:58.432976 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:58.432994 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:58.433115 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:58.433441 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:58.434031 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:58.434781 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:58.435000 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:58.435099 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:58.437730 (+ 2631us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.65:40709: BlockingRecv error: recv got EOF from 127.11.88.65:40709 (error 108)
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":107,"threads_started":1}
Aug 06 01:03:58 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:58 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:58.584241 21005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:58.579107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.66:46337)
0806 01:03:58.579242 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:58.579254 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:58.579321 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:58.579520 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:58.579521 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:58.579706 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:58.579757 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:58.579760 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:58.580471 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:58.580471 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:58.581040 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:58.581042 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:58.581471 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:58.581472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:58.581514 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:58.582037 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:58.582042 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:58.584142 (+ 2100us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":83,"threads_started":1}
W20260806 01:03:58.584309 21004 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:58.579209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:46337 (local address 127.11.88.126:45151)
0806 01:03:58.579298 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:58.579300 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:58.579314 (+ 14us) server_negotiation.cc:407] Connection header received
0806 01:03:58.579414 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:58.579415 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:58.579429 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:58.579498 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:58.579856 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:58.580384 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:58.581188 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:58.581395 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:58.581459 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:58.584245 (+ 2786us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.66:46337: BlockingRecv error: recv got EOF from 127.11.88.66:46337 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 06 01:03:58 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:58 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:58.750186 21006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:58.745285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.67:60729)
0806 01:03:58.745449 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:58.745466 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:58.745529 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:58.745674 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:58.745675 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:58.745866 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:58.745915 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:58.745916 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:58.746661 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:58.746662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:58.747191 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:58.747192 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:58.747525 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:58.747526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:58.747576 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:58.748022 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:58.748027 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:58.750052 (+ 2025us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":105,"threads_started":1}
W20260806 01:03:58.750322 21004 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:58.745375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:60729 (local address 127.11.88.126:45151)
0806 01:03:58.745454 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:58.745456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:58.745528 (+ 72us) server_negotiation.cc:407] Connection header received
0806 01:03:58.745581 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:58.745582 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:58.745595 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:58.745653 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:58.745976 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:58.746560 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:58.747277 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:58.747456 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:58.747506 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:58.750255 (+ 2749us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.67:60729: BlockingRecv error: recv got EOF from 127.11.88.67:60729 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 06 01:03:59 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:59 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:59.443585 21007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:59.438459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.65:45675)
0806 01:03:59.438598 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:59.438618 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:59.438698 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:59.438917 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:59.438918 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:59.439183 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:59.439245 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:59.439247 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:59.440008 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:59.440009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:59.440576 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:59.440578 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:59.440964 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:59.440965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:59.441007 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:59.441522 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:59.441527 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:59.443521 (+ 1994us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":75,"threads_started":1}
W20260806 01:03:59.443764 21008 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:59.438527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:45675 (local address 127.11.88.126:45151)
0806 01:03:59.438681 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:59.438683 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:59.438693 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:03:59.438802 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:59.438803 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:59.438817 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:59.438891 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:59.439346 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:59.439880 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:59.440683 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:59.440886 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:59.440950 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:59.443644 (+ 2694us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.65:45675: BlockingRecv error: recv got EOF from 127.11.88.65:45675 (error 108)
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":79,"threads_started":1}
Aug 06 01:03:59 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:59 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:59.589761 21009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:59.584827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.66:50597)
0806 01:03:59.585000 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:59.585012 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:59.585065 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:59.585266 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:59.585267 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:59.585456 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:59.585507 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:59.585509 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:59.586269 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:59.586270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:59.586882 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:59.586884 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:59.587255 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:59.587256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:59.587302 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:59.587767 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:59.587772 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:59.589685 (+ 1913us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":100,"threads_started":1}
W20260806 01:03:59.589924 21008 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:59.584987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:50597 (local address 127.11.88.126:45151)
0806 01:03:59.585038 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:59.585040 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:59.585053 (+ 13us) server_negotiation.cc:407] Connection header received
0806 01:03:59.585169 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:59.585169 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:59.585182 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:59.585244 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:59.585600 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:59.586193 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:59.586963 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:59.587183 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:59.587242 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:59.589817 (+ 2575us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.66:50597: BlockingRecv error: recv got EOF from 127.11.88.66:50597 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 06 01:03:59 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:03:59 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:03:59.756368 21010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:03:59.750815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.67:35403)
0806 01:03:59.751037 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0806 01:03:59.751056 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 01:03:59.751150 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:03:59.751332 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:03:59.751333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:03:59.751529 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:03:59.751584 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:59.751586 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:59.752311 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:59.752312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:59.752934 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:03:59.752935 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:03:59.753347 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:03:59.753348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:03:59.753402 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:59.754010 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:03:59.754015 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:03:59.756296 (+ 2281us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":102,"threads_started":1}
W20260806 01:03:59.756515 21008 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:03:59.750941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:35403 (local address 127.11.88.126:45151)
0806 01:03:59.751017 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0806 01:03:59.751018 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 01:03:59.751132 (+ 114us) server_negotiation.cc:407] Connection header received
0806 01:03:59.751203 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:03:59.751204 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:03:59.751219 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:03:59.751270 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:03:59.751664 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:59.752194 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:59.753026 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:03:59.753261 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:03:59.753325 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:03:59.756423 (+ 3098us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.67:35403: BlockingRecv error: recv got EOF from 127.11.88.67:35403 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 06 01:04:00 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:04:00 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:04:00.455636 21011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:00.444238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.65:49271)
0806 01:04:00.444422 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:00.444434 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:04:00.444499 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:04:00.444686 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:04:00.444687 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:04:00.444866 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:04:00.444922 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:00.444923 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:00.445859 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:00.445860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:00.446494 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:00.446498 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:00.446888 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:00.446889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:00.446953 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:00.453343 (+ 6390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:04:00.453350 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:04:00.455557 (+ 2207us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":113,"threads_started":1}
W20260806 01:04:00.455818 21012 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:04:00.444389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:49271 (local address 127.11.88.126:45151)
0806 01:04:00.444534 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:00.444536 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:00.444547 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:04:00.444577 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:00.444578 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:00.444589 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:00.444658 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:04:00.445096 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:00.445743 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:00.446604 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:00.446806 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:00.446886 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:00.455716 (+ 8830us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.65:49271: BlockingRecv error: recv got EOF from 127.11.88.65:49271 (error 108)
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":82,"threads_started":1}
Aug 06 01:04:00 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:04:00 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:04:00.596217 21013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:00.590474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.66:53183)
0806 01:04:00.590671 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:00.590686 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 01:04:00.590776 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:04:00.590979 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:04:00.590980 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:04:00.591210 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:04:00.591265 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:00.591267 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:00.592035 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:00.592036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:00.592690 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:00.592693 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:00.593126 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:00.593127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:00.593221 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:00.593748 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:04:00.593753 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:04:00.596151 (+ 2398us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":98,"threads_started":1}
W20260806 01:04:00.596442 21012 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:04:00.590616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:53183 (local address 127.11.88.126:45151)
0806 01:04:00.590676 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:00.590679 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:00.590752 (+ 73us) server_negotiation.cc:407] Connection header received
0806 01:04:00.590865 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:00.590866 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:00.590883 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:00.590968 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:04:00.591361 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:00.591930 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:00.592796 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:00.593018 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:00.593123 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:00.596355 (+ 3232us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.66:53183: BlockingRecv error: recv got EOF from 127.11.88.66:53183 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 06 01:04:00 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:04:00 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.67@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:04:00.762517 21014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:00.757036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.67:44375)
0806 01:04:00.757240 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:00.757253 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:04:00.757361 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:04:00.757562 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:04:00.757563 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:04:00.757781 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:04:00.757880 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:00.757889 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:00.758639 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:00.758640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:00.759179 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:00.759181 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:00.759557 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:00.759557 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:00.759619 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:00.760092 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:04:00.760097 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:04:00.762452 (+ 2355us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":110,"threads_started":1}
W20260806 01:04:00.762758 21012 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:04:00.757150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:44375 (local address 127.11.88.126:45151)
0806 01:04:00.757231 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:00.757233 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:00.757337 (+ 104us) server_negotiation.cc:407] Connection header received
0806 01:04:00.757459 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:00.757460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:00.757484 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:00.757553 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:04:00.757981 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:00.758558 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:00.759275 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:00.759468 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:00.759557 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:00.762673 (+ 3116us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.67:44375: BlockingRecv error: recv got EOF from 127.11.88.67:44375 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 06 01:04:01 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:04:01 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.65@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:04:01.461570 21015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:01.456255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.65:45465)
0806 01:04:01.456526 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:01.456537 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:04:01.456597 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:04:01.456814 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:04:01.456816 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:04:01.456994 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:04:01.457048 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:01.457050 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:01.457706 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:01.457706 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:01.458297 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:01.458299 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:01.458691 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:01.458692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:01.458746 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:01.459311 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:04:01.459316 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:04:01.461466 (+ 2150us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":204,"threads_started":1}
W20260806 01:04:01.461723 21016 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:04:01.456368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:45465 (local address 127.11.88.126:45151)
0806 01:04:01.456525 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:01.456527 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:01.456641 (+ 114us) server_negotiation.cc:407] Connection header received
0806 01:04:01.456676 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:01.456677 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:01.456691 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:01.456764 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:04:01.457129 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:01.457631 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:01.458392 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:01.458594 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:01.458659 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:01.461604 (+ 2945us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.65:45465: BlockingRecv error: recv got EOF from 127.11.88.65:45465 (error 108)
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":84,"threads_started":1}
Aug 06 01:04:01 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 01:04:01 dist-test-slave-69rg krb5kdc[19917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.88.66@KRBTEST.COM for oryx/127.11.88.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 01:04:01.602339 21017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:01.596801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:45151 (local address 127.11.88.66:54965)
0806 01:04:01.597020 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:01.597033 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:04:01.597134 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:04:01.597325 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:04:01.597326 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:04:01.597530 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:04:01.597583 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:01.597585 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:01.598503 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:01.598504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:01.599094 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:01.599096 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:01.599519 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:01.599521 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:01.599588 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:01.600203 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:04:01.600208 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:04:01.602196 (+ 1988us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.88.126:45151: Server oryx/127.11.88.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":105,"threads_started":1}
W20260806 01:04:01.602380 21016 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:04:01.596897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:54965 (local address 127.11.88.126:45151)
0806 01:04:01.597003 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:01.597006 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:01.597113 (+ 107us) server_negotiation.cc:407] Connection header received
0806 01:04:01.597215 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:01.597216 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:01.597232 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:01.597316 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:04:01.597681 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:01.598394 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:01.599206 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:01.599435 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:01.599522 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:01.602311 (+ 2789us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.88.66:54965: BlockingRecv error: recv got EOF from 127.11.88.66:54965 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 01:04:01.672948 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 20521
I20260806 01:04:01.679046 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 20684
I20260806 01:04:01.684500 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 20819
I20260806 01:04:01.690052 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 20449
2026-08-06T01:04:01Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17875 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-06T01:04:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:04:01Z Disabled control of system clock
I20260806 01:04:01.722376 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:34631
--webserver_interface=127.11.88.126
--webserver_port=0
--builtin_ntp_servers=127.11.88.84:41423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:34631
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 01:04:01.814297 21022 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:04:01.814533 21022 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:04:01.814556 21022 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:04:01.815935 21022 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:04:01.815994 21022 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:04:01.816007 21022 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:04:01.816021 21022 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:04:01.816035 21022 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:04:01.817787 21022 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:41423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:34631
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:34631
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21022
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:04:01.818177 21022 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:04:01.818540 21022 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:04:01.824961 21030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:04:01.824972 21028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:04:01.824987 21027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:04:01.825153 21022 server_base.cc:1034] running on GCE node
I20260806 01:04:01.825630 21022 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:04:01.826027 21022 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:04:01.827235 21022 hybrid_clock.cc:648] HybridClock initialized: now 1785978241827230 us; error 68 us; skew 500 ppm
I20260806 01:04:01.828847 21022 webserver.cc:460] Webserver started at http://127.11.88.126:46655/ using document root <none> and password file <none>
I20260806 01:04:01.829149 21022 fs_manager.cc:359] Metadata directory not provided
I20260806 01:04:01.829232 21022 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:04:01.829392 21022 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:04:01.830610 21022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "9528889f9a3742bcb8fdb844ae4fde90"
format_stamp: "Formatted at 2026-08-06 01:04:01 on dist-test-slave-69rg"
server_key: "86c424a7cd2cf8a3de0b0814e020c51d"
server_key_iv: "9f499f869a48f9437308b087698a92ad"
server_key_version: "encryptionkey@0"
I20260806 01:04:01.831123 21022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "9528889f9a3742bcb8fdb844ae4fde90"
format_stamp: "Formatted at 2026-08-06 01:04:01 on dist-test-slave-69rg"
server_key: "86c424a7cd2cf8a3de0b0814e020c51d"
server_key_iv: "9f499f869a48f9437308b087698a92ad"
server_key_version: "encryptionkey@0"
I20260806 01:04:01.832955 21022 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 01:04:01.833953 21036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:01.834204 21022 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:04:01.834343 21022 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "9528889f9a3742bcb8fdb844ae4fde90"
format_stamp: "Formatted at 2026-08-06 01:04:01 on dist-test-slave-69rg"
server_key: "86c424a7cd2cf8a3de0b0814e020c51d"
server_key_iv: "9f499f869a48f9437308b087698a92ad"
server_key_version: "encryptionkey@0"
I20260806 01:04:01.834441 21022 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:04:01.854705 21022 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:04:01.855123 21022 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:04:01.855312 21022 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:04:01.859890 21022 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:34631
I20260806 01:04:01.859927 21092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:34631 every 8 connection(s)
I20260806 01:04:01.860350 21022 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:04:01.861172 21093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:04:01.863934 21093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9528889f9a3742bcb8fdb844ae4fde90: Bootstrap starting.
I20260806 01:04:01.864604 21093 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9528889f9a3742bcb8fdb844ae4fde90: Neither blocks nor log segments found. Creating new log.
I20260806 01:04:01.864936 21093 log.cc:824] T 00000000000000000000000000000000 P 9528889f9a3742bcb8fdb844ae4fde90: Log is configured to *not* fsync() on all Append() calls
I20260806 01:04:01.865800 21093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9528889f9a3742bcb8fdb844ae4fde90: No bootstrap required, opened a new log
I20260806 01:04:01.867496 21093 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9528889f9a3742bcb8fdb844ae4fde90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9528889f9a3742bcb8fdb844ae4fde90" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 34631 } }
I20260806 01:04:01.867643 21093 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9528889f9a3742bcb8fdb844ae4fde90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:04:01.867673 21093 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9528889f9a3742bcb8fdb844ae4fde90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9528889f9a3742bcb8fdb844ae4fde90, State: Initialized, Role: FOLLOWER
I20260806 01:04:01.867839 21093 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9528889f9a3742bcb8fdb844ae4fde90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9528889f9a3742bcb8fdb844ae4fde90" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 34631 } }
I20260806 01:04:01.867918 21093 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9528889f9a3742bcb8fdb844ae4fde90 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:04:01.867942 21093 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9528889f9a3742bcb8fdb844ae4fde90 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:04:01.868016 21093 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9528889f9a3742bcb8fdb844ae4fde90 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:04:01.868319 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 21022
I20260806 01:04:01.868439 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:04:01.868662 11617 external_mini_cluster.cc:1428] Setting key acee0e8de706d289f421223eca0aef37
I20260806 01:04:01.868700 21093 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9528889f9a3742bcb8fdb844ae4fde90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9528889f9a3742bcb8fdb844ae4fde90" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 34631 } }
I20260806 01:04:01.868816 21093 leader_election.cc:302] T 00000000000000000000000000000000 P 9528889f9a3742bcb8fdb844ae4fde90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9528889f9a3742bcb8fdb844ae4fde90; no voters:
I20260806 01:04:01.869030 21093 leader_election.cc:288] T 00000000000000000000000000000000 P 9528889f9a3742bcb8fdb844ae4fde90 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:04:01.869068 21096 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9528889f9a3742bcb8fdb844ae4fde90 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:04:01.869388 21096 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9528889f9a3742bcb8fdb844ae4fde90 [term 1 LEADER]: Becoming Leader. State: Replica: 9528889f9a3742bcb8fdb844ae4fde90, State: Running, Role: LEADER
I20260806 01:04:01.869411 21093 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9528889f9a3742bcb8fdb844ae4fde90 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:04:01.869561 21096 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9528889f9a3742bcb8fdb844ae4fde90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9528889f9a3742bcb8fdb844ae4fde90" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 34631 } }
I20260806 01:04:01.869992 21100 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9528889f9a3742bcb8fdb844ae4fde90 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9528889f9a3742bcb8fdb844ae4fde90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9528889f9a3742bcb8fdb844ae4fde90" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 34631 } } }
I20260806 01:04:01.870075 21100 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9528889f9a3742bcb8fdb844ae4fde90 [sys.catalog]: This master's current role is: LEADER
I20260806 01:04:01.870131 21098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9528889f9a3742bcb8fdb844ae4fde90 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9528889f9a3742bcb8fdb844ae4fde90. Latest consensus state: current_term: 1 leader_uuid: "9528889f9a3742bcb8fdb844ae4fde90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9528889f9a3742bcb8fdb844ae4fde90" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 34631 } } }
I20260806 01:04:01.870210 21098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9528889f9a3742bcb8fdb844ae4fde90 [sys.catalog]: This master's current role is: LEADER
I20260806 01:04:01.870888 21107 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:04:01.871455 21107 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:04:01.873337 21107 catalog_manager.cc:1347] Generated new cluster ID: d56c782ffae244b0b60a5e3257c1ac6d
I20260806 01:04:01.873399 21107 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:04:01.875638 21099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:01.869250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46884 (local address 127.11.88.126:34631)
0806 01:04:01.869722 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:01.869732 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:01.869766 (+ 34us) server_negotiation.cc:407] Connection header received
0806 01:04:01.869911 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:01.869918 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:01.870356 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:01.870510 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:04:01.870745 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:01.872275 (+ 1530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:01.873316 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:01.873942 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:01.874066 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:01.874858 (+ 792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:04:01.874862 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:04:01.874862 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:04:01.875084 (+ 222us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:04:01.875126 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:04:01.875141 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:04:01.875206 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:01.875312 (+ 106us) server_negotiation.cc:299] Negotiation successful
0806 01:04:01.875395 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":77,"threads_started":1}
I20260806 01:04:01.881135 21107 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:04:01.881933 21107 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:04:01.901232 21107 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9528889f9a3742bcb8fdb844ae4fde90: Generated new TSK 0
I20260806 01:04:01.901503 21107 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:04:01.903810 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:0
--local_ip_for_outbound_sockets=127.11.88.65
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:34631
--builtin_ntp_servers=127.11.88.84:41423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260806 01:04:01.992081 21120 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:04:01.992337 21120 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:04:01.992374 21120 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:04:01.993582 21120 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:04:01.993655 21120 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:04:01.993698 21120 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:04:01.995222 21120 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:41423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:34631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21120
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:04:01.995510 21120 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:04:01.995854 21120 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:04:02.001369 21125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:04:02.001556 21128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:04:02.001382 21126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:04:02.002116 21120 server_base.cc:1034] running on GCE node
I20260806 01:04:02.002350 21120 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:04:02.002658 21120 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:04:02.003832 21120 hybrid_clock.cc:648] HybridClock initialized: now 1785978242003809 us; error 41 us; skew 500 ppm
I20260806 01:04:02.005298 21120 webserver.cc:460] Webserver started at http://127.11.88.65:42415/ using document root <none> and password file <none>
I20260806 01:04:02.005617 21120 fs_manager.cc:359] Metadata directory not provided
I20260806 01:04:02.005668 21120 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:04:02.005897 21120 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:04:02.007126 21120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/data/instance:
uuid: "e066a3b75a5b4eeb85a9480d2d28c670"
format_stamp: "Formatted at 2026-08-06 01:04:02 on dist-test-slave-69rg"
server_key: "320e433502025c60bfaba395739a6774"
server_key_iv: "a185a6ca2944d871a991cc13d65be8f7"
server_key_version: "encryptionkey@0"
I20260806 01:04:02.007758 21120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance:
uuid: "e066a3b75a5b4eeb85a9480d2d28c670"
format_stamp: "Formatted at 2026-08-06 01:04:02 on dist-test-slave-69rg"
server_key: "320e433502025c60bfaba395739a6774"
server_key_iv: "a185a6ca2944d871a991cc13d65be8f7"
server_key_version: "encryptionkey@0"
I20260806 01:04:02.009344 21120 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:04:02.010335 21134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:02.010530 21120 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 01:04:02.010681 21120 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "e066a3b75a5b4eeb85a9480d2d28c670"
format_stamp: "Formatted at 2026-08-06 01:04:02 on dist-test-slave-69rg"
server_key: "320e433502025c60bfaba395739a6774"
server_key_iv: "a185a6ca2944d871a991cc13d65be8f7"
server_key_version: "encryptionkey@0"
I20260806 01:04:02.010773 21120 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:04:02.023558 21120 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:04:02.024062 21120 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:04:02.024269 21120 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:04:02.024531 21120 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:04:02.024935 21120 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:04:02.024994 21120 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:02.025060 21120 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:04:02.025092 21120 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:02.031641 21120 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:45193
I20260806 01:04:02.031682 21258 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:45193 every 8 connection(s)
I20260806 01:04:02.032042 21120 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
I20260806 01:04:02.037667 21099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:02.032857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:52351 (local address 127.11.88.126:34631)
0806 01:04:02.032976 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:02.032979 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:02.033201 (+ 222us) server_negotiation.cc:407] Connection header received
0806 01:04:02.033773 (+ 572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:02.033775 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:02.033792 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:02.033861 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:04:02.034565 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:02.035095 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:02.036159 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:02.036382 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:02.036463 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:02.037361 (+ 898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:04:02.037363 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:04:02.037363 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:04:02.037368 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:04:02.037383 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:04:02.037388 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:04:02.037435 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:02.037532 (+ 97us) server_negotiation.cc:299] Negotiation successful
0806 01:04:02.037573 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 01:04:02.037972 21261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:02.032758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:34631 (local address 127.11.88.65:52351)
0806 01:04:02.033034 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:02.033071 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 01:04:02.033646 (+ 575us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:04:02.033936 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:04:02.033940 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:04:02.033948 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:04:02.034453 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:02.034458 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:02.035236 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:02.035237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:02.036052 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:02.036054 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:02.036474 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:02.036475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:02.036613 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:02.037211 (+ 598us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 01:04:02.037211 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:04:02.037240 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 01:04:02.037263 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:04:02.037435 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:04:02.037441 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:04:02.037444 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:04:02.037534 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 01:04:02.037640 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":113,"threads_started":1}
I20260806 01:04:02.038554 21259 heartbeater.cc:347] Connected to a master server at 127.11.88.126:34631
I20260806 01:04:02.038684 21259 heartbeater.cc:464] Registering TS with master...
I20260806 01:04:02.038913 21259 heartbeater.cc:511] Master 127.11.88.126:34631 requested a full tablet report, sending...
I20260806 01:04:02.039477 21054 ts_manager.cc:194] Registered new tserver with Master: e066a3b75a5b4eeb85a9480d2d28c670 (127.11.88.65:45193)
I20260806 01:04:02.040163 21054 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.88.65:52351
I20260806 01:04:02.040611 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 21120
I20260806 01:04:02.040723 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance
I20260806 01:04:02.040940 11617 external_mini_cluster.cc:1428] Setting key 1824691f2828764a958189bf59b04d5e
I20260806 01:04:02.042026 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:0
--local_ip_for_outbound_sockets=127.11.88.66
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:34631
--builtin_ntp_servers=127.11.88.84:41423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260806 01:04:02.130616 21262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:04:02.130884 21262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:04:02.130923 21262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:04:02.132184 21262 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:04:02.132267 21262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:04:02.132309 21262 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:04:02.134032 21262 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:41423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:34631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21262
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:04:02.134372 21262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:04:02.134739 21262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:04:02.140918 21272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:04:02.140918 21268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:04:02.140960 21262 server_base.cc:1034] running on GCE node
W20260806 01:04:02.140924 21270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:04:02.141496 21262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:04:02.141873 21262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:04:02.143060 21262 hybrid_clock.cc:648] HybridClock initialized: now 1785978242143010 us; error 75 us; skew 500 ppm
I20260806 01:04:02.144503 21262 webserver.cc:460] Webserver started at http://127.11.88.66:43671/ using document root <none> and password file <none>
I20260806 01:04:02.144811 21262 fs_manager.cc:359] Metadata directory not provided
I20260806 01:04:02.144888 21262 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:04:02.145053 21262 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:04:02.146333 21262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/data/instance:
uuid: "c41e3488c0f84972819b382df913f036"
format_stamp: "Formatted at 2026-08-06 01:04:02 on dist-test-slave-69rg"
server_key: "fc0814b559f098b33e61241a772d8afc"
server_key_iv: "1228f5de5707505b9704417dd909e26e"
server_key_version: "encryptionkey@0"
I20260806 01:04:02.146730 21262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance:
uuid: "c41e3488c0f84972819b382df913f036"
format_stamp: "Formatted at 2026-08-06 01:04:02 on dist-test-slave-69rg"
server_key: "fc0814b559f098b33e61241a772d8afc"
server_key_iv: "1228f5de5707505b9704417dd909e26e"
server_key_version: "encryptionkey@0"
I20260806 01:04:02.148286 21262 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 01:04:02.149125 21278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:02.149354 21262 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:04:02.149466 21262 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "c41e3488c0f84972819b382df913f036"
format_stamp: "Formatted at 2026-08-06 01:04:02 on dist-test-slave-69rg"
server_key: "fc0814b559f098b33e61241a772d8afc"
server_key_iv: "1228f5de5707505b9704417dd909e26e"
server_key_version: "encryptionkey@0"
I20260806 01:04:02.149544 21262 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:04:02.175173 21262 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:04:02.175547 21262 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:04:02.175719 21262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:04:02.175981 21262 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:04:02.176347 21262 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:04:02.176406 21262 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:02.176442 21262 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:04:02.176491 21262 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:02.182739 21262 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:40343
I20260806 01:04:02.182787 21394 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:40343 every 8 connection(s)
I20260806 01:04:02.183137 21262 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
I20260806 01:04:02.188016 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 21262
I20260806 01:04:02.188107 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance
I20260806 01:04:02.188339 11617 external_mini_cluster.cc:1428] Setting key d6223e9f73dab299144b0e305d07a0d6
I20260806 01:04:02.188970 21099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:02.183931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:48301 (local address 127.11.88.126:34631)
0806 01:04:02.184024 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:02.184026 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:02.184235 (+ 209us) server_negotiation.cc:407] Connection header received
0806 01:04:02.184785 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:02.184786 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:02.184798 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:02.184867 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:04:02.185667 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:02.186275 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:02.187257 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:02.187448 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:02.187502 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:02.188687 (+ 1185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:04:02.188689 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:04:02.188689 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:04:02.188694 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:04:02.188711 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:04:02.188715 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:04:02.188764 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:02.188854 (+ 90us) server_negotiation.cc:299] Negotiation successful
0806 01:04:02.188887 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 01:04:02.189208 21398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:02.183880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:34631 (local address 127.11.88.66:48301)
0806 01:04:02.184085 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:02.184131 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 01:04:02.184650 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:04:02.184957 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:04:02.184960 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:04:02.184969 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:04:02.185519 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:02.185524 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:02.186370 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:02.186371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:02.187173 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:02.187175 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:02.187523 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:02.187524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:02.187637 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:02.188520 (+ 883us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 01:04:02.188521 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:04:02.188561 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 01:04:02.188584 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:04:02.188764 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:04:02.188769 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:04:02.188773 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:04:02.188857 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 01:04:02.188967 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":92,"threads_started":1}
I20260806 01:04:02.189494 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:0
--local_ip_for_outbound_sockets=127.11.88.67
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:34631
--builtin_ntp_servers=127.11.88.84:41423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260806 01:04:02.189642 21396 heartbeater.cc:347] Connected to a master server at 127.11.88.126:34631
I20260806 01:04:02.189762 21396 heartbeater.cc:464] Registering TS with master...
I20260806 01:04:02.189983 21396 heartbeater.cc:511] Master 127.11.88.126:34631 requested a full tablet report, sending...
I20260806 01:04:02.190392 21054 ts_manager.cc:194] Registered new tserver with Master: c41e3488c0f84972819b382df913f036 (127.11.88.66:40343)
I20260806 01:04:02.190781 21054 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.88.66:48301
W20260806 01:04:02.274050 21399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:04:02.274266 21399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:04:02.274288 21399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:04:02.275496 21399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:04:02.275540 21399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:04:02.275593 21399 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:04:02.276974 21399 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:41423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:34631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21399
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:04:02.277235 21399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:04:02.277552 21399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:04:02.283038 21404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:04:02.283133 21399 server_base.cc:1034] running on GCE node
W20260806 01:04:02.283093 21405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:04:02.283041 21407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:04:02.283591 21399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:04:02.283882 21399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:04:02.285051 21399 hybrid_clock.cc:648] HybridClock initialized: now 1785978242285014 us; error 55 us; skew 500 ppm
I20260806 01:04:02.286484 21399 webserver.cc:460] Webserver started at http://127.11.88.67:38375/ using document root <none> and password file <none>
I20260806 01:04:02.286741 21399 fs_manager.cc:359] Metadata directory not provided
I20260806 01:04:02.286811 21399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:04:02.286962 21399 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:04:02.288050 21399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/data/instance:
uuid: "8f4fb5ccd6c34d4abfd4bb1706cbc6ab"
format_stamp: "Formatted at 2026-08-06 01:04:02 on dist-test-slave-69rg"
server_key: "dffc794af1cb44884c9450ee53a09b95"
server_key_iv: "fb959f191e33a7f7c0e21b80168d7b9e"
server_key_version: "encryptionkey@0"
I20260806 01:04:02.288434 21399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance:
uuid: "8f4fb5ccd6c34d4abfd4bb1706cbc6ab"
format_stamp: "Formatted at 2026-08-06 01:04:02 on dist-test-slave-69rg"
server_key: "dffc794af1cb44884c9450ee53a09b95"
server_key_iv: "fb959f191e33a7f7c0e21b80168d7b9e"
server_key_version: "encryptionkey@0"
I20260806 01:04:02.289793 21399 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 01:04:02.290655 21413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:02.290827 21399 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 01:04:02.290928 21399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "8f4fb5ccd6c34d4abfd4bb1706cbc6ab"
format_stamp: "Formatted at 2026-08-06 01:04:02 on dist-test-slave-69rg"
server_key: "dffc794af1cb44884c9450ee53a09b95"
server_key_iv: "fb959f191e33a7f7c0e21b80168d7b9e"
server_key_version: "encryptionkey@0"
I20260806 01:04:02.291014 21399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:04:02.321089 21399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:04:02.321530 21399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:04:02.321725 21399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:04:02.322047 21399 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:04:02.322427 21399 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:04:02.322484 21399 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:02.322533 21399 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:04:02.322559 21399 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:02.329631 21399 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:46707
I20260806 01:04:02.329684 21529 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:46707 every 8 connection(s)
I20260806 01:04:02.330155 21399 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
I20260806 01:04:02.335947 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 21399
I20260806 01:04:02.336055 21099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:02.331084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:35717 (local address 127.11.88.126:34631)
0806 01:04:02.331169 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:02.331172 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:02.331509 (+ 337us) server_negotiation.cc:407] Connection header received
0806 01:04:02.332014 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:02.332016 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:02.332027 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:02.332090 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:04:02.332844 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:02.333367 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:02.334505 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:02.334706 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:02.334770 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:02.335710 (+ 940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:04:02.335711 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:04:02.335712 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:04:02.335719 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:04:02.335743 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:04:02.335748 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:04:02.335824 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:02.335916 (+ 92us) server_negotiation.cc:299] Negotiation successful
0806 01:04:02.335952 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 01:04:02.336287 21533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:02.331060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:34631 (local address 127.11.88.67:35717)
0806 01:04:02.331355 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:02.331397 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 01:04:02.331911 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:04:02.332174 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:04:02.332178 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:04:02.332187 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:04:02.332729 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:02.332733 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:02.333498 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:02.333499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:02.334403 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:02.334406 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:02.334796 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:02.334797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:02.334911 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:02.335541 (+ 630us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 01:04:02.335541 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:04:02.335572 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 01:04:02.335596 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:04:02.335827 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:04:02.335831 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:04:02.335834 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:04:02.335887 (+ 53us) client_negotiation.cc:240] Negotiation successful
0806 01:04:02.335971 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":121,"threads_started":1}
I20260806 01:04:02.336722 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance
I20260806 01:04:02.336988 11617 external_mini_cluster.cc:1428] Setting key f5d65360dbe16ea266be7ac4798ab1bf
I20260806 01:04:02.337076 21531 heartbeater.cc:347] Connected to a master server at 127.11.88.126:34631
I20260806 01:04:02.337210 21531 heartbeater.cc:464] Registering TS with master...
I20260806 01:04:02.337499 21531 heartbeater.cc:511] Master 127.11.88.126:34631 requested a full tablet report, sending...
I20260806 01:04:02.337947 21053 ts_manager.cc:194] Registered new tserver with Master: 8f4fb5ccd6c34d4abfd4bb1706cbc6ab (127.11.88.67:46707)
I20260806 01:04:02.338469 21053 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.88.67:35717
I20260806 01:04:02.349517 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 01:04:02.351805 21099 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:04:02.351148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46894 (local address 127.11.88.126:34631)
0806 01:04:02.351236 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:02.351238 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:02.351336 (+ 98us) server_negotiation.cc:407] Connection header received
0806 01:04:02.351435 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:02.351436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:02.351451 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:02.351510 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:04:02.351684 (+ 174us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46894: BlockingRecv error: recv got EOF from 127.0.0.1:46894 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 01:04:02.351907 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 21120
I20260806 01:04:02.357978 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 21262
I20260806 01:04:02.364296 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 21399
I20260806 01:04:02.370240 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 21022
2026-08-06T01:04:02Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (677 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-06T01:04:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:04:02Z Disabled control of system clock
I20260806 01:04:02.399901 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:41137
--webserver_interface=127.11.88.126
--webserver_port=0
--builtin_ntp_servers=127.11.88.84:40161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:41137
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 01:04:02.485025 21542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:04:02.485268 21542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:04:02.485292 21542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:04:02.486493 21542 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:04:02.486537 21542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:04:02.486549 21542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:04:02.486562 21542 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:04:02.486575 21542 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:04:02.487937 21542 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:41137
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:41137
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21542
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:04:02.488160 21542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:04:02.488426 21542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:04:02.493533 21550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:04:02.493589 21548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:04:02.493528 21547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:04:02.493656 21542 server_base.cc:1034] running on GCE node
I20260806 01:04:02.494104 21542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:04:02.494411 21542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:04:02.495565 21542 hybrid_clock.cc:648] HybridClock initialized: now 1785978242495532 us; error 49 us; skew 500 ppm
I20260806 01:04:02.496837 21542 webserver.cc:460] Webserver started at http://127.11.88.126:36067/ using document root <none> and password file <none>
I20260806 01:04:02.497094 21542 fs_manager.cc:359] Metadata directory not provided
I20260806 01:04:02.497141 21542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:04:02.497327 21542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:04:02.498466 21542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "5cea8001fb3c45e2ba8c04810839430d"
format_stamp: "Formatted at 2026-08-06 01:04:02 on dist-test-slave-69rg"
server_key: "f59ea4e1d7d9eb2cd58dcb261dcdfd5d"
server_key_iv: "0db8f8d9bbb843f578199a241c6c1807"
server_key_version: "encryptionkey@0"
I20260806 01:04:02.498837 21542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "5cea8001fb3c45e2ba8c04810839430d"
format_stamp: "Formatted at 2026-08-06 01:04:02 on dist-test-slave-69rg"
server_key: "f59ea4e1d7d9eb2cd58dcb261dcdfd5d"
server_key_iv: "0db8f8d9bbb843f578199a241c6c1807"
server_key_version: "encryptionkey@0"
I20260806 01:04:02.500159 21542 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 01:04:02.500936 21556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:02.501127 21542 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:04:02.501240 21542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "5cea8001fb3c45e2ba8c04810839430d"
format_stamp: "Formatted at 2026-08-06 01:04:02 on dist-test-slave-69rg"
server_key: "f59ea4e1d7d9eb2cd58dcb261dcdfd5d"
server_key_iv: "0db8f8d9bbb843f578199a241c6c1807"
server_key_version: "encryptionkey@0"
I20260806 01:04:02.501329 21542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:04:02.504871 21542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:04:02.505148 21542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:04:02.505296 21542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:04:02.509186 21542 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:41137
I20260806 01:04:02.509218 21612 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:41137 every 8 connection(s)
I20260806 01:04:02.509562 21542 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:04:02.510327 21613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:04:02.513104 21613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5cea8001fb3c45e2ba8c04810839430d: Bootstrap starting.
I20260806 01:04:02.513726 21613 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5cea8001fb3c45e2ba8c04810839430d: Neither blocks nor log segments found. Creating new log.
I20260806 01:04:02.514086 21613 log.cc:824] T 00000000000000000000000000000000 P 5cea8001fb3c45e2ba8c04810839430d: Log is configured to *not* fsync() on all Append() calls
I20260806 01:04:02.514828 21613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5cea8001fb3c45e2ba8c04810839430d: No bootstrap required, opened a new log
I20260806 01:04:02.515056 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 21542
I20260806 01:04:02.515168 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:04:02.515398 11617 external_mini_cluster.cc:1428] Setting key dfb48ecbfdf3c106ffa7e10c37e7d777
I20260806 01:04:02.517343 21613 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5cea8001fb3c45e2ba8c04810839430d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cea8001fb3c45e2ba8c04810839430d" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 41137 } }
I20260806 01:04:02.517544 21613 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5cea8001fb3c45e2ba8c04810839430d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:04:02.517637 21613 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5cea8001fb3c45e2ba8c04810839430d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cea8001fb3c45e2ba8c04810839430d, State: Initialized, Role: FOLLOWER
I20260806 01:04:02.517834 21613 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5cea8001fb3c45e2ba8c04810839430d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cea8001fb3c45e2ba8c04810839430d" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 41137 } }
I20260806 01:04:02.517938 21613 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5cea8001fb3c45e2ba8c04810839430d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:04:02.517964 21613 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5cea8001fb3c45e2ba8c04810839430d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:04:02.518105 21613 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5cea8001fb3c45e2ba8c04810839430d [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:04:02.518644 21617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:02.516000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57362 (local address 127.11.88.126:41137)
0806 01:04:02.516242 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:02.516252 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:02.516286 (+ 34us) server_negotiation.cc:407] Connection header received
0806 01:04:02.516851 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:02.516860 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:02.516916 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:02.517085 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:04:02.517881 (+ 796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:04:02.517891 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:04:02.517892 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:04:02.517896 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:04:02.517958 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:04:02.517975 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:04:02.518066 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:02.518155 (+ 89us) server_negotiation.cc:299] Negotiation successful
0806 01:04:02.518222 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":86,"threads_started":1}
I20260806 01:04:02.518862 21613 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5cea8001fb3c45e2ba8c04810839430d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cea8001fb3c45e2ba8c04810839430d" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 41137 } }
I20260806 01:04:02.518976 21613 leader_election.cc:302] T 00000000000000000000000000000000 P 5cea8001fb3c45e2ba8c04810839430d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5cea8001fb3c45e2ba8c04810839430d; no voters:
I20260806 01:04:02.519171 21613 leader_election.cc:288] T 00000000000000000000000000000000 P 5cea8001fb3c45e2ba8c04810839430d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:04:02.519272 21618 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5cea8001fb3c45e2ba8c04810839430d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:04:02.519474 21618 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5cea8001fb3c45e2ba8c04810839430d [term 1 LEADER]: Becoming Leader. State: Replica: 5cea8001fb3c45e2ba8c04810839430d, State: Running, Role: LEADER
I20260806 01:04:02.519605 21618 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5cea8001fb3c45e2ba8c04810839430d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cea8001fb3c45e2ba8c04810839430d" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 41137 } }
I20260806 01:04:02.519667 21613 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5cea8001fb3c45e2ba8c04810839430d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:04:02.519999 21619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5cea8001fb3c45e2ba8c04810839430d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5cea8001fb3c45e2ba8c04810839430d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cea8001fb3c45e2ba8c04810839430d" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 41137 } } }
I20260806 01:04:02.520085 21619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5cea8001fb3c45e2ba8c04810839430d [sys.catalog]: This master's current role is: LEADER
I20260806 01:04:02.520327 21622 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:04:02.520869 21622 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:04:02.520292 21620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5cea8001fb3c45e2ba8c04810839430d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5cea8001fb3c45e2ba8c04810839430d. Latest consensus state: current_term: 1 leader_uuid: "5cea8001fb3c45e2ba8c04810839430d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cea8001fb3c45e2ba8c04810839430d" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 41137 } } }
I20260806 01:04:02.521076 21620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5cea8001fb3c45e2ba8c04810839430d [sys.catalog]: This master's current role is: LEADER
I20260806 01:04:02.522833 21622 catalog_manager.cc:1347] Generated new cluster ID: 04a6dccd062d43ff83e77f092d7857c0
I20260806 01:04:02.522903 21622 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:04:02.537863 21622 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:04:02.538100 21622 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:04:02.545627 21622 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5cea8001fb3c45e2ba8c04810839430d: Generated new TSK 0
I20260806 01:04:02.545881 21622 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:04:02.551864 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:0
--local_ip_for_outbound_sockets=127.11.88.65
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:41137
--builtin_ntp_servers=127.11.88.84:40161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 01:04:02.649403 21637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:04:02.649626 21637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:04:02.649652 21637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:04:02.650925 21637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:04:02.650971 21637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:04:02.651000 21637 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:04:02.652467 21637 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:41137
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21637
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:04:02.652766 21637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:04:02.653097 21637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:04:02.658191 21643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:04:02.658322 21642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:04:02.658196 21645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:04:02.658483 21637 server_base.cc:1034] running on GCE node
I20260806 01:04:02.658700 21637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:04:02.658987 21637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:04:02.660189 21637 hybrid_clock.cc:648] HybridClock initialized: now 1785978242660175 us; error 29 us; skew 500 ppm
I20260806 01:04:02.661621 21637 webserver.cc:460] Webserver started at http://127.11.88.65:35069/ using document root <none> and password file <none>
I20260806 01:04:02.661970 21637 fs_manager.cc:359] Metadata directory not provided
I20260806 01:04:02.662021 21637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:04:02.662158 21637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:04:02.663278 21637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/data/instance:
uuid: "494f6848ea7e494188f7ddc2d7c38cf9"
format_stamp: "Formatted at 2026-08-06 01:04:02 on dist-test-slave-69rg"
server_key: "d56034ca5f9f16c98d148ad2cbb6b452"
server_key_iv: "29cd171803a83a8df6bb14ec8c4a8b40"
server_key_version: "encryptionkey@0"
I20260806 01:04:02.663645 21637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance:
uuid: "494f6848ea7e494188f7ddc2d7c38cf9"
format_stamp: "Formatted at 2026-08-06 01:04:02 on dist-test-slave-69rg"
server_key: "d56034ca5f9f16c98d148ad2cbb6b452"
server_key_iv: "29cd171803a83a8df6bb14ec8c4a8b40"
server_key_version: "encryptionkey@0"
I20260806 01:04:02.665045 21637 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:04:02.665881 21651 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:02.666042 21637 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:04:02.666148 21637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "494f6848ea7e494188f7ddc2d7c38cf9"
format_stamp: "Formatted at 2026-08-06 01:04:02 on dist-test-slave-69rg"
server_key: "d56034ca5f9f16c98d148ad2cbb6b452"
server_key_iv: "29cd171803a83a8df6bb14ec8c4a8b40"
server_key_version: "encryptionkey@0"
I20260806 01:04:02.666224 21637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:04:02.669682 21637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:04:02.669999 21637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:04:02.670141 21637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:04:02.670405 21637 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:04:02.670758 21637 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:04:02.670792 21637 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:02.670814 21637 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:04:02.670848 21637 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:02.677085 21637 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:39391
I20260806 01:04:02.677129 21767 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:39391 every 8 connection(s)
I20260806 01:04:02.677469 21637 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
I20260806 01:04:02.678356 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 21637
I20260806 01:04:02.678467 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance
I20260806 01:04:02.678750 11617 external_mini_cluster.cc:1428] Setting key ff4a1ee075b53ce3a73ea0f8e19c9e78
I20260806 01:04:02.679908 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:0
--local_ip_for_outbound_sockets=127.11.88.66
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:41137
--builtin_ntp_servers=127.11.88.84:40161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260806 01:04:02.681032 21617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:02.678303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:43699 (local address 127.11.88.126:41137)
0806 01:04:02.678391 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:02.678394 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:02.678615 (+ 221us) server_negotiation.cc:407] Connection header received
0806 01:04:02.679259 (+ 644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:02.679260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:02.679266 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:02.679324 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:04:02.680724 (+ 1400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:04:02.680726 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:04:02.680726 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:04:02.680731 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:04:02.680749 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:04:02.680754 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:04:02.680821 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:02.680907 (+ 86us) server_negotiation.cc:299] Negotiation successful
0806 01:04:02.680925 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 01:04:02.681133 21770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:02.678256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:41137 (local address 127.11.88.65:43699)
0806 01:04:02.678446 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:02.678487 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 01:04:02.679150 (+ 663us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:04:02.679405 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:04:02.679409 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:04:02.679419 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:04:02.680548 (+ 1129us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 01:04:02.680548 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:04:02.680577 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 01:04:02.680607 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:04:02.680831 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:04:02.680834 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:04:02.680836 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 01:04:02.680891 (+ 55us) client_negotiation.cc:240] Negotiation successful
0806 01:04:02.680942 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":82,"threads_started":1}
I20260806 01:04:02.681695 21768 heartbeater.cc:347] Connected to a master server at 127.11.88.126:41137
I20260806 01:04:02.681803 21768 heartbeater.cc:464] Registering TS with master...
I20260806 01:04:02.681969 21768 heartbeater.cc:511] Master 127.11.88.126:41137 requested a full tablet report, sending...
I20260806 01:04:02.682504 21576 ts_manager.cc:194] Registered new tserver with Master: 494f6848ea7e494188f7ddc2d7c38cf9 (127.11.88.65:39391)
W20260806 01:04:02.766191 21771 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:04:02.766449 21771 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:04:02.766489 21771 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:04:02.767791 21771 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:04:02.767863 21771 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:04:02.767908 21771 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:04:02.769483 21771 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:41137
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21771
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:04:02.769793 21771 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:04:02.770154 21771 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:04:02.775887 21780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:04:02.775916 21771 server_base.cc:1034] running on GCE node
W20260806 01:04:02.775887 21776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:04:02.775894 21778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:04:02.776324 21771 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:04:02.776618 21771 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:04:02.777796 21771 hybrid_clock.cc:648] HybridClock initialized: now 1785978242777779 us; error 75 us; skew 500 ppm
I20260806 01:04:02.779392 21771 webserver.cc:460] Webserver started at http://127.11.88.66:36199/ using document root <none> and password file <none>
I20260806 01:04:02.779721 21771 fs_manager.cc:359] Metadata directory not provided
I20260806 01:04:02.779808 21771 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:04:02.779989 21771 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:04:02.781246 21771 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/data/instance:
uuid: "be9cd34a1121421e84b16c8f0735eb8f"
format_stamp: "Formatted at 2026-08-06 01:04:02 on dist-test-slave-69rg"
server_key: "8c4276e4cb22773ccafe09c74ca0d68b"
server_key_iv: "94310d7489c22b39194535d88b8c97fb"
server_key_version: "encryptionkey@0"
I20260806 01:04:02.781661 21771 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance:
uuid: "be9cd34a1121421e84b16c8f0735eb8f"
format_stamp: "Formatted at 2026-08-06 01:04:02 on dist-test-slave-69rg"
server_key: "8c4276e4cb22773ccafe09c74ca0d68b"
server_key_iv: "94310d7489c22b39194535d88b8c97fb"
server_key_version: "encryptionkey@0"
I20260806 01:04:02.783228 21771 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:04:02.784157 21786 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:02.784379 21771 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:04:02.784492 21771 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "be9cd34a1121421e84b16c8f0735eb8f"
format_stamp: "Formatted at 2026-08-06 01:04:02 on dist-test-slave-69rg"
server_key: "8c4276e4cb22773ccafe09c74ca0d68b"
server_key_iv: "94310d7489c22b39194535d88b8c97fb"
server_key_version: "encryptionkey@0"
I20260806 01:04:02.784570 21771 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:04:02.788129 21771 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:04:02.788434 21771 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:04:02.788584 21771 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:04:02.788810 21771 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:04:02.789235 21771 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:04:02.789285 21771 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:02.789314 21771 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:04:02.789382 21771 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:02.796146 21771 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:41655
I20260806 01:04:02.796233 21903 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:41655 every 8 connection(s)
I20260806 01:04:02.796577 21771 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
I20260806 01:04:02.799639 21617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:02.797389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:35867 (local address 127.11.88.126:41137)
0806 01:04:02.797467 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:02.797469 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:02.797661 (+ 192us) server_negotiation.cc:407] Connection header received
0806 01:04:02.798221 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:02.798222 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:02.798227 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:02.798300 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:04:02.799428 (+ 1128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:04:02.799429 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:04:02.799430 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:04:02.799435 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:04:02.799452 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:04:02.799457 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:04:02.799518 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:02.799565 (+ 47us) server_negotiation.cc:299] Negotiation successful
0806 01:04:02.799581 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 01:04:02.799882 21906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:02.797323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:41137 (local address 127.11.88.66:35867)
0806 01:04:02.797517 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:02.797568 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 01:04:02.798128 (+ 560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:04:02.798354 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:04:02.798357 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:04:02.798364 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:04:02.799266 (+ 902us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 01:04:02.799267 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:04:02.799294 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 01:04:02.799323 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:04:02.799519 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:04:02.799521 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:04:02.799524 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:04:02.799570 (+ 46us) client_negotiation.cc:240] Negotiation successful
0806 01:04:02.799619 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":98,"threads_started":1}
I20260806 01:04:02.800505 21904 heartbeater.cc:347] Connected to a master server at 127.11.88.126:41137
I20260806 01:04:02.800625 21904 heartbeater.cc:464] Registering TS with master...
I20260806 01:04:02.800763 21904 heartbeater.cc:511] Master 127.11.88.126:41137 requested a full tablet report, sending...
I20260806 01:04:02.801211 21576 ts_manager.cc:194] Registered new tserver with Master: be9cd34a1121421e84b16c8f0735eb8f (127.11.88.66:41655)
I20260806 01:04:02.806118 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 21771
I20260806 01:04:02.806244 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance
I20260806 01:04:02.806468 11617 external_mini_cluster.cc:1428] Setting key a6685ccee1085d16e0d423ed668afca1
I20260806 01:04:02.807456 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:0
--local_ip_for_outbound_sockets=127.11.88.67
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:41137
--builtin_ntp_servers=127.11.88.84:40161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 01:04:02.891731 21907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:04:02.891947 21907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:04:02.891973 21907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:04:02.893411 21907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:04:02.893474 21907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:04:02.893507 21907 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:04:02.894982 21907 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:41137
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21907
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:04:02.895273 21907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:04:02.895556 21907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:04:02.901314 21916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:04:02.901335 21914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:04:02.901432 21913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:04:02.901463 21907 server_base.cc:1034] running on GCE node
I20260806 01:04:02.901754 21907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:04:02.902053 21907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:04:02.903267 21907 hybrid_clock.cc:648] HybridClock initialized: now 1785978242903244 us; error 42 us; skew 500 ppm
I20260806 01:04:02.904773 21907 webserver.cc:460] Webserver started at http://127.11.88.67:37817/ using document root <none> and password file <none>
I20260806 01:04:02.905088 21907 fs_manager.cc:359] Metadata directory not provided
I20260806 01:04:02.905162 21907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:04:02.905330 21907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:04:02.906566 21907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/data/instance:
uuid: "d6c504b047404b3b86982841f3a731ac"
format_stamp: "Formatted at 2026-08-06 01:04:02 on dist-test-slave-69rg"
server_key: "18efb86f6d1f633a5c8edc7e836893b3"
server_key_iv: "1e29d776cb869c68caae84f2ac2a900a"
server_key_version: "encryptionkey@0"
I20260806 01:04:02.906939 21907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance:
uuid: "d6c504b047404b3b86982841f3a731ac"
format_stamp: "Formatted at 2026-08-06 01:04:02 on dist-test-slave-69rg"
server_key: "18efb86f6d1f633a5c8edc7e836893b3"
server_key_iv: "1e29d776cb869c68caae84f2ac2a900a"
server_key_version: "encryptionkey@0"
I20260806 01:04:02.908443 21907 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 01:04:02.909363 21923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:02.909686 21907 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:04:02.909830 21907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "d6c504b047404b3b86982841f3a731ac"
format_stamp: "Formatted at 2026-08-06 01:04:02 on dist-test-slave-69rg"
server_key: "18efb86f6d1f633a5c8edc7e836893b3"
server_key_iv: "1e29d776cb869c68caae84f2ac2a900a"
server_key_version: "encryptionkey@0"
I20260806 01:04:02.909965 21907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:04:02.914220 21907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:04:02.914558 21907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:04:02.914727 21907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:04:02.914973 21907 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:04:02.915349 21907 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:04:02.915411 21907 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:02.915457 21907 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:04:02.915488 21907 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:02.922571 21907 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:40863
I20260806 01:04:02.922621 22041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:40863 every 8 connection(s)
I20260806 01:04:02.922961 21907 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
I20260806 01:04:02.926191 21617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:02.923719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:59195 (local address 127.11.88.126:41137)
0806 01:04:02.923796 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:02.923798 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:02.924034 (+ 236us) server_negotiation.cc:407] Connection header received
0806 01:04:02.924557 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:02.924559 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:02.924564 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:02.924634 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:04:02.925946 (+ 1312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:04:02.925948 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:04:02.925948 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:04:02.925953 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:04:02.925970 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:04:02.925974 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:04:02.926038 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:02.926087 (+ 49us) server_negotiation.cc:299] Negotiation successful
0806 01:04:02.926101 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260806 01:04:02.926362 22044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:02.923683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:41137 (local address 127.11.88.67:59195)
0806 01:04:02.923896 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:02.923940 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 01:04:02.924442 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:04:02.924731 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:04:02.924734 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:04:02.924742 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:04:02.925746 (+ 1004us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 01:04:02.925746 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:04:02.925775 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 01:04:02.925804 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:04:02.926038 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:04:02.926040 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:04:02.926042 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 01:04:02.926094 (+ 52us) client_negotiation.cc:240] Negotiation successful
0806 01:04:02.926143 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":113,"threads_started":1}
I20260806 01:04:02.926870 22042 heartbeater.cc:347] Connected to a master server at 127.11.88.126:41137
I20260806 01:04:02.926965 22042 heartbeater.cc:464] Registering TS with master...
I20260806 01:04:02.927196 22042 heartbeater.cc:511] Master 127.11.88.126:41137 requested a full tablet report, sending...
I20260806 01:04:02.927603 21576 ts_manager.cc:194] Registered new tserver with Master: d6c504b047404b3b86982841f3a731ac (127.11.88.67:40863)
I20260806 01:04:02.933080 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 21907
I20260806 01:04:02.933209 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance
I20260806 01:04:02.933408 11617 external_mini_cluster.cc:1428] Setting key 32c592454735491076a4f654a942b999
I20260806 01:04:02.934408 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 01:04:02.936442 21617 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:04:02.935839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57366 (local address 127.11.88.126:41137)
0806 01:04:02.935907 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:02.935910 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:02.936045 (+ 135us) server_negotiation.cc:407] Connection header received
0806 01:04:02.936072 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:02.936073 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:02.936077 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:02.936131 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:04:02.936372 (+ 241us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57366: BlockingRecv error: recv got EOF from 127.0.0.1:57366 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 01:04:02.936559 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 21637
I20260806 01:04:02.942216 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 21771
I20260806 01:04:02.947970 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 21907
I20260806 01:04:02.953552 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 21542
2026-08-06T01:04:02Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (583 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:04:03 dist-test-slave-69rg krb5kdc[22052](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:04:03 dist-test-slave-69rg krb5kdc[22052](info): set up 2 sockets
Aug 06 01:04:03 dist-test-slave-69rg krb5kdc[22052](info): commencing operation
krb5kdc: starting...
W20260806 01:04:04.037206 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:04:04 dist-test-slave-69rg krb5kdc[22052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978244, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:04:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:04:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:04:04.170706 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:46241
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:35851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:46241
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:04:04.254671 22066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:04:04.255065 22066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:04:04.255112 22066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:04:04.256423 22066 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:04:04.256500 22066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:04:04.256524 22066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:04:04.256556 22066 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:04:04.256584 22066 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:04:04.258296 22066 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:35851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:46241
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:46241
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22066
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:04:04.258605 22066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:04:04.258867 22066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:04:04.264101 22074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:04:04.264134 22066 server_base.cc:1034] running on GCE node
W20260806 01:04:04.264096 22071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:04:04.264096 22072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:04:04.264750 22066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:04:04.265072 22066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:04:04.266253 22066 hybrid_clock.cc:648] HybridClock initialized: now 1785978244266237 us; error 46 us; skew 500 ppm
Aug 06 01:04:04 dist-test-slave-69rg krb5kdc[22052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978244, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:04:04.268875 22066 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:04:04.269347 22066 webserver.cc:460] Webserver started at http://127.11.88.126:38483/ using document root <none> and password file <none>
I20260806 01:04:04.269569 22066 fs_manager.cc:359] Metadata directory not provided
I20260806 01:04:04.269613 22066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:04:04.269707 22066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:04:04.270838 22066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "84649050bf8a4bc592ab70037c147c27"
format_stamp: "Formatted at 2026-08-06 01:04:04 on dist-test-slave-69rg"
server_key: "1178b0a76f1a3634656b0871a44c9836"
server_key_iv: "b4a8e6bcd81d4ec2465267ecaeaaac8c"
server_key_version: "encryptionkey@0"
I20260806 01:04:04.271133 22066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "84649050bf8a4bc592ab70037c147c27"
format_stamp: "Formatted at 2026-08-06 01:04:04 on dist-test-slave-69rg"
server_key: "1178b0a76f1a3634656b0871a44c9836"
server_key_iv: "b4a8e6bcd81d4ec2465267ecaeaaac8c"
server_key_version: "encryptionkey@0"
I20260806 01:04:04.272536 22066 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 01:04:04.273361 22081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:04.273543 22066 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:04:04.273638 22066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "84649050bf8a4bc592ab70037c147c27"
format_stamp: "Formatted at 2026-08-06 01:04:04 on dist-test-slave-69rg"
server_key: "1178b0a76f1a3634656b0871a44c9836"
server_key_iv: "b4a8e6bcd81d4ec2465267ecaeaaac8c"
server_key_version: "encryptionkey@0"
I20260806 01:04:04.273725 22066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:04:04.283914 22066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:04:04.286458 22066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:04:04.286584 22066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:04:04.290688 22066 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:46241
I20260806 01:04:04.290781 22133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:46241 every 8 connection(s)
I20260806 01:04:04.291039 22066 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:04:04.292033 22134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:04:04.294458 22134 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84649050bf8a4bc592ab70037c147c27: Bootstrap starting.
I20260806 01:04:04.295086 22134 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 84649050bf8a4bc592ab70037c147c27: Neither blocks nor log segments found. Creating new log.
I20260806 01:04:04.295410 22134 log.cc:824] T 00000000000000000000000000000000 P 84649050bf8a4bc592ab70037c147c27: Log is configured to *not* fsync() on all Append() calls
I20260806 01:04:04.296196 22134 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84649050bf8a4bc592ab70037c147c27: No bootstrap required, opened a new log
I20260806 01:04:04.296229 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 22066
I20260806 01:04:04.296449 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:04:04.296646 11617 external_mini_cluster.cc:1428] Setting key 3b529a8d45301c1e4f41225b8e66b21c
I20260806 01:04:04.298355 22134 raft_consensus.cc:348] T 00000000000000000000000000000000 P 84649050bf8a4bc592ab70037c147c27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84649050bf8a4bc592ab70037c147c27" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46241 } }
I20260806 01:04:04.298597 22134 raft_consensus.cc:374] T 00000000000000000000000000000000 P 84649050bf8a4bc592ab70037c147c27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:04:04.298663 22134 raft_consensus.cc:729] T 00000000000000000000000000000000 P 84649050bf8a4bc592ab70037c147c27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84649050bf8a4bc592ab70037c147c27, State: Initialized, Role: FOLLOWER
I20260806 01:04:04.298803 22134 consensus_queue.cc:260] T 00000000000000000000000000000000 P 84649050bf8a4bc592ab70037c147c27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84649050bf8a4bc592ab70037c147c27" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46241 } }
I20260806 01:04:04.298898 22134 raft_consensus.cc:388] T 00000000000000000000000000000000 P 84649050bf8a4bc592ab70037c147c27 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:04:04.298942 22134 raft_consensus.cc:482] T 00000000000000000000000000000000 P 84649050bf8a4bc592ab70037c147c27 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:04:04.299000 22134 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 84649050bf8a4bc592ab70037c147c27 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:04:04.300040 22134 raft_consensus.cc:504] T 00000000000000000000000000000000 P 84649050bf8a4bc592ab70037c147c27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84649050bf8a4bc592ab70037c147c27" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46241 } }
I20260806 01:04:04.300171 22134 leader_election.cc:302] T 00000000000000000000000000000000 P 84649050bf8a4bc592ab70037c147c27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 84649050bf8a4bc592ab70037c147c27; no voters:
I20260806 01:04:04.300386 22134 leader_election.cc:288] T 00000000000000000000000000000000 P 84649050bf8a4bc592ab70037c147c27 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:04:04.300411 22139 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 84649050bf8a4bc592ab70037c147c27 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:04:04.300590 22139 raft_consensus.cc:686] T 00000000000000000000000000000000 P 84649050bf8a4bc592ab70037c147c27 [term 1 LEADER]: Becoming Leader. State: Replica: 84649050bf8a4bc592ab70037c147c27, State: Running, Role: LEADER
I20260806 01:04:04.300724 22134 sys_catalog.cc:564] T 00000000000000000000000000000000 P 84649050bf8a4bc592ab70037c147c27 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:04:04.300748 22139 consensus_queue.cc:237] T 00000000000000000000000000000000 P 84649050bf8a4bc592ab70037c147c27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84649050bf8a4bc592ab70037c147c27" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46241 } }
I20260806 01:04:04.301090 22139 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84649050bf8a4bc592ab70037c147c27 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 84649050bf8a4bc592ab70037c147c27. Latest consensus state: current_term: 1 leader_uuid: "84649050bf8a4bc592ab70037c147c27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84649050bf8a4bc592ab70037c147c27" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46241 } } }
I20260806 01:04:04.301112 22140 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84649050bf8a4bc592ab70037c147c27 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "84649050bf8a4bc592ab70037c147c27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84649050bf8a4bc592ab70037c147c27" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46241 } } }
I20260806 01:04:04.301317 22140 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84649050bf8a4bc592ab70037c147c27 [sys.catalog]: This master's current role is: LEADER
I20260806 01:04:04.301512 22139 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84649050bf8a4bc592ab70037c147c27 [sys.catalog]: This master's current role is: LEADER
I20260806 01:04:04.301703 22151 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:04:04.302327 22151 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:04:04.304225 22151 catalog_manager.cc:1347] Generated new cluster ID: 0108aaccea7c4f079be1ed6c41845ceb
I20260806 01:04:04.304283 22151 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 01:04:04 dist-test-slave-69rg krb5kdc[22052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978244, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:04:04.309535 22138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:04.297232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51526 (local address 127.11.88.126:46241)
0806 01:04:04.297420 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:04.297428 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:04.297454 (+ 26us) server_negotiation.cc:407] Connection header received
0806 01:04:04.298339 (+ 885us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:04.298346 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:04.298401 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:04.298518 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:04:04.299384 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.300614 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.301784 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.302412 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.303036 (+ 624us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:04.305631 (+ 2595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:04:04.305636 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:04:04.305636 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:04:04.305651 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:04:04.307641 (+ 1990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:04:04.308146 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:04:04.308150 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:04:04.308150 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:04:04.308280 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:04:04.308520 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:04:04.308521 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:04:04.308521 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:04:04.308792 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:04:04.308974 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:04.309084 (+ 110us) server_negotiation.cc:299] Negotiation successful
0806 01:04:04.309364 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":98,"threads_started":1}
I20260806 01:04:04.314836 22151 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:04:04.315825 22151 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:04:04.322772 22151 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 84649050bf8a4bc592ab70037c147c27: Generated new TSK 0
I20260806 01:04:04.323024 22151 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.88.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
I20260806 01:04:04.353528 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:0
--local_ip_for_outbound_sockets=127.11.88.65
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:46241
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:35851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:04:04.439659 22163 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:04:04.439882 22163 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:04:04.439908 22163 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:04:04.441113 22163 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:04:04.441155 22163 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:04:04.441182 22163 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:04:04.442775 22163 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:35851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:46241
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22163
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:04:04.443037 22163 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:04:04.443327 22163 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:04:04.448565 22168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:04:04.448649 22163 server_base.cc:1034] running on GCE node
W20260806 01:04:04.448570 22169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:04:04.448573 22171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:04:04.449013 22163 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:04:04.449262 22163 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:04:04.450400 22163 hybrid_clock.cc:648] HybridClock initialized: now 1785978244450390 us; error 27 us; skew 500 ppm
Aug 06 01:04:04 dist-test-slave-69rg krb5kdc[22052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978244, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:04:04.453095 22163 init.cc:377] Logged in from keytab as kudu/127.11.88.65@KRBTEST.COM (short username kudu)
I20260806 01:04:04.453624 22163 webserver.cc:460] Webserver started at http://127.11.88.65:37777/ using document root <none> and password file <none>
I20260806 01:04:04.453913 22163 fs_manager.cc:359] Metadata directory not provided
I20260806 01:04:04.453962 22163 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:04:04.454110 22163 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:04:04.455183 22163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/data/instance:
uuid: "b5abfb653ebf485ba4a59d4a40e484af"
format_stamp: "Formatted at 2026-08-06 01:04:04 on dist-test-slave-69rg"
server_key: "f78781790693504b9187035422b82729"
server_key_iv: "48233ef35d0ca4878f37968d0e4537a9"
server_key_version: "encryptionkey@0"
I20260806 01:04:04.455555 22163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance:
uuid: "b5abfb653ebf485ba4a59d4a40e484af"
format_stamp: "Formatted at 2026-08-06 01:04:04 on dist-test-slave-69rg"
server_key: "f78781790693504b9187035422b82729"
server_key_iv: "48233ef35d0ca4878f37968d0e4537a9"
server_key_version: "encryptionkey@0"
I20260806 01:04:04.456971 22163 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:04:04.457934 22178 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:04.458302 22163 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:04:04.458441 22163 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "b5abfb653ebf485ba4a59d4a40e484af"
format_stamp: "Formatted at 2026-08-06 01:04:04 on dist-test-slave-69rg"
server_key: "f78781790693504b9187035422b82729"
server_key_iv: "48233ef35d0ca4878f37968d0e4537a9"
server_key_version: "encryptionkey@0"
I20260806 01:04:04.458544 22163 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:04:04.467314 22163 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:04:04.470062 22163 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:04:04.470237 22163 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:04:04.470503 22163 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:04:04.470849 22163 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:04:04.470912 22163 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:04.470960 22163 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:04:04.470985 22163 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:04.477962 22163 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:42531
I20260806 01:04:04.478022 22295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:42531 every 8 connection(s)
I20260806 01:04:04.478430 22163 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
I20260806 01:04:04.479450 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 22163
I20260806 01:04:04.479571 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance
I20260806 01:04:04.479808 11617 external_mini_cluster.cc:1428] Setting key ddadab532cb97a61bbad297e08920d03
Aug 06 01:04:04 dist-test-slave-69rg krb5kdc[22052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978244, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.88.66@KRBTEST.COM; defaulting to no policy
I20260806 01:04:04.489742 22138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:04.479219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:39933 (local address 127.11.88.126:46241)
0806 01:04:04.479311 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:04.479314 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:04.479594 (+ 280us) server_negotiation.cc:407] Connection header received
0806 01:04:04.480336 (+ 742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:04.480338 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:04.480350 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:04.480426 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:04:04.481878 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.482526 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.483676 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.483916 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.484000 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:04.486672 (+ 2672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:04:04.486674 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:04:04.486674 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:04:04.486709 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:04:04.488184 (+ 1475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:04:04.488693 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:04:04.488694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:04:04.488695 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:04:04.488775 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:04:04.489030 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:04:04.489031 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:04:04.489031 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:04:04.489173 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:04:04.489236 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:04.489519 (+ 283us) server_negotiation.cc:299] Negotiation successful
0806 01:04:04.489601 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 01:04:04.489981 22298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:04.479190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:46241 (local address 127.11.88.65:39933)
0806 01:04:04.479425 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:04.479479 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 01:04:04.480221 (+ 742us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:04:04.480508 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:04:04.480512 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:04:04.481403 (+ 891us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:04:04.481695 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:04.481701 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.482644 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.482645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:04.483529 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:04.483532 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.484013 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.484014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:04.484150 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:04.484757 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:04:04.484766 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:04:04.486558 (+ 1792us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:04:04.488293 (+ 1735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:04:04.488301 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:04:04.488303 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:04:04.488539 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:04:04.488857 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:04:04.488858 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:04:04.488858 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:04:04.488963 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:04:04.489258 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:04:04.489263 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:04:04.489386 (+ 123us) client_negotiation.cc:769] Sending connection context
0806 01:04:04.489471 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 01:04:04.489635 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":125,"threads_started":1}
I20260806 01:04:04.490520 22296 heartbeater.cc:347] Connected to a master server at 127.11.88.126:46241
I20260806 01:04:04.490634 22296 heartbeater.cc:464] Registering TS with master...
I20260806 01:04:04.490859 22296 heartbeater.cc:511] Master 127.11.88.126:46241 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.66@KRBTEST.COM" created.
I20260806 01:04:04.491469 22098 ts_manager.cc:194] Registered new tserver with Master: b5abfb653ebf485ba4a59d4a40e484af (127.11.88.65:42531)
I20260806 01:04:04.492129 22098 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.65@KRBTEST.COM'} at 127.11.88.65:39933
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
I20260806 01:04:04.509791 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:0
--local_ip_for_outbound_sockets=127.11.88.66
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:46241
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:35851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:04:04.595098 22301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:04:04.595368 22301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:04:04.595410 22301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:04:04.596655 22301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:04:04.596741 22301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:04:04.596789 22301 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:04:04.598484 22301 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:35851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:46241
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22301
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:04:04.598786 22301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:04:04.599053 22301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:04:04.604511 22307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:04:04.604511 22306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:04:04.604578 22309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:04:04.604571 22301 server_base.cc:1034] running on GCE node
I20260806 01:04:04.604993 22301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:04:04.605232 22301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:04:04.606374 22301 hybrid_clock.cc:648] HybridClock initialized: now 1785978244606359 us; error 30 us; skew 500 ppm
Aug 06 01:04:04 dist-test-slave-69rg krb5kdc[22052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978244, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:04:04.608996 22301 init.cc:377] Logged in from keytab as kudu/127.11.88.66@KRBTEST.COM (short username kudu)
I20260806 01:04:04.609494 22301 webserver.cc:460] Webserver started at http://127.11.88.66:37729/ using document root <none> and password file <none>
I20260806 01:04:04.609742 22301 fs_manager.cc:359] Metadata directory not provided
I20260806 01:04:04.609789 22301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:04:04.609982 22301 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:04:04.611034 22301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/data/instance:
uuid: "da16b6eaacad484da375a5edcbecce41"
format_stamp: "Formatted at 2026-08-06 01:04:04 on dist-test-slave-69rg"
server_key: "b56ce9661013ded65d062c8a5435f72e"
server_key_iv: "220bd33e1999523566d4090046b8a405"
server_key_version: "encryptionkey@0"
I20260806 01:04:04.611428 22301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance:
uuid: "da16b6eaacad484da375a5edcbecce41"
format_stamp: "Formatted at 2026-08-06 01:04:04 on dist-test-slave-69rg"
server_key: "b56ce9661013ded65d062c8a5435f72e"
server_key_iv: "220bd33e1999523566d4090046b8a405"
server_key_version: "encryptionkey@0"
I20260806 01:04:04.612788 22301 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:04:04.613618 22316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:04.613808 22301 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 01:04:04.613951 22301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "da16b6eaacad484da375a5edcbecce41"
format_stamp: "Formatted at 2026-08-06 01:04:04 on dist-test-slave-69rg"
server_key: "b56ce9661013ded65d062c8a5435f72e"
server_key_iv: "220bd33e1999523566d4090046b8a405"
server_key_version: "encryptionkey@0"
I20260806 01:04:04.614028 22301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:04:04.649291 22301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:04:04.651801 22301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:04:04.651964 22301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:04:04.652249 22301 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:04:04.652599 22301 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:04:04.652635 22301 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:04.652658 22301 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:04:04.652707 22301 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:04.658944 22301 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:43537
I20260806 01:04:04.659001 22432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:43537 every 8 connection(s)
I20260806 01:04:04.659396 22301 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
I20260806 01:04:04.665756 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 22301
I20260806 01:04:04.665903 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance
I20260806 01:04:04.666131 11617 external_mini_cluster.cc:1428] Setting key 9f46c34c3a39f4fc772c06a07e1fdd04
Aug 06 01:04:04 dist-test-slave-69rg krb5kdc[22052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978244, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:04:04.669723 22138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:04.660251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:43559 (local address 127.11.88.126:46241)
0806 01:04:04.660327 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:04.660329 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:04.660519 (+ 190us) server_negotiation.cc:407] Connection header received
0806 01:04:04.661071 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:04.661072 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:04.661083 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:04.661151 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:04:04.662286 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.662848 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.663915 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.664130 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.664197 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:04.666732 (+ 2535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:04:04.666734 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:04:04.666734 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:04:04.666743 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:04:04.668229 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:04:04.668683 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:04:04.668684 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:04:04.668685 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:04:04.668752 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:04:04.669020 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:04:04.669021 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:04:04.669022 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:04:04.669148 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:04:04.669223 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:04.669521 (+ 298us) server_negotiation.cc:299] Negotiation successful
0806 01:04:04.669626 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 01:04:04.669986 22436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:04.660222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:46241 (local address 127.11.88.66:43559)
0806 01:04:04.660380 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:04.660423 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 01:04:04.660923 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:04:04.661206 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:04:04.661210 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:04:04.661805 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:04:04.662157 (+ 352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:04.662163 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.662962 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.662963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:04.663799 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:04.663802 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.664222 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.664223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:04.664329 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:04.664958 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:04:04.664967 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:04:04.666619 (+ 1652us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:04:04.668342 (+ 1723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:04:04.668351 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:04:04.668353 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:04:04.668598 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:04:04.668830 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:04:04.668830 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:04:04.668831 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:04:04.668951 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:04:04.669225 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:04:04.669234 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:04:04.669382 (+ 148us) client_negotiation.cc:769] Sending connection context
0806 01:04:04.669489 (+ 107us) client_negotiation.cc:240] Negotiation successful
0806 01:04:04.669662 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":81,"threads_started":1}
I20260806 01:04:04.670578 22433 heartbeater.cc:347] Connected to a master server at 127.11.88.126:46241
I20260806 01:04:04.670697 22433 heartbeater.cc:464] Registering TS with master...
I20260806 01:04:04.670923 22433 heartbeater.cc:511] Master 127.11.88.126:46241 requested a full tablet report, sending...
I20260806 01:04:04.671330 22098 ts_manager.cc:194] Registered new tserver with Master: da16b6eaacad484da375a5edcbecce41 (127.11.88.66:43537)
I20260806 01:04:04.671734 22098 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.66@KRBTEST.COM'} at 127.11.88.66:43559
WARNING: no policy specified for kudu/127.11.88.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
I20260806 01:04:04.693022 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:0
--local_ip_for_outbound_sockets=127.11.88.67
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:46241
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:35851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:04:04.777026 22439 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:04:04.777279 22439 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:04:04.777324 22439 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:04:04.778677 22439 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:04:04.778759 22439 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:04:04.778807 22439 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:04:04.780411 22439 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:35851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:46241
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22439
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:04:04.780709 22439 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:04:04.780972 22439 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:04:04.786434 22447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:04:04.786418 22444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:04:04.786418 22445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:04:04.786549 22439 server_base.cc:1034] running on GCE node
I20260806 01:04:04.786952 22439 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:04:04.787230 22439 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:04:04.788389 22439 hybrid_clock.cc:648] HybridClock initialized: now 1785978244788373 us; error 36 us; skew 500 ppm
Aug 06 01:04:04 dist-test-slave-69rg krb5kdc[22052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978244, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:04:04.791046 22439 init.cc:377] Logged in from keytab as kudu/127.11.88.67@KRBTEST.COM (short username kudu)
I20260806 01:04:04.791574 22439 webserver.cc:460] Webserver started at http://127.11.88.67:35219/ using document root <none> and password file <none>
I20260806 01:04:04.791834 22439 fs_manager.cc:359] Metadata directory not provided
I20260806 01:04:04.791906 22439 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:04:04.792061 22439 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:04:04.793145 22439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/data/instance:
uuid: "8cb5b4c227b64e16ba749638bd7cc14e"
format_stamp: "Formatted at 2026-08-06 01:04:04 on dist-test-slave-69rg"
server_key: "c9b256685cddd882e7073824e9049c01"
server_key_iv: "d915b9ed6994281d0ab0fda7ef47b091"
server_key_version: "encryptionkey@0"
I20260806 01:04:04.793529 22439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance:
uuid: "8cb5b4c227b64e16ba749638bd7cc14e"
format_stamp: "Formatted at 2026-08-06 01:04:04 on dist-test-slave-69rg"
server_key: "c9b256685cddd882e7073824e9049c01"
server_key_iv: "d915b9ed6994281d0ab0fda7ef47b091"
server_key_version: "encryptionkey@0"
I20260806 01:04:04.795012 22439 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:04:04.795770 22454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:04.795954 22439 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 01:04:04.796066 22439 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "8cb5b4c227b64e16ba749638bd7cc14e"
format_stamp: "Formatted at 2026-08-06 01:04:04 on dist-test-slave-69rg"
server_key: "c9b256685cddd882e7073824e9049c01"
server_key_iv: "d915b9ed6994281d0ab0fda7ef47b091"
server_key_version: "encryptionkey@0"
I20260806 01:04:04.796149 22439 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:04:04.834451 22439 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:04:04.836725 22439 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:04:04.836898 22439 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:04:04.837154 22439 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:04:04.837492 22439 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:04:04.837548 22439 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:04.837592 22439 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:04:04.837625 22439 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:04.844200 22439 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:36133
I20260806 01:04:04.844266 22571 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:36133 every 8 connection(s)
I20260806 01:04:04.844646 22439 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
I20260806 01:04:04.849103 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 22439
I20260806 01:04:04.849237 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance
I20260806 01:04:04.849421 11617 external_mini_cluster.cc:1428] Setting key e3987c4276f7f2a8cd2d120ec32eb62b
Aug 06 01:04:04 dist-test-slave-69rg krb5kdc[22052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978244, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:04:04.854233 22138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:04.845511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:45715 (local address 127.11.88.126:46241)
0806 01:04:04.845568 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:04.845572 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:04.845873 (+ 301us) server_negotiation.cc:407] Connection header received
0806 01:04:04.846448 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:04.846449 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:04.846460 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:04.846517 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:04:04.847454 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.847951 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.848944 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.849124 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.849176 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:04.851531 (+ 2355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:04:04.851532 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:04:04.851533 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:04:04.851540 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:04:04.852871 (+ 1331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:04:04.853286 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:04:04.853287 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:04:04.853287 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:04:04.853342 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:04:04.853562 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:04:04.853562 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:04:04.853563 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:04:04.853674 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:04:04.853725 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:04.854043 (+ 318us) server_negotiation.cc:299] Negotiation successful
0806 01:04:04.854140 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260806 01:04:04.854393 22575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:04.845510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:46241 (local address 127.11.88.67:45715)
0806 01:04:04.845720 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:04.845760 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 01:04:04.846345 (+ 585us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:04:04.846572 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:04:04.846576 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:04:04.847161 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:04:04.847377 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:04.847381 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.848034 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.848035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:04.848842 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:04.848844 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.849225 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.849226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:04.849384 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:04.850049 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:04:04.850058 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:04:04.851437 (+ 1379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:04:04.852953 (+ 1516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:04:04.852960 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:04:04.852961 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:04:04.853215 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:04:04.853403 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:04:04.853404 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:04:04.853404 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:04:04.853506 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:04:04.853731 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:04:04.853736 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:04:04.853921 (+ 185us) client_negotiation.cc:769] Sending connection context
0806 01:04:04.854012 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 01:04:04.854141 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":90,"threads_started":1}
I20260806 01:04:04.854930 22572 heartbeater.cc:347] Connected to a master server at 127.11.88.126:46241
I20260806 01:04:04.855047 22572 heartbeater.cc:464] Registering TS with master...
I20260806 01:04:04.855245 22572 heartbeater.cc:511] Master 127.11.88.126:46241 requested a full tablet report, sending...
I20260806 01:04:04.855641 22098 ts_manager.cc:194] Registered new tserver with Master: 8cb5b4c227b64e16ba749638bd7cc14e (127.11.88.67:36133)
I20260806 01:04:04.856041 22098 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.67@KRBTEST.COM'} at 127.11.88.67:45715
I20260806 01:04:04.861351 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 01:04:04.869349 22138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:04.862891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51536 (local address 127.11.88.126:46241)
0806 01:04:04.862939 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:04.862941 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:04.862957 (+ 16us) server_negotiation.cc:407] Connection header received
0806 01:04:04.862997 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:04.862998 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:04.863006 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:04.863063 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:04:04.863611 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.864101 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.864849 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.865044 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.865113 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:04.866437 (+ 1324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:04:04.866438 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:04:04.866438 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:04:04.866445 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:04:04.867933 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:04:04.868300 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:04:04.868301 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:04:04.868301 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:04:04.868360 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:04:04.868553 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:04:04.868554 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:04:04.868554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:04:04.868907 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:04:04.869009 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:04.869124 (+ 115us) server_negotiation.cc:299] Negotiation successful
0806 01:04:04.869200 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 01:04:04.871318 22098 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51536:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 01:04:04.872962 22098 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:04:04.880225 22590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:04.875897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59618 (local address 127.11.88.66:43537)
0806 01:04:04.876143 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:04.876149 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:04.876162 (+ 13us) server_negotiation.cc:407] Connection header received
0806 01:04:04.876209 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:04.876211 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:04.876230 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:04.876315 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:04:04.876489 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.877795 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.879151 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.879753 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.879830 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:04.879893 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:04.880086 (+ 193us) server_negotiation.cc:299] Negotiation successful
0806 01:04:04.880134 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":110,"threads_started":1}
I20260806 01:04:04.880218 22586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:04.875606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:43537 (local address 127.0.0.1:59618)
0806 01:04:04.875825 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:04.875869 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 01:04:04.875950 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:04:04.876335 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:04:04.876338 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:04:04.876341 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:04:04.876421 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:04.876424 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.877923 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.877924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:04.879047 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:04.879050 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.879845 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.879846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:04.879939 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:04.879954 (+ 15us) client_negotiation.cc:769] Sending connection context
0806 01:04:04.880060 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 01:04:04.880118 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"mutex_wait_us":92,"thread_start_us":107,"threads_started":1}
I20260806 01:04:04.880853 22587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:04.875611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:36133 (local address 127.0.0.1:45304)
0806 01:04:04.876054 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:04.876063 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 01:04:04.876099 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:04:04.876629 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:04:04.876630 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:04:04.876632 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:04:04.876681 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:04.876682 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.878129 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.878130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:04.879537 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:04.879541 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.880571 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.880573 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:04.880652 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:04.880657 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 01:04:04.880712 (+ 55us) client_negotiation.cc:240] Negotiation successful
0806 01:04:04.880765 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":426,"mutex_wait_us":110,"thread_start_us":107,"threads_started":1}
I20260806 01:04:04.880877 22588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:04.875606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:42531 (local address 127.0.0.1:55980)
0806 01:04:04.875895 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:04.875907 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:04:04.875966 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:04:04.876706 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:04:04.876707 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:04:04.876709 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:04:04.876775 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:04.876777 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.877988 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.877989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:04.879542 (+ 1553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:04.879544 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.880644 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.880645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:04.880731 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:04.880735 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:04:04.880767 (+ 32us) client_negotiation.cc:240] Negotiation successful
0806 01:04:04.880801 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"mutex_wait_us":68,"thread_start_us":61,"threads_started":1}
I20260806 01:04:04.881199 22591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:04.876140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55980 (local address 127.11.88.65:42531)
0806 01:04:04.876505 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:04.876509 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:04.876519 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:04:04.876585 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:04.876587 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:04.876604 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:04.876901 (+ 297us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:04:04.876972 (+ 71us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.877852 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.879658 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.880511 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.880958 (+ 447us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:04.881039 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:04.881072 (+ 33us) server_negotiation.cc:299] Negotiation successful
0806 01:04:04.881117 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":113,"threads_started":1}
I20260806 01:04:04.881232 22589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:04.875702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45304 (local address 127.11.88.67:36133)
0806 01:04:04.876413 (+ 711us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:04.876418 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:04.876430 (+ 12us) server_negotiation.cc:407] Connection header received
0806 01:04:04.876473 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:04.876475 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:04.876492 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:04.876637 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:04:04.876747 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.877978 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.879643 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.880475 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.880546 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:04.880597 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:04.881095 (+ 498us) server_negotiation.cc:299] Negotiation successful
0806 01:04:04.881145 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":666,"thread_start_us":80,"threads_started":1}
I20260806 01:04:04.881340 22366 tablet_service.cc:1467] Processing CreateTablet for tablet 4fb160340c754056a96fe3917e62af58 (DEFAULT_TABLE table=test-table [id=a90dac13888f4e84b61b74185b93f111]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:04:04.881665 22366 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fb160340c754056a96fe3917e62af58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:04:04.881901 22505 tablet_service.cc:1467] Processing CreateTablet for tablet 4fb160340c754056a96fe3917e62af58 (DEFAULT_TABLE table=test-table [id=a90dac13888f4e84b61b74185b93f111]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:04:04.882314 22505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fb160340c754056a96fe3917e62af58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:04:04.882548 22229 tablet_service.cc:1467] Processing CreateTablet for tablet 4fb160340c754056a96fe3917e62af58 (DEFAULT_TABLE table=test-table [id=a90dac13888f4e84b61b74185b93f111]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:04:04.882869 22229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fb160340c754056a96fe3917e62af58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:04:04.885434 22593 tablet_bootstrap.cc:492] T 4fb160340c754056a96fe3917e62af58 P da16b6eaacad484da375a5edcbecce41: Bootstrap starting.
I20260806 01:04:04.885996 22592 tablet_bootstrap.cc:492] T 4fb160340c754056a96fe3917e62af58 P 8cb5b4c227b64e16ba749638bd7cc14e: Bootstrap starting.
I20260806 01:04:04.886251 22593 tablet_bootstrap.cc:654] T 4fb160340c754056a96fe3917e62af58 P da16b6eaacad484da375a5edcbecce41: Neither blocks nor log segments found. Creating new log.
I20260806 01:04:04.886250 22594 tablet_bootstrap.cc:492] T 4fb160340c754056a96fe3917e62af58 P b5abfb653ebf485ba4a59d4a40e484af: Bootstrap starting.
I20260806 01:04:04.886735 22592 tablet_bootstrap.cc:654] T 4fb160340c754056a96fe3917e62af58 P 8cb5b4c227b64e16ba749638bd7cc14e: Neither blocks nor log segments found. Creating new log.
I20260806 01:04:04.886894 22594 tablet_bootstrap.cc:654] T 4fb160340c754056a96fe3917e62af58 P b5abfb653ebf485ba4a59d4a40e484af: Neither blocks nor log segments found. Creating new log.
I20260806 01:04:04.886983 22593 log.cc:824] T 4fb160340c754056a96fe3917e62af58 P da16b6eaacad484da375a5edcbecce41: Log is configured to *not* fsync() on all Append() calls
I20260806 01:04:04.887447 22592 log.cc:824] T 4fb160340c754056a96fe3917e62af58 P 8cb5b4c227b64e16ba749638bd7cc14e: Log is configured to *not* fsync() on all Append() calls
I20260806 01:04:04.887532 22594 log.cc:824] T 4fb160340c754056a96fe3917e62af58 P b5abfb653ebf485ba4a59d4a40e484af: Log is configured to *not* fsync() on all Append() calls
I20260806 01:04:04.887907 22593 tablet_bootstrap.cc:492] T 4fb160340c754056a96fe3917e62af58 P da16b6eaacad484da375a5edcbecce41: No bootstrap required, opened a new log
I20260806 01:04:04.887990 22593 ts_tablet_manager.cc:1397] T 4fb160340c754056a96fe3917e62af58 P da16b6eaacad484da375a5edcbecce41: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 01:04:04.888410 22594 tablet_bootstrap.cc:492] T 4fb160340c754056a96fe3917e62af58 P b5abfb653ebf485ba4a59d4a40e484af: No bootstrap required, opened a new log
I20260806 01:04:04.888450 22592 tablet_bootstrap.cc:492] T 4fb160340c754056a96fe3917e62af58 P 8cb5b4c227b64e16ba749638bd7cc14e: No bootstrap required, opened a new log
I20260806 01:04:04.888475 22594 ts_tablet_manager.cc:1397] T 4fb160340c754056a96fe3917e62af58 P b5abfb653ebf485ba4a59d4a40e484af: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 01:04:04.888518 22592 ts_tablet_manager.cc:1397] T 4fb160340c754056a96fe3917e62af58 P 8cb5b4c227b64e16ba749638bd7cc14e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 01:04:04.890012 22592 raft_consensus.cc:348] T 4fb160340c754056a96fe3917e62af58 P 8cb5b4c227b64e16ba749638bd7cc14e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cb5b4c227b64e16ba749638bd7cc14e" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 36133 } } peers { permanent_uuid: "b5abfb653ebf485ba4a59d4a40e484af" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 42531 } } peers { permanent_uuid: "da16b6eaacad484da375a5edcbecce41" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 43537 } }
I20260806 01:04:04.890192 22592 raft_consensus.cc:374] T 4fb160340c754056a96fe3917e62af58 P 8cb5b4c227b64e16ba749638bd7cc14e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:04:04.890264 22592 raft_consensus.cc:729] T 4fb160340c754056a96fe3917e62af58 P 8cb5b4c227b64e16ba749638bd7cc14e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cb5b4c227b64e16ba749638bd7cc14e, State: Initialized, Role: FOLLOWER
I20260806 01:04:04.890149 22593 raft_consensus.cc:348] T 4fb160340c754056a96fe3917e62af58 P da16b6eaacad484da375a5edcbecce41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cb5b4c227b64e16ba749638bd7cc14e" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 36133 } } peers { permanent_uuid: "b5abfb653ebf485ba4a59d4a40e484af" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 42531 } } peers { permanent_uuid: "da16b6eaacad484da375a5edcbecce41" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 43537 } }
I20260806 01:04:04.890323 22593 raft_consensus.cc:374] T 4fb160340c754056a96fe3917e62af58 P da16b6eaacad484da375a5edcbecce41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:04:04.890408 22593 raft_consensus.cc:729] T 4fb160340c754056a96fe3917e62af58 P da16b6eaacad484da375a5edcbecce41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da16b6eaacad484da375a5edcbecce41, State: Initialized, Role: FOLLOWER
I20260806 01:04:04.890419 22592 consensus_queue.cc:260] T 4fb160340c754056a96fe3917e62af58 P 8cb5b4c227b64e16ba749638bd7cc14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cb5b4c227b64e16ba749638bd7cc14e" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 36133 } } peers { permanent_uuid: "b5abfb653ebf485ba4a59d4a40e484af" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 42531 } } peers { permanent_uuid: "da16b6eaacad484da375a5edcbecce41" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 43537 } }
I20260806 01:04:04.890584 22593 consensus_queue.cc:260] T 4fb160340c754056a96fe3917e62af58 P da16b6eaacad484da375a5edcbecce41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cb5b4c227b64e16ba749638bd7cc14e" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 36133 } } peers { permanent_uuid: "b5abfb653ebf485ba4a59d4a40e484af" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 42531 } } peers { permanent_uuid: "da16b6eaacad484da375a5edcbecce41" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 43537 } }
I20260806 01:04:04.890551 22594 raft_consensus.cc:348] T 4fb160340c754056a96fe3917e62af58 P b5abfb653ebf485ba4a59d4a40e484af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cb5b4c227b64e16ba749638bd7cc14e" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 36133 } } peers { permanent_uuid: "b5abfb653ebf485ba4a59d4a40e484af" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 42531 } } peers { permanent_uuid: "da16b6eaacad484da375a5edcbecce41" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 43537 } }
I20260806 01:04:04.890691 22594 raft_consensus.cc:374] T 4fb160340c754056a96fe3917e62af58 P b5abfb653ebf485ba4a59d4a40e484af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:04:04.890731 22592 ts_tablet_manager.cc:1428] T 4fb160340c754056a96fe3917e62af58 P 8cb5b4c227b64e16ba749638bd7cc14e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 01:04:04.890746 22594 raft_consensus.cc:729] T 4fb160340c754056a96fe3917e62af58 P b5abfb653ebf485ba4a59d4a40e484af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5abfb653ebf485ba4a59d4a40e484af, State: Initialized, Role: FOLLOWER
I20260806 01:04:04.890847 22594 consensus_queue.cc:260] T 4fb160340c754056a96fe3917e62af58 P b5abfb653ebf485ba4a59d4a40e484af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cb5b4c227b64e16ba749638bd7cc14e" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 36133 } } peers { permanent_uuid: "b5abfb653ebf485ba4a59d4a40e484af" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 42531 } } peers { permanent_uuid: "da16b6eaacad484da375a5edcbecce41" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 43537 } }
I20260806 01:04:04.891078 22593 ts_tablet_manager.cc:1428] T 4fb160340c754056a96fe3917e62af58 P da16b6eaacad484da375a5edcbecce41: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 01:04:04.891132 22594 ts_tablet_manager.cc:1428] T 4fb160340c754056a96fe3917e62af58 P b5abfb653ebf485ba4a59d4a40e484af: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 01:04:04.891175 22296 heartbeater.cc:503] Master 127.11.88.126:46241 was elected leader, sending a full tablet report...
I20260806 01:04:04.891247 22572 heartbeater.cc:503] Master 127.11.88.126:46241 was elected leader, sending a full tablet report...
I20260806 01:04:04.891467 22433 heartbeater.cc:503] Master 127.11.88.126:46241 was elected leader, sending a full tablet report...
W20260806 01:04:04.909993 22435 tablet.cc:2369] T 4fb160340c754056a96fe3917e62af58 P da16b6eaacad484da375a5edcbecce41: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 01:04:04.941305 22600 raft_consensus.cc:482] T 4fb160340c754056a96fe3917e62af58 P b5abfb653ebf485ba4a59d4a40e484af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:04:04.941444 22600 raft_consensus.cc:504] T 4fb160340c754056a96fe3917e62af58 P b5abfb653ebf485ba4a59d4a40e484af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cb5b4c227b64e16ba749638bd7cc14e" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 36133 } } peers { permanent_uuid: "b5abfb653ebf485ba4a59d4a40e484af" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 42531 } } peers { permanent_uuid: "da16b6eaacad484da375a5edcbecce41" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 43537 } }
I20260806 01:04:04.941880 22600 leader_election.cc:288] T 4fb160340c754056a96fe3917e62af58 P b5abfb653ebf485ba4a59d4a40e484af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cb5b4c227b64e16ba749638bd7cc14e (127.11.88.67:36133), da16b6eaacad484da375a5edcbecce41 (127.11.88.66:43537)
I20260806 01:04:04.944818 22590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:04.942159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:35385 (local address 127.11.88.66:43537)
0806 01:04:04.942207 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:04.942209 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:04.942218 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:04:04.942249 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:04.942250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:04.942260 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:04.942320 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:04:04.942513 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.943083 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.944045 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.944438 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.944531 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:04.944540 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:04.944699 (+ 159us) server_negotiation.cc:299] Negotiation successful
0806 01:04:04.944744 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 01:04:04.944818 22298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:04.942056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:43537 (local address 127.11.88.65:35385)
0806 01:04:04.942119 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:04.942132 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:04:04.942177 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:04:04.942346 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:04:04.942347 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:04:04.942349 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:04:04.942433 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:04.942435 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.943176 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.943177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:04.943944 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:04.943946 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.944533 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.944534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:04.944620 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:04.944623 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:04:04.944692 (+ 69us) client_negotiation.cc:240] Negotiation successful
0806 01:04:04.944737 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260806 01:04:04.944962 22601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:04.942056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:36133 (local address 127.11.88.65:42185)
0806 01:04:04.942299 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:04.942316 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 01:04:04.942404 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:04:04.942589 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:04:04.942589 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:04:04.942591 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:04:04.942648 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:04.942649 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.943344 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.943345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:04.944108 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:04.944110 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.944688 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.944689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:04.944763 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:04.944771 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 01:04:04.944837 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 01:04:04.944876 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"mutex_wait_us":16,"thread_start_us":168,"threads_started":1}
I20260806 01:04:04.944949 22589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:04.942158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:42185 (local address 127.11.88.67:36133)
0806 01:04:04.942208 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:04.942210 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:04.942474 (+ 264us) server_negotiation.cc:407] Connection header received
0806 01:04:04.942505 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:04.942506 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:04.942516 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:04.942569 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:04:04.942758 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.943218 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.944208 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.944595 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.944683 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:04.944691 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:04.944843 (+ 152us) server_negotiation.cc:299] Negotiation successful
0806 01:04:04.944879 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 01:04:04.945250 22386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fb160340c754056a96fe3917e62af58" candidate_uuid: "b5abfb653ebf485ba4a59d4a40e484af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da16b6eaacad484da375a5edcbecce41" is_pre_election: true
I20260806 01:04:04.945303 22525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fb160340c754056a96fe3917e62af58" candidate_uuid: "b5abfb653ebf485ba4a59d4a40e484af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cb5b4c227b64e16ba749638bd7cc14e" is_pre_election: true
I20260806 01:04:04.945434 22386 raft_consensus.cc:2454] T 4fb160340c754056a96fe3917e62af58 P da16b6eaacad484da375a5edcbecce41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5abfb653ebf485ba4a59d4a40e484af in term 0.
I20260806 01:04:04.945494 22525 raft_consensus.cc:2454] T 4fb160340c754056a96fe3917e62af58 P 8cb5b4c227b64e16ba749638bd7cc14e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5abfb653ebf485ba4a59d4a40e484af in term 0.
I20260806 01:04:04.945667 22181 leader_election.cc:302] T 4fb160340c754056a96fe3917e62af58 P b5abfb653ebf485ba4a59d4a40e484af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5abfb653ebf485ba4a59d4a40e484af, da16b6eaacad484da375a5edcbecce41; no voters:
I20260806 01:04:04.945827 22600 raft_consensus.cc:2781] T 4fb160340c754056a96fe3917e62af58 P b5abfb653ebf485ba4a59d4a40e484af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:04:04.945890 22600 raft_consensus.cc:482] T 4fb160340c754056a96fe3917e62af58 P b5abfb653ebf485ba4a59d4a40e484af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:04:04.945912 22600 raft_consensus.cc:3037] T 4fb160340c754056a96fe3917e62af58 P b5abfb653ebf485ba4a59d4a40e484af [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:04:04.946611 22600 raft_consensus.cc:504] T 4fb160340c754056a96fe3917e62af58 P b5abfb653ebf485ba4a59d4a40e484af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cb5b4c227b64e16ba749638bd7cc14e" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 36133 } } peers { permanent_uuid: "b5abfb653ebf485ba4a59d4a40e484af" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 42531 } } peers { permanent_uuid: "da16b6eaacad484da375a5edcbecce41" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 43537 } }
I20260806 01:04:04.946766 22600 leader_election.cc:288] T 4fb160340c754056a96fe3917e62af58 P b5abfb653ebf485ba4a59d4a40e484af [CANDIDATE]: Term 1 election: Requested vote from peers 8cb5b4c227b64e16ba749638bd7cc14e (127.11.88.67:36133), da16b6eaacad484da375a5edcbecce41 (127.11.88.66:43537)
I20260806 01:04:04.946933 22525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fb160340c754056a96fe3917e62af58" candidate_uuid: "b5abfb653ebf485ba4a59d4a40e484af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cb5b4c227b64e16ba749638bd7cc14e"
I20260806 01:04:04.946954 22386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fb160340c754056a96fe3917e62af58" candidate_uuid: "b5abfb653ebf485ba4a59d4a40e484af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da16b6eaacad484da375a5edcbecce41"
I20260806 01:04:04.947029 22525 raft_consensus.cc:3037] T 4fb160340c754056a96fe3917e62af58 P 8cb5b4c227b64e16ba749638bd7cc14e [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:04:04.947026 22386 raft_consensus.cc:3037] T 4fb160340c754056a96fe3917e62af58 P da16b6eaacad484da375a5edcbecce41 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:04:04.947726 22525 raft_consensus.cc:2454] T 4fb160340c754056a96fe3917e62af58 P 8cb5b4c227b64e16ba749638bd7cc14e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5abfb653ebf485ba4a59d4a40e484af in term 1.
I20260806 01:04:04.947870 22386 raft_consensus.cc:2454] T 4fb160340c754056a96fe3917e62af58 P da16b6eaacad484da375a5edcbecce41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5abfb653ebf485ba4a59d4a40e484af in term 1.
I20260806 01:04:04.947976 22180 leader_election.cc:302] T 4fb160340c754056a96fe3917e62af58 P b5abfb653ebf485ba4a59d4a40e484af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8cb5b4c227b64e16ba749638bd7cc14e, b5abfb653ebf485ba4a59d4a40e484af; no voters:
I20260806 01:04:04.948097 22600 raft_consensus.cc:2781] T 4fb160340c754056a96fe3917e62af58 P b5abfb653ebf485ba4a59d4a40e484af [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:04:04.948297 22600 raft_consensus.cc:686] T 4fb160340c754056a96fe3917e62af58 P b5abfb653ebf485ba4a59d4a40e484af [term 1 LEADER]: Becoming Leader. State: Replica: b5abfb653ebf485ba4a59d4a40e484af, State: Running, Role: LEADER
I20260806 01:04:04.948386 22600 consensus_queue.cc:237] T 4fb160340c754056a96fe3917e62af58 P b5abfb653ebf485ba4a59d4a40e484af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cb5b4c227b64e16ba749638bd7cc14e" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 36133 } } peers { permanent_uuid: "b5abfb653ebf485ba4a59d4a40e484af" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 42531 } } peers { permanent_uuid: "da16b6eaacad484da375a5edcbecce41" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 43537 } }
I20260806 01:04:04.949225 22096 catalog_manager.cc:5495] T 4fb160340c754056a96fe3917e62af58 P b5abfb653ebf485ba4a59d4a40e484af reported cstate change: term changed from 0 to 1, leader changed from <none> to b5abfb653ebf485ba4a59d4a40e484af (127.11.88.65). New cstate: current_term: 1 leader_uuid: "b5abfb653ebf485ba4a59d4a40e484af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cb5b4c227b64e16ba749638bd7cc14e" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5abfb653ebf485ba4a59d4a40e484af" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 42531 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da16b6eaacad484da375a5edcbecce41" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 43537 } health_report { overall_health: UNKNOWN } } }
I20260806 01:04:04.954550 22591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:04.952288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55982 (local address 127.11.88.65:42531)
0806 01:04:04.952349 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:04.952351 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:04.952359 (+ 8us) server_negotiation.cc:407] Connection header received
0806 01:04:04.952386 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:04.952387 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:04.952402 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:04.952460 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:04:04.952605 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.953070 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.953806 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:04.954067 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:04.954127 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:04.954269 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:04:04.954363 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:04:04.954425 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:04.954458 (+ 33us) server_negotiation.cc:299] Negotiation successful
0806 01:04:04.954476 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 01:04:04.956377 22386 raft_consensus.cc:1261] T 4fb160340c754056a96fe3917e62af58 P da16b6eaacad484da375a5edcbecce41 [term 1 FOLLOWER]: Refusing update from remote peer b5abfb653ebf485ba4a59d4a40e484af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:04:04.956393 22525 raft_consensus.cc:1261] T 4fb160340c754056a96fe3917e62af58 P 8cb5b4c227b64e16ba749638bd7cc14e [term 1 FOLLOWER]: Refusing update from remote peer b5abfb653ebf485ba4a59d4a40e484af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:04:04.956772 22602 consensus_queue.cc:1035] T 4fb160340c754056a96fe3917e62af58 P b5abfb653ebf485ba4a59d4a40e484af [LEADER]: Connected to new peer: Peer: permanent_uuid: "da16b6eaacad484da375a5edcbecce41" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 43537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:04:04.956909 22600 consensus_queue.cc:1035] T 4fb160340c754056a96fe3917e62af58 P b5abfb653ebf485ba4a59d4a40e484af [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cb5b4c227b64e16ba749638bd7cc14e" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:04:04.960219 22607 mvcc.cc:205] Tried to move back new op lower bound from 7315366891338645504 to 7315366891309121536. Current Snapshot: MvccSnapshot[applied={T|T < 7315366891338645504}]
I20260806 01:04:04.960901 22606 mvcc.cc:205] Tried to move back new op lower bound from 7315366891338645504 to 7315366891309121536. Current Snapshot: MvccSnapshot[applied={T|T < 7315366891338645504 or (T in {7315366891338645504})}]
I20260806 01:04:04.962070 22096 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51536:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:04:04.962167 22096 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51536:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:04:04.962991 22096 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 84649050bf8a4bc592ab70037c147c27: Sending DeleteTablet for 3 replicas of tablet 4fb160340c754056a96fe3917e62af58
I20260806 01:04:04.963383 22366 tablet_service.cc:1514] Processing DeleteTablet for tablet 4fb160340c754056a96fe3917e62af58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:04:04 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:59618
I20260806 01:04:04.963456 22505 tablet_service.cc:1514] Processing DeleteTablet for tablet 4fb160340c754056a96fe3917e62af58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:04:04 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:45304
I20260806 01:04:04.963665 22614 tablet_replica.cc:330] T 4fb160340c754056a96fe3917e62af58 P da16b6eaacad484da375a5edcbecce41: stopping tablet replica
I20260806 01:04:04.963680 22229 tablet_service.cc:1514] Processing DeleteTablet for tablet 4fb160340c754056a96fe3917e62af58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:04:04 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:55980
I20260806 01:04:04.963863 22616 tablet_replica.cc:330] T 4fb160340c754056a96fe3917e62af58 P 8cb5b4c227b64e16ba749638bd7cc14e: stopping tablet replica
I20260806 01:04:04.963924 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 22163
I20260806 01:04:04.963995 22616 raft_consensus.cc:2229] T 4fb160340c754056a96fe3917e62af58 P 8cb5b4c227b64e16ba749638bd7cc14e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:04:04.964882 22616 raft_consensus.cc:2258] T 4fb160340c754056a96fe3917e62af58 P 8cb5b4c227b64e16ba749638bd7cc14e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:04:04.965546 22616 ts_tablet_manager.cc:1905] T 4fb160340c754056a96fe3917e62af58 P 8cb5b4c227b64e16ba749638bd7cc14e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:04:04.966631 22614 raft_consensus.cc:2229] T 4fb160340c754056a96fe3917e62af58 P da16b6eaacad484da375a5edcbecce41 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:04:04.966791 22614 raft_consensus.cc:2258] T 4fb160340c754056a96fe3917e62af58 P da16b6eaacad484da375a5edcbecce41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:04:04.967286 22614 ts_tablet_manager.cc:1905] T 4fb160340c754056a96fe3917e62af58 P da16b6eaacad484da375a5edcbecce41: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:04:04.967348 22616 ts_tablet_manager.cc:1918] T 4fb160340c754056a96fe3917e62af58 P 8cb5b4c227b64e16ba749638bd7cc14e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:04:04.967444 22616 log.cc:1196] T 4fb160340c754056a96fe3917e62af58 P 8cb5b4c227b64e16ba749638bd7cc14e: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-2/wal/wals/4fb160340c754056a96fe3917e62af58
I20260806 01:04:04.967752 22616 ts_tablet_manager.cc:1939] T 4fb160340c754056a96fe3917e62af58 P 8cb5b4c227b64e16ba749638bd7cc14e: Deleting consensus metadata
I20260806 01:04:04.968176 22083 catalog_manager.cc:4841] TS 8cb5b4c227b64e16ba749638bd7cc14e (127.11.88.67:36133): tablet 4fb160340c754056a96fe3917e62af58 (table test-table [id=a90dac13888f4e84b61b74185b93f111]) successfully deleted
I20260806 01:04:04.969272 22614 ts_tablet_manager.cc:1918] T 4fb160340c754056a96fe3917e62af58 P da16b6eaacad484da375a5edcbecce41: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:04:04.969355 22614 log.cc:1196] T 4fb160340c754056a96fe3917e62af58 P da16b6eaacad484da375a5edcbecce41: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785978186227899-11617-0/minicluster-data/ts-1/wal/wals/4fb160340c754056a96fe3917e62af58
I20260806 01:04:04.969630 22614 ts_tablet_manager.cc:1939] T 4fb160340c754056a96fe3917e62af58 P da16b6eaacad484da375a5edcbecce41: Deleting consensus metadata
I20260806 01:04:04.970101 22084 catalog_manager.cc:4841] TS da16b6eaacad484da375a5edcbecce41 (127.11.88.66:43537): tablet 4fb160340c754056a96fe3917e62af58 (table test-table [id=a90dac13888f4e84b61b74185b93f111]) successfully deleted
W20260806 01:04:04.971772 22085 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.88.65:42531 (error 108)
I20260806 01:04:04.972417 22587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:04.972241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:42531 (local address 127.0.0.1:55992)
0806 01:04:04.972306 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:04.972372 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.65:42531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260806 01:04:04.972429 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 22301
W20260806 01:04:04.973502 22085 catalog_manager.cc:4584] TS b5abfb653ebf485ba4a59d4a40e484af (127.11.88.65:42531): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4fb160340c754056a96fe3917e62af58: Network error: Client connection negotiation failed: client connection to 127.11.88.65:42531: connect: Connection refused (error 111)
I20260806 01:04:04.979409 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 22439
I20260806 01:04:04.985575 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 22066
2026-08-06T01:04:04Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2035 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:04:05 dist-test-slave-69rg krb5kdc[22621](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:04:05 dist-test-slave-69rg krb5kdc[22621](info): set up 2 sockets
Aug 06 01:04:05 dist-test-slave-69rg krb5kdc[22621](info): commencing operation
krb5kdc: starting...
W20260806 01:04:06.081280 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.071s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:04:06 dist-test-slave-69rg krb5kdc[22621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978246, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:04:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:04:06Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.88.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.88.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.88.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/rangeradmin_127.11.88.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.88.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/rangeradmin_127.11.88.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.88.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.88.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.88.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/rangerlookup_127.11.88.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.88.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/rangerlookup_127.11.88.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.88.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.88.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.88.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/HTTP_127.11.88.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.88.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/HTTP_127.11.88.84@KRBTEST.COM.keytab.
I20260806 01:04:06.277902 11617 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task7A9gSt/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/postgres -l logfile start
2026-08-06 01:04:09.344 UTC [22651] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 01:04:09.344 UTC [22651] LOG: listening on IPv4 address "127.11.88.84", port 45365
2026-08-06 01:04:09.349 UTC [22651] LOG: listening on Unix socket "/tmp/.s.PGSQL.45365"
2026-08-06 01:04:09.374 UTC [22654] LOG: database system was shut down at 2026-08-06 01:04:07 UTC
2026-08-06 01:04:09.378 UTC [22651] LOG: database system is ready to accept connections
I20260806 01:04:10.344436 11617 mini_postgres.cc:96] Postgres bound to 45365
2026-08-06 01:04:10.353 UTC [22662] FATAL: database "slave" does not exist
127.11.88.84:45365 - accepting connections
I20260806 01:04:10.354171 11617 mini_ranger.cc:161] Starting Ranger...
I20260806 01:04:10.372355 11617 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 01:04:10.959437 11617 mini_ranger.cc:87] Created ranger Postgres database
I20260806 01:04:10.959563 11617 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ranger-admin
2026-08-06 01:04:11,288 [I] DB FLAVOR :POSTGRES
2026-08-06 01:04:11,288 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 01:04:11,288 [I] Checking connection..
2026-08-06 01:04:11,288 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:45365/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 01:04:11,587 [I] Checking connection passed.
2026-08-06 01:04:11,587 [I] --------- Verifying version history table ---------
2026-08-06 01:04:11,588 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:45365/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 01:04:11,865 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 01:04:11,865 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:45365/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 01:04:12,127 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 01:04:12,127 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 01:04:12,127 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:45365/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 01:04:12.402 UTC [22729] WARNING: there is no transaction in progress
2026-08-06 01:04:12,409 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 01:04:12,409 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:45365/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 01:04:12,679 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 01:04:12,679 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 01:04:12,680 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:45365/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 01:04:12,941 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:45365/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 01:04:13,209 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:45365/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-69rg.c.gcp-upstream.internal','N') ;"
2026-08-06 01:04:13,471 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:45365/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 01:04:13,726 [I] Table x_portal_user does not exist in database ranger
2026-08-06 01:04:13,727 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:45365/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 01:04:13,990 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 01:04:13,990 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:45365/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 01:04:14,249 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:45365/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 01:04:14,497 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 01:04:14,497 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:45365/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 01:04:15.621 UTC [22839] WARNING: there is no transaction in progress
2026-08-06 01:04:15.640 UTC [22839] WARNING: there is no transaction in progress
2026-08-06 01:04:15.661 UTC [22839] WARNING: there is no transaction in progress
2026-08-06 01:04:15.681 UTC [22839] WARNING: there is no transaction in progress
2026-08-06 01:04:15.702 UTC [22839] WARNING: there is no transaction in progress
2026-08-06 01:04:15.721 UTC [22839] WARNING: there is no transaction in progress
2026-08-06 01:04:15.794 UTC [22839] WARNING: there is no transaction in progress
2026-08-06 01:04:15.803 UTC [22839] WARNING: there is no transaction in progress
2026-08-06 01:04:15.824 UTC [22839] WARNING: there is no transaction in progress
2026-08-06 01:04:15.844 UTC [22839] WARNING: there is no transaction in progress
2026-08-06 01:04:15.861 UTC [22839] WARNING: there is no transaction in progress
2026-08-06 01:04:15.889 UTC [22839] WARNING: there is no transaction in progress
2026-08-06 01:04:15.907 UTC [22839] WARNING: there is no transaction in progress
2026-08-06 01:04:15.918 UTC [22839] WARNING: there is no transaction in progress
2026-08-06 01:04:15.935 UTC [22839] WARNING: there is no transaction in progress
2026-08-06 01:04:15.947 UTC [22839] WARNING: there is no transaction in progress
2026-08-06 01:04:16,840 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 01:04:16,840 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:45365/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 01:04:17,092 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 01:04:17,092 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:45365/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 01:04:17,383 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 01:04:17,383 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:45365/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 01:04:17,626 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 01:04:17,627 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:45365/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 01:04:17,906 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:45365/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 01:04:18,186 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:45365/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-69rg.c.gcp-upstream.internal';"
2026-08-06 01:04:18,447 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 01:04:18,447 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:45365/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 01:04:18,712 [I] DB_PATCHES have already been applied
I20260806 01:04:18.718909 11617 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ranger-admin:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task7A9gSt/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 01:04:18.718986 11617 mini_ranger.cc:193] Using host: 127.11.88.84
I20260806 01:04:18.722819 11617 mini_ranger.cc:227] Ranger admin URL: http://127.11.88.84:41887
Aug 06, 2026 1:04:19 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 1:04:19 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 1:04:19 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 1:04:19 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 1:04:19 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 1:04:19 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 1:04:19 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 01:04:19.888414 11617 mini_ranger.cc:160] Time spent starting Ranger: real 9.534s user 0.004s sys 0.008s
Aug 06, 2026 1:04:41 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 1:04:41 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 06, 2026 1:04:41 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 1:04:41 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 1:04:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 1:04:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 1:04:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 1:04:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 1:04:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 1:04:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 1:04:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 1:04:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 1:04:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 1:04:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 1:04:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 1:04:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 1:04:41 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 1:04:42 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 01:04:43.022820 11617 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.88.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.88.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.88.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/rangerkms_127.11.88.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.88.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/rangerkms_127.11.88.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.88.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.88.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.88.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/HTTP_127.11.88.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.88.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/HTTP_127.11.88.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 01:04:43 dist-test-slave-69rg krb5kdc[22621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978283, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 01:04:43.132465 11617 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 01:04:43.144691 11617 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 01:04:44.147892 11617 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 01:04:44.147990 11617 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ranger-kms
I20260806 01:04:44.148007 11617 mini_ranger_kms.cc:227] Using postgres at 127.11.88.84:45365
2026-08-06 01:04:44,930 [I] DB FLAVOR :POSTGRES
2026-08-06 01:04:44,930 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 01:04:44,930 [I] Checking connection
2026-08-06 01:04:44,930 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:45365/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 01:04:45,217 [I] connection success
2026-08-06 01:04:45,217 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 01:04:45,217 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 01:04:45,218 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:45365/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 01:04:45,523 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 01:04:45,523 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 01:04:45,524 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 01:04:45,524 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:45365/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 01:04:45,808 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 01:04:46.345772 11617 mini_ranger_kms.cc:310] Created kms service
I20260806 01:04:46.558808 11617 mini_ranger_kms.cc:326] Created kudu user
I20260806 01:04:46.604511 11617 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 01:04:46 dist-test-slave-69rg krb5kdc[22621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978283, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.88.84@KRBTEST.COM
I20260806 01:04:47.046979 11617 mini_ranger_kms.cc:384] Added ranger policy
I20260806 01:04:47.047108 11617 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ranger-kms:/tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 01:04:47.047132 11617 mini_ranger_kms.cc:240] Using host: 127.11.88.84
I20260806 01:04:47.051637 11617 mini_ranger_kms.cc:276] Ranger KMS PID: 23025
I20260806 01:04:47.051791 11617 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.88.84:41361
Aug 06, 2026 1:04:48 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 1:04:48 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 1:04:48 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 1:04:48 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 1:04:48 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 1:04:48 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260806 01:04:49.318478 11617 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.186s user 0.000s sys 0.398s
I20260806 01:04:49.318602 11617 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 01:04:49.318754 11617 mini_ranger_kms.cc:401] 127.11.88.84:41361/kms/v1/keys
Aug 06 01:04:49 dist-test-slave-69rg krb5kdc[22621](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785978289, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.88.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 06 01:04:49 dist-test-slave-69rg krb5kdc[22621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978289, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.88.84@KRBTEST.COM for HTTP/127.11.88.84@KRBTEST.COM
Aug 06 01:04:50 dist-test-slave-69rg krb5kdc[22621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978289, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.88.84@KRBTEST.COM for HTTP/127.11.88.84@KRBTEST.COM
Aug 06 01:04:52 dist-test-slave-69rg krb5kdc[22621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:04:52.661583 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:44067
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:34179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:44067
--ranger_config_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.88.84:41361/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:04:52.745231 23079 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:04:52.745497 23079 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:04:52.745537 23079 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:04:52.746716 23079 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:04:52.746790 23079 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:04:52.746814 23079 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:04:52.746850 23079 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:04:52.746869 23079 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:04:52.748557 23079 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:34179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.88.84:41361/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:44067
--ranger_config_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:44067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23079
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:04:52.748826 23079 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:04:52.749078 23079 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 01:04:52.754372 23079 server_base.cc:1034] running on GCE node
W20260806 01:04:52.754454 23088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:04:52.754527 23085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:04:52.754747 23084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:04:52.755017 23079 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:04:52.755334 23079 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:04:52.756524 23079 hybrid_clock.cc:648] HybridClock initialized: now 1785978292756496 us; error 42 us; skew 500 ppm
Aug 06 01:04:52 dist-test-slave-69rg krb5kdc[22621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978292, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:04:52.759352 23079 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:04:52.759810 23079 webserver.cc:460] Webserver started at http://127.11.88.126:45773/ using document root <none> and password file <none>
I20260806 01:04:52.760061 23079 fs_manager.cc:359] Metadata directory not provided
I20260806 01:04:52.760123 23079 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:04:52.760291 23079 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 01:04:52 dist-test-slave-69rg krb5kdc[22621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978292, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for HTTP/127.11.88.84@KRBTEST.COM
I20260806 01:04:52.809607 23079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "6261042ee9804623bcea58944d17063a"
format_stamp: "Formatted at 2026-08-06 01:04:52 on dist-test-slave-69rg"
server_key: "61ca88d45070cf38306afa282d1a720b"
server_key_iv: "390b122fe33f54cc9b5b003faf302376"
server_key_version: "kuduclusterkey@0"
I20260806 01:04:52.810200 23079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "6261042ee9804623bcea58944d17063a"
format_stamp: "Formatted at 2026-08-06 01:04:52 on dist-test-slave-69rg"
server_key: "61ca88d45070cf38306afa282d1a720b"
server_key_iv: "390b122fe33f54cc9b5b003faf302376"
server_key_version: "kuduclusterkey@0"
I20260806 01:04:52.811797 23079 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 01:04:52.825043 23095 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:52.825280 23079 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 01:04:52.825397 23079 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "6261042ee9804623bcea58944d17063a"
format_stamp: "Formatted at 2026-08-06 01:04:52 on dist-test-slave-69rg"
server_key: "61ca88d45070cf38306afa282d1a720b"
server_key_iv: "390b122fe33f54cc9b5b003faf302376"
server_key_version: "kuduclusterkey@0"
I20260806 01:04:52.825520 23079 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:04:52.860224 23079 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:04:52.862330 23079 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:04:52.862521 23079 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:04:52.867703 23079 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:44067
I20260806 01:04:52.867727 23155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:44067 every 8 connection(s)
I20260806 01:04:52.868170 23079 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:04:52.868746 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 23079
I20260806 01:04:52.868863 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:04:52.868991 23156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:04:52.869100 11617 external_mini_cluster.cc:1428] Setting key 4be0a2fe7a5ae5121a40d00207305821
I20260806 01:04:52.872833 23156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6261042ee9804623bcea58944d17063a: Bootstrap starting.
I20260806 01:04:52.873638 23156 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6261042ee9804623bcea58944d17063a: Neither blocks nor log segments found. Creating new log.
I20260806 01:04:52.874022 23156 log.cc:824] T 00000000000000000000000000000000 P 6261042ee9804623bcea58944d17063a: Log is configured to *not* fsync() on all Append() calls
I20260806 01:04:52.874817 23156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6261042ee9804623bcea58944d17063a: No bootstrap required, opened a new log
Aug 06 01:04:52 dist-test-slave-69rg krb5kdc[22621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:04:52.877812 23156 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6261042ee9804623bcea58944d17063a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6261042ee9804623bcea58944d17063a" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44067 } }
I20260806 01:04:52.878095 23156 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6261042ee9804623bcea58944d17063a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:04:52.878185 23156 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6261042ee9804623bcea58944d17063a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6261042ee9804623bcea58944d17063a, State: Initialized, Role: FOLLOWER
I20260806 01:04:52.878360 23156 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6261042ee9804623bcea58944d17063a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6261042ee9804623bcea58944d17063a" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44067 } }
I20260806 01:04:52.878472 23156 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6261042ee9804623bcea58944d17063a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:04:52.878535 23156 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6261042ee9804623bcea58944d17063a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:04:52.878592 23156 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6261042ee9804623bcea58944d17063a [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:04:52.879892 23156 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6261042ee9804623bcea58944d17063a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6261042ee9804623bcea58944d17063a" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44067 } }
I20260806 01:04:52.880045 23156 leader_election.cc:302] T 00000000000000000000000000000000 P 6261042ee9804623bcea58944d17063a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6261042ee9804623bcea58944d17063a; no voters:
I20260806 01:04:52.880266 23156 leader_election.cc:288] T 00000000000000000000000000000000 P 6261042ee9804623bcea58944d17063a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:04:52.880537 23162 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6261042ee9804623bcea58944d17063a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:04:52.880599 23156 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6261042ee9804623bcea58944d17063a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:04:52.880797 23162 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6261042ee9804623bcea58944d17063a [term 1 LEADER]: Becoming Leader. State: Replica: 6261042ee9804623bcea58944d17063a, State: Running, Role: LEADER
I20260806 01:04:52.880963 23162 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6261042ee9804623bcea58944d17063a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6261042ee9804623bcea58944d17063a" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44067 } }
I20260806 01:04:52.881438 23162 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6261042ee9804623bcea58944d17063a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6261042ee9804623bcea58944d17063a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6261042ee9804623bcea58944d17063a" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44067 } } }
I20260806 01:04:52.881640 23162 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6261042ee9804623bcea58944d17063a [sys.catalog]: This master's current role is: LEADER
I20260806 01:04:52.881903 23162 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6261042ee9804623bcea58944d17063a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6261042ee9804623bcea58944d17063a. Latest consensus state: current_term: 1 leader_uuid: "6261042ee9804623bcea58944d17063a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6261042ee9804623bcea58944d17063a" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44067 } } }
I20260806 01:04:52.882143 23162 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6261042ee9804623bcea58944d17063a [sys.catalog]: This master's current role is: LEADER
I20260806 01:04:52.882652 23156 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 01:04:52.883183 23174 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:04:52.886951 23174 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:04:52.887296 23159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:52.869646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41076 (local address 127.11.88.126:44067)
0806 01:04:52.869888 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:52.869897 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:52.869937 (+ 40us) server_negotiation.cc:407] Connection header received
0806 01:04:52.870537 (+ 600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:52.870546 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:52.870612 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:52.870796 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:04:52.871694 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:52.873029 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:52.874185 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:52.874804 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:52.874915 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:52.878423 (+ 3508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:04:52.878428 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:04:52.878429 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:04:52.878444 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:04:52.881611 (+ 3167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:04:52.882152 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:04:52.882156 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:04:52.882157 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:04:52.882335 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:04:52.882590 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:04:52.882591 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:04:52.882591 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:04:52.883030 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:04:52.885797 (+ 2767us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:52.886154 (+ 357us) server_negotiation.cc:299] Negotiation successful
0806 01:04:52.886768 (+ 614us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":88,"threads_started":1}
I20260806 01:04:52.893373 23174 catalog_manager.cc:1347] Generated new cluster ID: dcb88fa535f449388e1c227dc0062b27
I20260806 01:04:52.893545 23174 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:04:52.900316 23174 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:04:52.901153 23174 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:04:52.912882 23174 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6261042ee9804623bcea58944d17063a: Generated new TSK 0
I20260806 01:04:52.913235 23174 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.88.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
I20260806 01:04:53.773470 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.88.84:41361/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:0
--local_ip_for_outbound_sockets=127.11.88.65
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:44067
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:34179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:04:53.861675 23204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:04:53.861991 23204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:04:53.862036 23204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:04:53.863886 23204 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:04:53.863970 23204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:04:53.864027 23204 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:04:53.866165 23204 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:34179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.88.84:41361/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:44067
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23204
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:04:53.866498 23204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:04:53.866827 23204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:04:53.873513 23213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:04:53.873546 23210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:04:53.873721 23204 server_base.cc:1034] running on GCE node
W20260806 01:04:53.873517 23209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:04:53.874127 23204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:04:53.874418 23204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:04:53.875627 23204 hybrid_clock.cc:648] HybridClock initialized: now 1785978293875600 us; error 41 us; skew 500 ppm
Aug 06 01:04:53 dist-test-slave-69rg krb5kdc[22621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978293, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:04:53.878917 23204 init.cc:377] Logged in from keytab as kudu/127.11.88.65@KRBTEST.COM (short username kudu)
I20260806 01:04:53.879457 23204 webserver.cc:460] Webserver started at http://127.11.88.65:35493/ using document root <none> and password file <none>
I20260806 01:04:53.879725 23204 fs_manager.cc:359] Metadata directory not provided
I20260806 01:04:53.879796 23204 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:04:53.879943 23204 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 01:04:53 dist-test-slave-69rg krb5kdc[22621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978293, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for HTTP/127.11.88.84@KRBTEST.COM
I20260806 01:04:53.896241 23204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-0/data/instance:
uuid: "5fb1e2c0ff7f4299a973fd412fac9aaa"
format_stamp: "Formatted at 2026-08-06 01:04:53 on dist-test-slave-69rg"
server_key: "16c1d53143f1bb1a243a681ff4f6a9aa"
server_key_iv: "26fd94460f8d8b0d375991c2d409632e"
server_key_version: "kuduclusterkey@0"
I20260806 01:04:53.896775 23204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance:
uuid: "5fb1e2c0ff7f4299a973fd412fac9aaa"
format_stamp: "Formatted at 2026-08-06 01:04:53 on dist-test-slave-69rg"
server_key: "16c1d53143f1bb1a243a681ff4f6a9aa"
server_key_iv: "26fd94460f8d8b0d375991c2d409632e"
server_key_version: "kuduclusterkey@0"
I20260806 01:04:53.899775 23204 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 01:04:53.915803 23221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:53.916069 23204 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260806 01:04:53.916175 23204 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "5fb1e2c0ff7f4299a973fd412fac9aaa"
format_stamp: "Formatted at 2026-08-06 01:04:53 on dist-test-slave-69rg"
server_key: "16c1d53143f1bb1a243a681ff4f6a9aa"
server_key_iv: "26fd94460f8d8b0d375991c2d409632e"
server_key_version: "kuduclusterkey@0"
I20260806 01:04:53.916286 23204 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:04:53.939424 23204 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:04:53.941617 23204 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:04:53.941795 23204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:04:53.942139 23204 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:04:53.942755 23204 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:04:53.942859 23204 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:53.942962 23204 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:04:53.943045 23204 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:53.949811 23204 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:40151
I20260806 01:04:53.951217 23204 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
I20260806 01:04:53.952623 23341 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:40151 every 8 connection(s)
I20260806 01:04:53.958415 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 23204
I20260806 01:04:53.958561 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance
I20260806 01:04:53.958796 11617 external_mini_cluster.cc:1428] Setting key 3cebff1b69db91300e104235dedc8380
Aug 06 01:04:53 dist-test-slave-69rg krb5kdc[22621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978293, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:04:53.967126 23345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:53.955268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:46821 (local address 127.11.88.126:44067)
0806 01:04:53.956388 (+ 1120us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:53.956390 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:53.956399 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:04:53.956427 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:53.956428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:53.956441 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:53.956518 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:04:53.957178 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:53.958004 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:53.959363 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:53.959684 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:53.959763 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:53.963240 (+ 3477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:04:53.963241 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:04:53.963242 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:04:53.963250 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:04:53.965201 (+ 1951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:04:53.965765 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:04:53.965766 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:04:53.965767 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:04:53.965868 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:04:53.966276 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:04:53.966277 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:04:53.966278 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:04:53.966435 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:04:53.966486 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:53.966921 (+ 435us) server_negotiation.cc:299] Negotiation successful
0806 01:04:53.967012 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1091,"thread_start_us":62,"threads_started":1}
I20260806 01:04:53.967916 23344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:53.955166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44067 (local address 127.11.88.65:46821)
0806 01:04:53.955431 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:53.955482 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 01:04:53.956183 (+ 701us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:04:53.956655 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:04:53.956659 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:04:53.956865 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:04:53.957062 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:53.957066 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:53.958117 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:53.958119 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:53.959278 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:53.959281 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:53.959789 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:53.959790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:53.959944 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:53.961765 (+ 1821us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:04:53.961775 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:04:53.963134 (+ 1359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:04:53.965310 (+ 2176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:04:53.965318 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:04:53.965321 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:04:53.965663 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:04:53.965953 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:04:53.965954 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:04:53.965954 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:04:53.966180 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:04:53.966542 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:04:53.966549 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:04:53.966738 (+ 189us) client_negotiation.cc:769] Sending connection context
0806 01:04:53.967467 (+ 729us) client_negotiation.cc:240] Negotiation successful
0806 01:04:53.967660 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":112,"threads_started":1}
I20260806 01:04:53.968722 23342 heartbeater.cc:347] Connected to a master server at 127.11.88.126:44067
I20260806 01:04:53.968832 23342 heartbeater.cc:464] Registering TS with master...
I20260806 01:04:53.969035 23342 heartbeater.cc:511] Master 127.11.88.126:44067 requested a full tablet report, sending...
I20260806 01:04:53.969574 23112 ts_manager.cc:194] Registered new tserver with Master: 5fb1e2c0ff7f4299a973fd412fac9aaa (127.11.88.65:40151)
WARNING: no policy specified for kudu/127.11.88.66@KRBTEST.COM; defaulting to no policy
I20260806 01:04:53.970498 23112 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.65@KRBTEST.COM'} at 127.11.88.65:46821
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
I20260806 01:04:53.993494 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.88.84:41361/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:0
--local_ip_for_outbound_sockets=127.11.88.66
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:44067
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:34179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:04:54.120226 23348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:04:54.120457 23348 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:04:54.120498 23348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:04:54.121969 23348 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:04:54.122082 23348 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:04:54.122149 23348 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:04:54.123871 23348 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:34179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.88.84:41361/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:44067
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23348
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:04:54.124156 23348 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:04:54.124413 23348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
Aug 06 01:04:54 dist-test-slave-69rg krb5kdc[22621](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785978294, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260806 01:04:54.129768 23358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:04:54.129974 23348 server_base.cc:1034] running on GCE node
W20260806 01:04:54.129750 23356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:04:54.133526 23355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:04:54.133958 23348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:04:54.134280 23348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:04:54.135476 23348 hybrid_clock.cc:648] HybridClock initialized: now 1785978294135440 us; error 51 us; skew 500 ppm
Aug 06 01:04:54 dist-test-slave-69rg krb5kdc[22621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978294, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:04:54.138747 23348 init.cc:377] Logged in from keytab as kudu/127.11.88.66@KRBTEST.COM (short username kudu)
I20260806 01:04:54.139331 23348 webserver.cc:460] Webserver started at http://127.11.88.66:39227/ using document root <none> and password file <none>
I20260806 01:04:54.139614 23348 fs_manager.cc:359] Metadata directory not provided
I20260806 01:04:54.139676 23348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:04:54.139819 23348 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 01:04:54 dist-test-slave-69rg krb5kdc[22621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978294, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for HTTP/127.11.88.84@KRBTEST.COM
I20260806 01:04:54.168282 23348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-1/data/instance:
uuid: "62b0aa85cd45409197e36ec841ef5b0e"
format_stamp: "Formatted at 2026-08-06 01:04:54 on dist-test-slave-69rg"
server_key: "6c0537d8b18fa947e0d1a633748331bc"
server_key_iv: "78174a92072e1ebaa13b44acd453e67d"
server_key_version: "kuduclusterkey@0"
I20260806 01:04:54.168954 23348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance:
uuid: "62b0aa85cd45409197e36ec841ef5b0e"
format_stamp: "Formatted at 2026-08-06 01:04:54 on dist-test-slave-69rg"
server_key: "6c0537d8b18fa947e0d1a633748331bc"
server_key_iv: "78174a92072e1ebaa13b44acd453e67d"
server_key_version: "kuduclusterkey@0"
I20260806 01:04:54.172312 23348 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 01:04:54.192335 23365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:54.192653 23348 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 01:04:54.192765 23348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "62b0aa85cd45409197e36ec841ef5b0e"
format_stamp: "Formatted at 2026-08-06 01:04:54 on dist-test-slave-69rg"
server_key: "6c0537d8b18fa947e0d1a633748331bc"
server_key_iv: "78174a92072e1ebaa13b44acd453e67d"
server_key_version: "kuduclusterkey@0"
I20260806 01:04:54.192873 23348 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:04:54.205621 23348 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:04:54.208498 23348 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:04:54.208752 23348 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:04:54.209021 23348 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:04:54.209475 23348 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:04:54.209570 23348 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:54.209635 23348 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:04:54.209682 23348 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:54.217227 23348 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:46515
I20260806 01:04:54.217865 23348 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
I20260806 01:04:54.222071 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 23348
I20260806 01:04:54.222218 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance
I20260806 01:04:54.222431 11617 external_mini_cluster.cc:1428] Setting key 462f1df29ba5836dcafb8c195ea91b96
I20260806 01:04:54.229240 23488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:46515 every 8 connection(s)
Aug 06 01:04:54 dist-test-slave-69rg krb5kdc[22621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978294, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:04:54.244743 23345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:54.228841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:49583 (local address 127.11.88.126:44067)
0806 01:04:54.228899 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:54.228901 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:54.231276 (+ 2375us) server_negotiation.cc:407] Connection header received
0806 01:04:54.232078 (+ 802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:54.232080 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:54.232101 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:54.232138 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:04:54.233080 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.233995 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.235655 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.235995 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.236039 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:54.240857 (+ 4818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:04:54.240859 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:04:54.240860 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:04:54.240871 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:04:54.242839 (+ 1968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:04:54.243449 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:04:54.243451 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:04:54.243451 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:04:54.243519 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:04:54.243838 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:04:54.243839 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:04:54.243839 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:04:54.243994 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:04:54.244041 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:54.244495 (+ 454us) server_negotiation.cc:299] Negotiation successful
0806 01:04:54.244617 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260806 01:04:54.245666 23492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:54.228856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44067 (local address 127.11.88.66:49583)
0806 01:04:54.231100 (+ 2244us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:54.231164 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0806 01:04:54.231927 (+ 763us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:04:54.232351 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:04:54.232356 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:04:54.232650 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:04:54.232954 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:54.232961 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.234126 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.234127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:54.235524 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:54.235527 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.236142 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.236143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:54.236299 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:54.238755 (+ 2456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:04:54.238777 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:04:54.240701 (+ 1924us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:04:54.242965 (+ 2264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:04:54.242975 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:04:54.242979 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:04:54.243342 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:04:54.243599 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:04:54.243600 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:04:54.243600 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:04:54.243755 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:04:54.244110 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:04:54.244117 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:04:54.244314 (+ 197us) client_negotiation.cc:769] Sending connection context
0806 01:04:54.245190 (+ 876us) client_negotiation.cc:240] Negotiation successful
0806 01:04:54.245391 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2178,"thread_start_us":132,"threads_started":1}
I20260806 01:04:54.246541 23489 heartbeater.cc:347] Connected to a master server at 127.11.88.126:44067
I20260806 01:04:54.246647 23489 heartbeater.cc:464] Registering TS with master...
I20260806 01:04:54.246858 23489 heartbeater.cc:511] Master 127.11.88.126:44067 requested a full tablet report, sending...
I20260806 01:04:54.247242 23112 ts_manager.cc:194] Registered new tserver with Master: 62b0aa85cd45409197e36ec841ef5b0e (127.11.88.66:46515)
I20260806 01:04:54.247767 23112 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.66@KRBTEST.COM'} at 127.11.88.66:49583
WARNING: no policy specified for kudu/127.11.88.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
I20260806 01:04:54.277233 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.88.84:41361/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:0
--local_ip_for_outbound_sockets=127.11.88.67
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:44067
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:34179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:04:54.370404 23494 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:04:54.370651 23494 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:04:54.370693 23494 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:04:54.371974 23494 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:04:54.372045 23494 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:04:54.372092 23494 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:04:54.373858 23494 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:34179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.88.84:41361/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:44067
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23494
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:04:54.374150 23494 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:04:54.374398 23494 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:04:54.379665 23500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:04:54.379725 23503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:04:54.380126 23499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:04:54.380884 23494 server_base.cc:1034] running on GCE node
I20260806 01:04:54.381098 23494 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:04:54.381398 23494 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:04:54.382580 23494 hybrid_clock.cc:648] HybridClock initialized: now 1785978294382555 us; error 37 us; skew 500 ppm
Aug 06 01:04:54 dist-test-slave-69rg krb5kdc[22621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978294, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:04:54.386114 23494 init.cc:377] Logged in from keytab as kudu/127.11.88.67@KRBTEST.COM (short username kudu)
I20260806 01:04:54.386744 23494 webserver.cc:460] Webserver started at http://127.11.88.67:33995/ using document root <none> and password file <none>
I20260806 01:04:54.387035 23494 fs_manager.cc:359] Metadata directory not provided
I20260806 01:04:54.387173 23494 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:04:54.387363 23494 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 01:04:54 dist-test-slave-69rg krb5kdc[22621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978294, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for HTTP/127.11.88.84@KRBTEST.COM
I20260806 01:04:54.408250 23494 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-2/data/instance:
uuid: "f80ccb31b6dd41d2b88924de256f2e27"
format_stamp: "Formatted at 2026-08-06 01:04:54 on dist-test-slave-69rg"
server_key: "77971fe1f00abf5c40c003335c87a075"
server_key_iv: "e223c5c9e863e56e1e736c1f11540c2c"
server_key_version: "kuduclusterkey@0"
I20260806 01:04:54.408871 23494 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance:
uuid: "f80ccb31b6dd41d2b88924de256f2e27"
format_stamp: "Formatted at 2026-08-06 01:04:54 on dist-test-slave-69rg"
server_key: "77971fe1f00abf5c40c003335c87a075"
server_key_iv: "e223c5c9e863e56e1e736c1f11540c2c"
server_key_version: "kuduclusterkey@0"
I20260806 01:04:54.414273 23494 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.000s
I20260806 01:04:54.433079 23510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:54.433390 23494 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:04:54.433512 23494 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "f80ccb31b6dd41d2b88924de256f2e27"
format_stamp: "Formatted at 2026-08-06 01:04:54 on dist-test-slave-69rg"
server_key: "77971fe1f00abf5c40c003335c87a075"
server_key_iv: "e223c5c9e863e56e1e736c1f11540c2c"
server_key_version: "kuduclusterkey@0"
I20260806 01:04:54.433626 23494 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:04:54.473650 23494 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:04:54.476322 23494 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:04:54.476562 23494 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:04:54.476883 23494 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:04:54.477347 23494 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:04:54.477449 23494 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:54.477531 23494 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:04:54.477569 23494 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:04:54.485859 23494 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:39073
I20260806 01:04:54.486434 23494 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
I20260806 01:04:54.489672 23627 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:39073 every 8 connection(s)
I20260806 01:04:54.496477 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 23494
I20260806 01:04:54.496608 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance
Aug 06 01:04:54 dist-test-slave-69rg krb5kdc[22621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978294, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:04:54.496821 11617 external_mini_cluster.cc:1428] Setting key 5dbd35cbda2095766aea291976ad8a5f
I20260806 01:04:54.501569 23345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:54.489380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:38527 (local address 127.11.88.126:44067)
0806 01:04:54.489433 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:54.489436 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:54.490369 (+ 933us) server_negotiation.cc:407] Connection header received
0806 01:04:54.490895 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:54.490897 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:54.490911 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:54.490991 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:04:54.491753 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.492523 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.494162 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.494449 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.494533 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:54.497892 (+ 3359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:04:54.497894 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:04:54.497894 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:04:54.497903 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:04:54.499770 (+ 1867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:04:54.500383 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:04:54.500384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:04:54.500385 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:04:54.500452 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:04:54.500763 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:04:54.500764 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:04:54.500764 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:04:54.500912 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:04:54.500970 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:54.501376 (+ 406us) server_negotiation.cc:299] Negotiation successful
0806 01:04:54.501469 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 01:04:54.502462 23630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:54.489378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44067 (local address 127.11.88.67:38527)
0806 01:04:54.490227 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:54.490260 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0806 01:04:54.490791 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:04:54.491066 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:04:54.491070 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:04:54.491336 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:04:54.491620 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:54.491626 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.492615 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.492616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:54.494053 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:54.494056 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.494564 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.494566 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:54.494717 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:54.495407 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:04:54.495418 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:04:54.497104 (+ 1686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:04:54.499872 (+ 2768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:04:54.499880 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:04:54.499883 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:04:54.500277 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:04:54.500529 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:04:54.500530 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:04:54.500530 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:04:54.500674 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:04:54.501006 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:04:54.501012 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:04:54.501188 (+ 176us) client_negotiation.cc:769] Sending connection context
0806 01:04:54.502010 (+ 822us) client_negotiation.cc:240] Negotiation successful
0806 01:04:54.502207 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":810,"thread_start_us":86,"threads_started":1}
I20260806 01:04:54.503172 23628 heartbeater.cc:347] Connected to a master server at 127.11.88.126:44067
I20260806 01:04:54.503289 23628 heartbeater.cc:464] Registering TS with master...
I20260806 01:04:54.503499 23628 heartbeater.cc:511] Master 127.11.88.126:44067 requested a full tablet report, sending...
I20260806 01:04:54.504004 23112 ts_manager.cc:194] Registered new tserver with Master: f80ccb31b6dd41d2b88924de256f2e27 (127.11.88.67:39073)
I20260806 01:04:54.504510 23112 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.67@KRBTEST.COM'} at 127.11.88.67:38527
I20260806 01:04:54.508805 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 01:04:54.519037 23345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:54.510659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41080 (local address 127.11.88.126:44067)
0806 01:04:54.510705 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:54.510708 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:54.510856 (+ 148us) server_negotiation.cc:407] Connection header received
0806 01:04:54.510909 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:54.510910 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:54.510923 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:54.510980 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:04:54.511960 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.512713 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.513848 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.514147 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.514236 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:54.515900 (+ 1664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:04:54.515902 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:04:54.515902 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:04:54.515910 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:04:54.517646 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:04:54.518136 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:04:54.518137 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:04:54.518138 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:04:54.518213 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:04:54.518421 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:04:54.518422 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:04:54.518422 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:04:54.518556 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:04:54.518631 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:54.518856 (+ 225us) server_negotiation.cc:299] Negotiation successful
0806 01:04:54.518938 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 01:04:54.522187 23112 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41080:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 01:04:54.524566 23112 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:04:54.534837 23645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:54.528610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:39073 (local address 127.0.0.1:49412)
0806 01:04:54.529995 (+ 1385us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:54.530044 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 01:04:54.530116 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:04:54.530673 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:04:54.530678 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:04:54.530681 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:04:54.530771 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:54.530772 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.532056 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.532057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:54.533349 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:54.533352 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.534524 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.534525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:54.534612 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:54.534626 (+ 14us) client_negotiation.cc:769] Sending connection context
0806 01:04:54.534694 (+ 68us) client_negotiation.cc:240] Negotiation successful
0806 01:04:54.534749 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1314,"thread_start_us":73,"threads_started":1}
I20260806 01:04:54.535318 23642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:54.528921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49412 (local address 127.11.88.67:39073)
0806 01:04:54.530482 (+ 1561us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:54.530489 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:54.530498 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:04:54.530542 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:54.530544 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:54.530561 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:54.530650 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:04:54.530880 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.531953 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.533482 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.534336 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.534409 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:54.534487 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:54.535181 (+ 694us) server_negotiation.cc:299] Negotiation successful
0806 01:04:54.535236 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1519,"thread_start_us":89,"threads_started":1}
I20260806 01:04:54.536652 23559 tablet_service.cc:1467] Processing CreateTablet for tablet 016c8d5d23514c528b0493030e2c0e51 (DEFAULT_TABLE table=test-table [id=f38c893920f24e17819b50b8efc705a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:04:54.537056 23559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 016c8d5d23514c528b0493030e2c0e51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:04:54.539680 23643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:54.529212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:46515 (local address 127.0.0.1:49552)
0806 01:04:54.530211 (+ 999us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:54.530219 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0806 01:04:54.530255 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:04:54.531045 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:04:54.531046 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:04:54.531049 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:04:54.531096 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:54.531098 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.534730 (+ 3632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.534731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:54.535814 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:54.535817 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.539436 (+ 3619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.539437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:54.539507 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:54.539512 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 01:04:54.539543 (+ 31us) client_negotiation.cc:240] Negotiation successful
0806 01:04:54.539584 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":984,"thread_start_us":72,"threads_started":1}
I20260806 01:04:54.540706 23641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:54.529400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:40151 (local address 127.0.0.1:34504)
0806 01:04:54.530320 (+ 920us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:54.530328 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0806 01:04:54.530360 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:04:54.532151 (+ 1791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:04:54.532152 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:04:54.532154 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:04:54.532197 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:54.532198 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.537059 (+ 4861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.537060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:54.538195 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:54.538198 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.540479 (+ 2281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.540480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:54.540546 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:54.540550 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:04:54.540580 (+ 30us) client_negotiation.cc:240] Negotiation successful
0806 01:04:54.540632 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":909,"thread_start_us":73,"threads_started":1}
I20260806 01:04:54.541082 23647 tablet_bootstrap.cc:492] T 016c8d5d23514c528b0493030e2c0e51 P f80ccb31b6dd41d2b88924de256f2e27: Bootstrap starting.
I20260806 01:04:54.541253 23644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:54.529344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49552 (local address 127.11.88.66:46515)
0806 01:04:54.530864 (+ 1520us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:54.530869 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:54.530880 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:04:54.530918 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:54.530920 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:54.530935 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:54.531171 (+ 236us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:04:54.531248 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.534625 (+ 3377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.536096 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.539341 (+ 3245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.540994 (+ 1653us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:54.541093 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:54.541123 (+ 30us) server_negotiation.cc:299] Negotiation successful
0806 01:04:54.541169 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1479,"thread_start_us":89,"threads_started":1}
I20260806 01:04:54.541728 23646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:54.529625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34504 (local address 127.11.88.65:40151)
0806 01:04:54.531981 (+ 2356us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:54.531986 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:54.531996 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:04:54.532031 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:54.532032 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:54.532049 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:54.532273 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:04:54.532340 (+ 67us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.533387 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.538310 (+ 4923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.539081 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.541480 (+ 2399us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:54.541556 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:54.541586 (+ 30us) server_negotiation.cc:299] Negotiation successful
0806 01:04:54.541647 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2319,"thread_start_us":57,"threads_started":1}
I20260806 01:04:54.542618 23647 tablet_bootstrap.cc:654] T 016c8d5d23514c528b0493030e2c0e51 P f80ccb31b6dd41d2b88924de256f2e27: Neither blocks nor log segments found. Creating new log.
I20260806 01:04:54.542564 23252 tablet_service.cc:1467] Processing CreateTablet for tablet 016c8d5d23514c528b0493030e2c0e51 (DEFAULT_TABLE table=test-table [id=f38c893920f24e17819b50b8efc705a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:04:54.542611 23417 tablet_service.cc:1467] Processing CreateTablet for tablet 016c8d5d23514c528b0493030e2c0e51 (DEFAULT_TABLE table=test-table [id=f38c893920f24e17819b50b8efc705a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:04:54.542915 23252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 016c8d5d23514c528b0493030e2c0e51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:04:54.542963 23417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 016c8d5d23514c528b0493030e2c0e51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:04:54.543001 23647 log.cc:824] T 016c8d5d23514c528b0493030e2c0e51 P f80ccb31b6dd41d2b88924de256f2e27: Log is configured to *not* fsync() on all Append() calls
I20260806 01:04:54.543745 23647 tablet_bootstrap.cc:492] T 016c8d5d23514c528b0493030e2c0e51 P f80ccb31b6dd41d2b88924de256f2e27: No bootstrap required, opened a new log
I20260806 01:04:54.543805 23647 ts_tablet_manager.cc:1397] T 016c8d5d23514c528b0493030e2c0e51 P f80ccb31b6dd41d2b88924de256f2e27: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 01:04:54.546041 23647 raft_consensus.cc:348] T 016c8d5d23514c528b0493030e2c0e51 P f80ccb31b6dd41d2b88924de256f2e27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb1e2c0ff7f4299a973fd412fac9aaa" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 40151 } } peers { permanent_uuid: "62b0aa85cd45409197e36ec841ef5b0e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 46515 } } peers { permanent_uuid: "f80ccb31b6dd41d2b88924de256f2e27" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 39073 } }
I20260806 01:04:54.546218 23647 raft_consensus.cc:374] T 016c8d5d23514c528b0493030e2c0e51 P f80ccb31b6dd41d2b88924de256f2e27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:04:54.546257 23647 raft_consensus.cc:729] T 016c8d5d23514c528b0493030e2c0e51 P f80ccb31b6dd41d2b88924de256f2e27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f80ccb31b6dd41d2b88924de256f2e27, State: Initialized, Role: FOLLOWER
I20260806 01:04:54.546371 23647 consensus_queue.cc:260] T 016c8d5d23514c528b0493030e2c0e51 P f80ccb31b6dd41d2b88924de256f2e27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb1e2c0ff7f4299a973fd412fac9aaa" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 40151 } } peers { permanent_uuid: "62b0aa85cd45409197e36ec841ef5b0e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 46515 } } peers { permanent_uuid: "f80ccb31b6dd41d2b88924de256f2e27" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 39073 } }
I20260806 01:04:54.546618 23647 ts_tablet_manager.cc:1428] T 016c8d5d23514c528b0493030e2c0e51 P f80ccb31b6dd41d2b88924de256f2e27: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 01:04:54.546957 23628 heartbeater.cc:503] Master 127.11.88.126:44067 was elected leader, sending a full tablet report...
I20260806 01:04:54.547225 23649 tablet_bootstrap.cc:492] T 016c8d5d23514c528b0493030e2c0e51 P 5fb1e2c0ff7f4299a973fd412fac9aaa: Bootstrap starting.
I20260806 01:04:54.547917 23649 tablet_bootstrap.cc:654] T 016c8d5d23514c528b0493030e2c0e51 P 5fb1e2c0ff7f4299a973fd412fac9aaa: Neither blocks nor log segments found. Creating new log.
I20260806 01:04:54.548236 23649 log.cc:824] T 016c8d5d23514c528b0493030e2c0e51 P 5fb1e2c0ff7f4299a973fd412fac9aaa: Log is configured to *not* fsync() on all Append() calls
I20260806 01:04:54.548596 23650 tablet_bootstrap.cc:492] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e: Bootstrap starting.
I20260806 01:04:54.549585 23650 tablet_bootstrap.cc:654] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e: Neither blocks nor log segments found. Creating new log.
I20260806 01:04:54.549958 23650 log.cc:824] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e: Log is configured to *not* fsync() on all Append() calls
I20260806 01:04:54.550707 23649 tablet_bootstrap.cc:492] T 016c8d5d23514c528b0493030e2c0e51 P 5fb1e2c0ff7f4299a973fd412fac9aaa: No bootstrap required, opened a new log
I20260806 01:04:54.550777 23649 ts_tablet_manager.cc:1397] T 016c8d5d23514c528b0493030e2c0e51 P 5fb1e2c0ff7f4299a973fd412fac9aaa: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260806 01:04:54.553460 23649 raft_consensus.cc:348] T 016c8d5d23514c528b0493030e2c0e51 P 5fb1e2c0ff7f4299a973fd412fac9aaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb1e2c0ff7f4299a973fd412fac9aaa" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 40151 } } peers { permanent_uuid: "62b0aa85cd45409197e36ec841ef5b0e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 46515 } } peers { permanent_uuid: "f80ccb31b6dd41d2b88924de256f2e27" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 39073 } }
I20260806 01:04:54.553656 23649 raft_consensus.cc:374] T 016c8d5d23514c528b0493030e2c0e51 P 5fb1e2c0ff7f4299a973fd412fac9aaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:04:54.553697 23649 raft_consensus.cc:729] T 016c8d5d23514c528b0493030e2c0e51 P 5fb1e2c0ff7f4299a973fd412fac9aaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb1e2c0ff7f4299a973fd412fac9aaa, State: Initialized, Role: FOLLOWER
I20260806 01:04:54.553850 23649 consensus_queue.cc:260] T 016c8d5d23514c528b0493030e2c0e51 P 5fb1e2c0ff7f4299a973fd412fac9aaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb1e2c0ff7f4299a973fd412fac9aaa" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 40151 } } peers { permanent_uuid: "62b0aa85cd45409197e36ec841ef5b0e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 46515 } } peers { permanent_uuid: "f80ccb31b6dd41d2b88924de256f2e27" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 39073 } }
I20260806 01:04:54.554179 23342 heartbeater.cc:503] Master 127.11.88.126:44067 was elected leader, sending a full tablet report...
I20260806 01:04:54.554780 23649 ts_tablet_manager.cc:1428] T 016c8d5d23514c528b0493030e2c0e51 P 5fb1e2c0ff7f4299a973fd412fac9aaa: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260806 01:04:54.555562 23650 tablet_bootstrap.cc:492] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e: No bootstrap required, opened a new log
I20260806 01:04:54.555652 23650 ts_tablet_manager.cc:1397] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260806 01:04:54.557657 23650 raft_consensus.cc:348] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb1e2c0ff7f4299a973fd412fac9aaa" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 40151 } } peers { permanent_uuid: "62b0aa85cd45409197e36ec841ef5b0e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 46515 } } peers { permanent_uuid: "f80ccb31b6dd41d2b88924de256f2e27" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 39073 } }
I20260806 01:04:54.557861 23650 raft_consensus.cc:374] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:04:54.557902 23650 raft_consensus.cc:729] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62b0aa85cd45409197e36ec841ef5b0e, State: Initialized, Role: FOLLOWER
I20260806 01:04:54.558010 23650 consensus_queue.cc:260] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb1e2c0ff7f4299a973fd412fac9aaa" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 40151 } } peers { permanent_uuid: "62b0aa85cd45409197e36ec841ef5b0e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 46515 } } peers { permanent_uuid: "f80ccb31b6dd41d2b88924de256f2e27" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 39073 } }
I20260806 01:04:54.558363 23489 heartbeater.cc:503] Master 127.11.88.126:44067 was elected leader, sending a full tablet report...
I20260806 01:04:54.558311 23650 ts_tablet_manager.cc:1428] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
Aug 06 01:04:54 dist-test-slave-69rg krb5kdc[22621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978294, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for HTTP/127.11.88.84@KRBTEST.COM
I20260806 01:04:54.655922 23656 raft_consensus.cc:482] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:04:54.656087 23656 raft_consensus.cc:504] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb1e2c0ff7f4299a973fd412fac9aaa" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 40151 } } peers { permanent_uuid: "62b0aa85cd45409197e36ec841ef5b0e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 46515 } } peers { permanent_uuid: "f80ccb31b6dd41d2b88924de256f2e27" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 39073 } }
I20260806 01:04:54.656551 23656 leader_election.cc:288] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5fb1e2c0ff7f4299a973fd412fac9aaa (127.11.88.65:40151), f80ccb31b6dd41d2b88924de256f2e27 (127.11.88.67:39073)
I20260806 01:04:54.662969 23492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:54.656843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:40151 (local address 127.11.88.66:35249)
0806 01:04:54.657084 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:54.657096 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:04:54.657145 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:04:54.658857 (+ 1712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:04:54.658859 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:04:54.658861 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:04:54.658940 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:54.658941 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.660055 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.660057 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:54.661461 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:54.661465 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.662726 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.662727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:54.662799 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:54.662802 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:04:54.662849 (+ 47us) client_negotiation.cc:240] Negotiation successful
0806 01:04:54.662891 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214}
I20260806 01:04:54.663781 23646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:54.657262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:35249 (local address 127.11.88.65:40151)
0806 01:04:54.657308 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:54.657310 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:54.657317 (+ 7us) server_negotiation.cc:407] Connection header received
0806 01:04:54.657344 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:54.657345 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:54.657354 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:54.657400 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:04:54.659034 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.659761 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.661664 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.662601 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.662650 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:54.662661 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:54.663667 (+ 1006us) server_negotiation.cc:299] Negotiation successful
0806 01:04:54.663717 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 01:04:54.664048 23293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "016c8d5d23514c528b0493030e2c0e51" candidate_uuid: "62b0aa85cd45409197e36ec841ef5b0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb1e2c0ff7f4299a973fd412fac9aaa" is_pre_election: true
I20260806 01:04:54.664237 23293 raft_consensus.cc:2454] T 016c8d5d23514c528b0493030e2c0e51 P 5fb1e2c0ff7f4299a973fd412fac9aaa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62b0aa85cd45409197e36ec841ef5b0e in term 0.
I20260806 01:04:54.664682 23368 leader_election.cc:302] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fb1e2c0ff7f4299a973fd412fac9aaa, 62b0aa85cd45409197e36ec841ef5b0e; no voters:
I20260806 01:04:54.664885 23656 raft_consensus.cc:2781] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:04:54.664943 23656 raft_consensus.cc:482] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:04:54.664969 23656 raft_consensus.cc:3037] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:04:54.665915 23656 raft_consensus.cc:504] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb1e2c0ff7f4299a973fd412fac9aaa" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 40151 } } peers { permanent_uuid: "62b0aa85cd45409197e36ec841ef5b0e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 46515 } } peers { permanent_uuid: "f80ccb31b6dd41d2b88924de256f2e27" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 39073 } }
I20260806 01:04:54.666047 23656 leader_election.cc:288] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e [CANDIDATE]: Term 1 election: Requested vote from peers 5fb1e2c0ff7f4299a973fd412fac9aaa (127.11.88.65:40151), f80ccb31b6dd41d2b88924de256f2e27 (127.11.88.67:39073)
I20260806 01:04:54.666363 23293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "016c8d5d23514c528b0493030e2c0e51" candidate_uuid: "62b0aa85cd45409197e36ec841ef5b0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb1e2c0ff7f4299a973fd412fac9aaa"
I20260806 01:04:54.666435 23293 raft_consensus.cc:3037] T 016c8d5d23514c528b0493030e2c0e51 P 5fb1e2c0ff7f4299a973fd412fac9aaa [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:04:54.667315 23293 raft_consensus.cc:2454] T 016c8d5d23514c528b0493030e2c0e51 P 5fb1e2c0ff7f4299a973fd412fac9aaa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62b0aa85cd45409197e36ec841ef5b0e in term 1.
I20260806 01:04:54.667546 23368 leader_election.cc:302] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fb1e2c0ff7f4299a973fd412fac9aaa, 62b0aa85cd45409197e36ec841ef5b0e; no voters:
I20260806 01:04:54.667660 23656 raft_consensus.cc:2781] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:04:54.667831 23656 raft_consensus.cc:686] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e [term 1 LEADER]: Becoming Leader. State: Replica: 62b0aa85cd45409197e36ec841ef5b0e, State: Running, Role: LEADER
I20260806 01:04:54.667915 23656 consensus_queue.cc:237] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb1e2c0ff7f4299a973fd412fac9aaa" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 40151 } } peers { permanent_uuid: "62b0aa85cd45409197e36ec841ef5b0e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 46515 } } peers { permanent_uuid: "f80ccb31b6dd41d2b88924de256f2e27" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 39073 } }
I20260806 01:04:54.668866 23112 catalog_manager.cc:5495] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e reported cstate change: term changed from 0 to 1, leader changed from <none> to 62b0aa85cd45409197e36ec841ef5b0e (127.11.88.66). New cstate: current_term: 1 leader_uuid: "62b0aa85cd45409197e36ec841ef5b0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fb1e2c0ff7f4299a973fd412fac9aaa" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 40151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62b0aa85cd45409197e36ec841ef5b0e" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f80ccb31b6dd41d2b88924de256f2e27" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 39073 } health_report { overall_health: UNKNOWN } } }
I20260806 01:04:54.673425 23492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:54.659888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:39073 (local address 127.11.88.66:36451)
0806 01:04:54.663050 (+ 3162us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:54.663061 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:04:54.663105 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:04:54.670005 (+ 6900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:04:54.670006 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:04:54.670008 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:04:54.670052 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:54.670053 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.671015 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.671017 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:54.672124 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:04:54.672127 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.673173 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.673174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:04:54.673247 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:54.673251 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:04:54.673302 (+ 51us) client_negotiation.cc:240] Negotiation successful
0806 01:04:54.673342 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3150,"thread_start_us":114,"threads_started":1}
I20260806 01:04:54.673779 23642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:54.658766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:36451 (local address 127.11.88.67:39073)
0806 01:04:54.658817 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:54.658819 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:54.663214 (+ 4395us) server_negotiation.cc:407] Connection header received
0806 01:04:54.663249 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:54.663250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:54.663261 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:54.663309 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:04:54.670146 (+ 6837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.670891 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.672363 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.672914 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.672989 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:54.673000 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:54.673650 (+ 650us) server_negotiation.cc:299] Negotiation successful
0806 01:04:54.673700 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 01:04:54.674393 23579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "016c8d5d23514c528b0493030e2c0e51" candidate_uuid: "62b0aa85cd45409197e36ec841ef5b0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f80ccb31b6dd41d2b88924de256f2e27" is_pre_election: true
I20260806 01:04:54.674549 23579 raft_consensus.cc:2454] T 016c8d5d23514c528b0493030e2c0e51 P f80ccb31b6dd41d2b88924de256f2e27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62b0aa85cd45409197e36ec841ef5b0e in term 0.
I20260806 01:04:54.674672 23578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "016c8d5d23514c528b0493030e2c0e51" candidate_uuid: "62b0aa85cd45409197e36ec841ef5b0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f80ccb31b6dd41d2b88924de256f2e27"
I20260806 01:04:54.674732 23578 raft_consensus.cc:3037] T 016c8d5d23514c528b0493030e2c0e51 P f80ccb31b6dd41d2b88924de256f2e27 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:04:54.675658 23578 raft_consensus.cc:2454] T 016c8d5d23514c528b0493030e2c0e51 P f80ccb31b6dd41d2b88924de256f2e27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62b0aa85cd45409197e36ec841ef5b0e in term 1.
I20260806 01:04:54.686967 23644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:54.682266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49564 (local address 127.11.88.66:46515)
0806 01:04:54.682310 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 01:04:54.682312 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:04:54.682322 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:04:54.682364 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:04:54.682365 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:04:54.682384 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:04:54.682459 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:04:54.682675 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.683414 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.685693 (+ 2279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:04:54.686031 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:04:54.686101 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:04:54.686347 (+ 246us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:04:54.686488 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:04:54.686577 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 01:04:54.686839 (+ 262us) server_negotiation.cc:299] Negotiation successful
0806 01:04:54.686860 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 01:04:54.689417 23578 raft_consensus.cc:1261] T 016c8d5d23514c528b0493030e2c0e51 P f80ccb31b6dd41d2b88924de256f2e27 [term 1 FOLLOWER]: Refusing update from remote peer 62b0aa85cd45409197e36ec841ef5b0e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:04:54.689898 23658 consensus_queue.cc:1035] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f80ccb31b6dd41d2b88924de256f2e27" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 39073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:04:54.692584 23293 raft_consensus.cc:1261] T 016c8d5d23514c528b0493030e2c0e51 P 5fb1e2c0ff7f4299a973fd412fac9aaa [term 1 FOLLOWER]: Refusing update from remote peer 62b0aa85cd45409197e36ec841ef5b0e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:04:54.693169 23658 consensus_queue.cc:1035] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb1e2c0ff7f4299a973fd412fac9aaa" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 40151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:04:54.697371 23661 mvcc.cc:205] Tried to move back new op lower bound from 7315367095044800512 to 7315367094960181248. Current Snapshot: MvccSnapshot[applied={T|T < 7315367095044800512}]
I20260806 01:04:54.697593 23662 mvcc.cc:205] Tried to move back new op lower bound from 7315367095044800512 to 7315367094960181248. Current Snapshot: MvccSnapshot[applied={T|T < 7315367095044800512}]
I20260806 01:04:54.700152 23664 mvcc.cc:205] Tried to move back new op lower bound from 7315367095044800512 to 7315367094960181248. Current Snapshot: MvccSnapshot[applied={T|T < 7315367095044800512}]
I20260806 01:04:54.703531 23112 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:04:54.703630 23112 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:04:54.704456 23112 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6261042ee9804623bcea58944d17063a: Sending DeleteTablet for 3 replicas of tablet 016c8d5d23514c528b0493030e2c0e51
I20260806 01:04:54.704869 23417 tablet_service.cc:1514] Processing DeleteTablet for tablet 016c8d5d23514c528b0493030e2c0e51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:04:54 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:49552
I20260806 01:04:54.704923 23559 tablet_service.cc:1514] Processing DeleteTablet for tablet 016c8d5d23514c528b0493030e2c0e51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:04:54 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:49412
I20260806 01:04:54.705058 23252 tablet_service.cc:1514] Processing DeleteTablet for tablet 016c8d5d23514c528b0493030e2c0e51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:04:54 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:34504
I20260806 01:04:54.705497 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 23204
I20260806 01:04:54.713946 23670 tablet_replica.cc:330] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e: stopping tablet replica
I20260806 01:04:54.714175 23670 raft_consensus.cc:2229] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e [term 1 LEADER]: Raft consensus shutting down.
I20260806 01:04:54.714421 23670 raft_consensus.cc:2258] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:04:54.714651 23671 tablet_replica.cc:330] T 016c8d5d23514c528b0493030e2c0e51 P f80ccb31b6dd41d2b88924de256f2e27: stopping tablet replica
I20260806 01:04:54.715145 23670 ts_tablet_manager.cc:1905] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:04:54.716936 23671 raft_consensus.cc:2229] T 016c8d5d23514c528b0493030e2c0e51 P f80ccb31b6dd41d2b88924de256f2e27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:04:54.717149 23671 raft_consensus.cc:2258] T 016c8d5d23514c528b0493030e2c0e51 P f80ccb31b6dd41d2b88924de256f2e27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:04:54.722340 23671 ts_tablet_manager.cc:1905] T 016c8d5d23514c528b0493030e2c0e51 P f80ccb31b6dd41d2b88924de256f2e27: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:04:54.724138 23670 ts_tablet_manager.cc:1918] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:04:54.725505 23670 log.cc:1196] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-1/wal/wals/016c8d5d23514c528b0493030e2c0e51
I20260806 01:04:54.725910 23670 ts_tablet_manager.cc:1939] T 016c8d5d23514c528b0493030e2c0e51 P 62b0aa85cd45409197e36ec841ef5b0e: Deleting consensus metadata
I20260806 01:04:54.726488 23096 catalog_manager.cc:4841] TS 62b0aa85cd45409197e36ec841ef5b0e (127.11.88.66:46515): tablet 016c8d5d23514c528b0493030e2c0e51 (table test-table [id=f38c893920f24e17819b50b8efc705a6]) successfully deleted
I20260806 01:04:54.726773 23671 ts_tablet_manager.cc:1918] T 016c8d5d23514c528b0493030e2c0e51 P f80ccb31b6dd41d2b88924de256f2e27: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:04:54.726905 23671 log.cc:1196] T 016c8d5d23514c528b0493030e2c0e51 P f80ccb31b6dd41d2b88924de256f2e27: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785978186227899-11617-0/minicluster-data/ts-2/wal/wals/016c8d5d23514c528b0493030e2c0e51
I20260806 01:04:54.727525 23671 ts_tablet_manager.cc:1939] T 016c8d5d23514c528b0493030e2c0e51 P f80ccb31b6dd41d2b88924de256f2e27: Deleting consensus metadata
I20260806 01:04:54.729256 23099 catalog_manager.cc:4841] TS f80ccb31b6dd41d2b88924de256f2e27 (127.11.88.67:39073): tablet 016c8d5d23514c528b0493030e2c0e51 (table test-table [id=f38c893920f24e17819b50b8efc705a6]) successfully deleted
W20260806 01:04:54.731640 23097 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.88.65:40151 (error 108)
I20260806 01:04:54.732309 23641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:04:54.732157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:40151 (local address 127.0.0.1:34518)
0806 01:04:54.732215 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0806 01:04:54.732271 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.65:40151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260806 01:04:54.732443 23097 catalog_manager.cc:4584] TS 5fb1e2c0ff7f4299a973fd412fac9aaa (127.11.88.65:40151): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 016c8d5d23514c528b0493030e2c0e51: Network error: Client connection negotiation failed: client connection to 127.11.88.65:40151: connect: Connection refused (error 111)
I20260806 01:04:54.737460 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 23348
I20260806 01:04:54.744107 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 23494
I20260806 01:04:54.754307 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 23079
I20260806 01:04:54.760960 11617 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 01:04:55.105979 11617 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 01:04:55.106119 11617 mini_ranger.cc:66] Stopping Ranger...
I20260806 01:04:55.451470 11617 mini_ranger.cc:68] Stopped Ranger
2026-08-06 01:04:55.451 UTC [22651] LOG: received smart shutdown request
2026-08-06 01:04:55.455 UTC [22651] LOG: background worker "logical replication launcher" (PID 22660) exited with exit code 1
2026-08-06 01:04:55.456 UTC [22655] LOG: shutting down
2026-08-06 01:04:55.647 UTC [22651] LOG: database system is shut down
2026-08-06T01:04:55Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (50776 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:04:55 dist-test-slave-69rg krb5kdc[23683](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:04:55 dist-test-slave-69rg krb5kdc[23683](info): set up 2 sockets
Aug 06 01:04:55 dist-test-slave-69rg krb5kdc[23683](info): commencing operation
krb5kdc: starting...
W20260806 01:04:56.835188 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.049s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:04:56 dist-test-slave-69rg krb5kdc[23683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:04:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:04:56Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.88.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.88.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.88.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/rangeradmin_127.11.88.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.88.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/rangeradmin_127.11.88.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.88.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.88.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.88.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/rangerlookup_127.11.88.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.88.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/rangerlookup_127.11.88.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.88.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.88.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.88.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/HTTP_127.11.88.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.88.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/HTTP_127.11.88.84@KRBTEST.COM.keytab.
I20260806 01:04:57.013867 11617 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task7A9gSt/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/postgres -l logfile start
2026-08-06 01:04:59.718 UTC [23715] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 01:04:59.718 UTC [23715] LOG: listening on IPv4 address "127.11.88.84", port 34839
2026-08-06 01:04:59.721 UTC [23715] LOG: listening on Unix socket "/tmp/.s.PGSQL.34839"
2026-08-06 01:04:59.743 UTC [23718] LOG: database system was shut down at 2026-08-06 01:04:58 UTC
2026-08-06 01:04:59.748 UTC [23715] LOG: database system is ready to accept connections
I20260806 01:05:00.743643 11617 mini_postgres.cc:96] Postgres bound to 34839
2026-08-06 01:05:00.750 UTC [23726] FATAL: database "slave" does not exist
127.11.88.84:34839 - accepting connections
I20260806 01:05:00.751194 11617 mini_ranger.cc:161] Starting Ranger...
I20260806 01:05:00.769601 11617 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 01:05:01.519366 11617 mini_ranger.cc:87] Created ranger Postgres database
I20260806 01:05:01.519470 11617 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ranger-admin
2026-08-06 01:05:01,797 [I] DB FLAVOR :POSTGRES
2026-08-06 01:05:01,798 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 01:05:01,798 [I] Checking connection..
2026-08-06 01:05:01,798 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:34839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 01:05:02,048 [I] Checking connection passed.
2026-08-06 01:05:02,048 [I] --------- Verifying version history table ---------
2026-08-06 01:05:02,048 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:34839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 01:05:02,300 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 01:05:02,301 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:34839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 01:05:02,571 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 01:05:02,572 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 01:05:02,572 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:34839/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 01:05:02.842 UTC [23795] WARNING: there is no transaction in progress
2026-08-06 01:05:02,849 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 01:05:02,850 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:34839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 01:05:03,101 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 01:05:03,102 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 01:05:03,102 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:34839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 01:05:03,365 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:34839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 01:05:03,606 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:34839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-69rg.c.gcp-upstream.internal','N') ;"
2026-08-06 01:05:03,846 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:34839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 01:05:04,114 [I] Table x_portal_user does not exist in database ranger
2026-08-06 01:05:04,114 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:34839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 01:05:04,355 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 01:05:04,356 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:34839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 01:05:04,629 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:34839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 01:05:04,886 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 01:05:04,886 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:34839/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 01:05:06.071 UTC [23906] WARNING: there is no transaction in progress
2026-08-06 01:05:06.096 UTC [23906] WARNING: there is no transaction in progress
2026-08-06 01:05:06.119 UTC [23906] WARNING: there is no transaction in progress
2026-08-06 01:05:06.139 UTC [23906] WARNING: there is no transaction in progress
2026-08-06 01:05:06.159 UTC [23906] WARNING: there is no transaction in progress
2026-08-06 01:05:06.182 UTC [23906] WARNING: there is no transaction in progress
2026-08-06 01:05:06.261 UTC [23906] WARNING: there is no transaction in progress
2026-08-06 01:05:06.271 UTC [23906] WARNING: there is no transaction in progress
2026-08-06 01:05:06.290 UTC [23906] WARNING: there is no transaction in progress
2026-08-06 01:05:06.303 UTC [23906] WARNING: there is no transaction in progress
2026-08-06 01:05:06.316 UTC [23906] WARNING: there is no transaction in progress
2026-08-06 01:05:06.336 UTC [23906] WARNING: there is no transaction in progress
2026-08-06 01:05:06.348 UTC [23906] WARNING: there is no transaction in progress
2026-08-06 01:05:06.356 UTC [23906] WARNING: there is no transaction in progress
2026-08-06 01:05:06.365 UTC [23906] WARNING: there is no transaction in progress
2026-08-06 01:05:06.376 UTC [23906] WARNING: there is no transaction in progress
2026-08-06 01:05:07,246 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 01:05:07,246 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:34839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 01:05:07,531 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 01:05:07,532 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:34839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 01:05:07,797 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 01:05:07,798 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:34839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 01:05:08,087 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 01:05:08,088 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:34839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 01:05:08,341 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:34839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 01:05:08,603 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:34839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-69rg.c.gcp-upstream.internal';"
2026-08-06 01:05:08,881 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 01:05:08,882 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:34839/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 01:05:09,141 [I] DB_PATCHES have already been applied
I20260806 01:05:09.147298 11617 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ranger-admin:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task7A9gSt/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 01:05:09.147379 11617 mini_ranger.cc:193] Using host: 127.11.88.84
I20260806 01:05:09.151252 11617 mini_ranger.cc:227] Ranger admin URL: http://127.11.88.84:39451
Aug 06, 2026 1:05:09 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 1:05:09 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 1:05:09 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 1:05:09 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 1:05:09 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 1:05:10 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 1:05:10 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 01:05:10.278970 11617 mini_ranger.cc:160] Time spent starting Ranger: real 9.528s user 0.000s sys 0.011s
Aug 06, 2026 1:05:31 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 1:05:31 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 06, 2026 1:05:31 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 1:05:32 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 1:05:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 1:05:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 1:05:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 1:05:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 1:05:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 1:05:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 1:05:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 1:05:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 1:05:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 1:05:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 1:05:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 1:05:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 1:05:32 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 1:05:32 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 01:05:33.620205 11617 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.88.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.88.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.88.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/rangerkms_127.11.88.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.88.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/rangerkms_127.11.88.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.88.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.88.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.88.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/HTTP_127.11.88.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.88.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/HTTP_127.11.88.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 01:05:33 dist-test-slave-69rg krb5kdc[23683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978333, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 01:05:33.710366 11617 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 01:05:33.720985 11617 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 01:05:34.720990 11617 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 01:05:34.721091 11617 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ranger-kms
I20260806 01:05:34.721110 11617 mini_ranger_kms.cc:227] Using postgres at 127.11.88.84:34839
2026-08-06 01:05:34,897 [I] DB FLAVOR :POSTGRES
2026-08-06 01:05:34,898 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 01:05:34,898 [I] Checking connection
2026-08-06 01:05:34,898 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:34839/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 01:05:35,158 [I] connection success
2026-08-06 01:05:35,158 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 01:05:35,158 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 01:05:35,158 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:34839/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 01:05:35,435 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 01:05:35,435 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 01:05:35,435 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 01:05:35,435 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.88.84:34839/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 01:05:35,767 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 01:05:36.293164 11617 mini_ranger_kms.cc:310] Created kms service
I20260806 01:05:36.511972 11617 mini_ranger_kms.cc:326] Created kudu user
I20260806 01:05:36.574991 11617 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 01:05:36 dist-test-slave-69rg krb5kdc[23683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978333, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.88.84@KRBTEST.COM
I20260806 01:05:37.009927 11617 mini_ranger_kms.cc:384] Added ranger policy
I20260806 01:05:37.010058 11617 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ranger-kms:/tmp/dist-test-task7A9gSt/build/release/bin/postgresql.jar:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task7A9gSt/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 01:05:37.010080 11617 mini_ranger_kms.cc:240] Using host: 127.11.88.84
I20260806 01:05:37.014534 11617 mini_ranger_kms.cc:276] Ranger KMS PID: 24096
I20260806 01:05:37.014638 11617 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.88.84:55647
Aug 06, 2026 1:05:38 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 1:05:38 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 1:05:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 1:05:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 1:05:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 1:05:38 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260806 01:05:39.331725 11617 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.621s user 0.000s sys 0.162s
I20260806 01:05:39.331851 11617 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 01:05:39.331900 11617 mini_ranger_kms.cc:401] 127.11.88.84:55647/kms/v1/keys
Aug 06 01:05:39 dist-test-slave-69rg krb5kdc[23683](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785978339, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.88.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 06 01:05:39 dist-test-slave-69rg krb5kdc[23683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978339, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.88.84@KRBTEST.COM for HTTP/127.11.88.84@KRBTEST.COM
Aug 06 01:05:40 dist-test-slave-69rg krb5kdc[23683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978339, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.88.84@KRBTEST.COM for HTTP/127.11.88.84@KRBTEST.COM
Aug 06 01:05:42 dist-test-slave-69rg krb5kdc[23683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978342, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:05:42.677461 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:44671
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:40049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:44671
--ranger_config_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.88.84:55647/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:05:42.762089 24146 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:05:42.762322 24146 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:05:42.762346 24146 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:05:42.763612 24146 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:05:42.763660 24146 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:05:42.763676 24146 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:05:42.763695 24146 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:05:42.763706 24146 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:05:42.765364 24146 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.88.84:55647/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:44671
--ranger_config_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:44671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24146
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:05:42.765642 24146 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:05:42.765942 24146 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:05:42.771394 24152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:42.771317 24154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:42.771317 24151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:42.771588 24146 server_base.cc:1034] running on GCE node
I20260806 01:05:42.772019 24146 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:05:42.772424 24146 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:05:42.773638 24146 hybrid_clock.cc:648] HybridClock initialized: now 1785978342773617 us; error 43 us; skew 500 ppm
Aug 06 01:05:42 dist-test-slave-69rg krb5kdc[23683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978342, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:05:42.776773 24146 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:05:42.777302 24146 webserver.cc:460] Webserver started at http://127.11.88.126:37393/ using document root <none> and password file <none>
I20260806 01:05:42.777535 24146 fs_manager.cc:359] Metadata directory not provided
I20260806 01:05:42.777596 24146 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:05:42.777741 24146 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 01:05:42 dist-test-slave-69rg krb5kdc[23683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978342, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for HTTP/127.11.88.84@KRBTEST.COM
I20260806 01:05:42.839588 24146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "0a6ad8d5d2994b24a9dbceb61004474b"
format_stamp: "Formatted at 2026-08-06 01:05:42 on dist-test-slave-69rg"
server_key: "99073f14642216ea5876b9f8040e6029"
server_key_iv: "c8a96980af214227beac8e5ebd61805d"
server_key_version: "kuduclusterkey@0"
I20260806 01:05:42.840013 24146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "0a6ad8d5d2994b24a9dbceb61004474b"
format_stamp: "Formatted at 2026-08-06 01:05:42 on dist-test-slave-69rg"
server_key: "99073f14642216ea5876b9f8040e6029"
server_key_iv: "c8a96980af214227beac8e5ebd61805d"
server_key_version: "kuduclusterkey@0"
I20260806 01:05:42.841501 24146 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:05:42.856300 24162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:42.856540 24146 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:05:42.856673 24146 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "0a6ad8d5d2994b24a9dbceb61004474b"
format_stamp: "Formatted at 2026-08-06 01:05:42 on dist-test-slave-69rg"
server_key: "99073f14642216ea5876b9f8040e6029"
server_key_iv: "c8a96980af214227beac8e5ebd61805d"
server_key_version: "kuduclusterkey@0"
I20260806 01:05:42.856781 24146 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:05:42.871124 24146 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:05:42.873334 24146 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:05:42.873500 24146 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:05:42.878669 24146 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:44671
I20260806 01:05:42.878710 24216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:44671 every 8 connection(s)
I20260806 01:05:42.879082 24146 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:05:42.879801 24217 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:05:42.882164 24217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b: Bootstrap starting.
I20260806 01:05:42.882771 24217 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b: Neither blocks nor log segments found. Creating new log.
I20260806 01:05:42.883077 24217 log.cc:824] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b: Log is configured to *not* fsync() on all Append() calls
I20260806 01:05:42.883800 24217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b: No bootstrap required, opened a new log
I20260806 01:05:42.885102 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 24146
I20260806 01:05:42.885206 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:05:42.885422 11617 external_mini_cluster.cc:1428] Setting key b32d153e4e083cc0725c93d22e244a03
I20260806 01:05:42.886335 24217 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a6ad8d5d2994b24a9dbceb61004474b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44671 } }
I20260806 01:05:42.886528 24217 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:05:42.886582 24217 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6ad8d5d2994b24a9dbceb61004474b, State: Initialized, Role: FOLLOWER
I20260806 01:05:42.886763 24217 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a6ad8d5d2994b24a9dbceb61004474b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44671 } }
I20260806 01:05:42.886884 24217 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:05:42.886936 24217 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:05:42.887005 24217 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:05:42.887754 24217 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a6ad8d5d2994b24a9dbceb61004474b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44671 } }
I20260806 01:05:42.887871 24217 leader_election.cc:302] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0a6ad8d5d2994b24a9dbceb61004474b; no voters:
I20260806 01:05:42.888057 24217 leader_election.cc:288] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:05:42.888105 24222 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:05:42.888399 24222 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [term 1 LEADER]: Becoming Leader. State: Replica: 0a6ad8d5d2994b24a9dbceb61004474b, State: Running, Role: LEADER
I20260806 01:05:42.888432 24217 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:05:42.888566 24222 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a6ad8d5d2994b24a9dbceb61004474b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44671 } }
I20260806 01:05:42.888916 24222 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0a6ad8d5d2994b24a9dbceb61004474b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a6ad8d5d2994b24a9dbceb61004474b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44671 } } }
I20260806 01:05:42.888981 24222 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [sys.catalog]: This master's current role is: LEADER
I20260806 01:05:42.889109 24222 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0a6ad8d5d2994b24a9dbceb61004474b. Latest consensus state: current_term: 1 leader_uuid: "0a6ad8d5d2994b24a9dbceb61004474b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a6ad8d5d2994b24a9dbceb61004474b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44671 } } }
I20260806 01:05:42.889149 24222 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [sys.catalog]: This master's current role is: LEADER
I20260806 01:05:42.889954 24217 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 01:05:42.890051 24231 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:05:42.890547 24231 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 06 01:05:42 dist-test-slave-69rg krb5kdc[23683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978342, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:05:42.899356 24221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:42.886042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49986 (local address 127.11.88.126:44671)
0806 01:05:42.886281 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:42.886291 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:42.886385 (+ 94us) server_negotiation.cc:407] Connection header received
0806 01:05:42.886540 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:42.886548 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:42.886608 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:42.886746 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:42.887746 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:42.889252 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:42.890472 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:42.890978 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:42.891111 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:42.894164 (+ 3053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:42.894206 (+ 42us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:42.894206 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:42.894347 (+ 141us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:42.896997 (+ 2650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:42.897470 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:42.897473 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:42.897474 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:42.897599 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:42.897873 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:42.897874 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:42.897875 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:42.898262 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:42.898868 (+ 606us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:42.898944 (+ 76us) server_negotiation.cc:299] Negotiation successful
0806 01:05:42.899113 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":116,"threads_started":1}
I20260806 01:05:42.903466 24231 catalog_manager.cc:1347] Generated new cluster ID: 4dc4a15f929749d3bf4699f2bcb80d88
I20260806 01:05:42.903533 24231 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:05:42.917016 24231 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:05:42.917938 24231 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:05:42.925668 24231 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b: Generated new TSK 0
I20260806 01:05:42.926096 24231 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.88.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
I20260806 01:05:43.674666 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.88.84:55647/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:0
--local_ip_for_outbound_sockets=127.11.88.65
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:44671
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:40049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:05:43.766897 24264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:05:43.767151 24264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:05:43.767195 24264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:05:43.768419 24264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:05:43.768493 24264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:05:43.768539 24264 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:05:43.770188 24264 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.88.84:55647/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:44671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24264
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:05:43.770470 24264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:05:43.770717 24264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:05:43.776036 24272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:43.776117 24269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:43.776448 24270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:43.776952 24264 server_base.cc:1034] running on GCE node
I20260806 01:05:43.777192 24264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:05:43.777482 24264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:05:43.778723 24264 hybrid_clock.cc:648] HybridClock initialized: now 1785978343778695 us; error 36 us; skew 500 ppm
Aug 06 01:05:43 dist-test-slave-69rg krb5kdc[23683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978343, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:05:43.781965 24264 init.cc:377] Logged in from keytab as kudu/127.11.88.65@KRBTEST.COM (short username kudu)
I20260806 01:05:43.782516 24264 webserver.cc:460] Webserver started at http://127.11.88.65:41073/ using document root <none> and password file <none>
I20260806 01:05:43.782799 24264 fs_manager.cc:359] Metadata directory not provided
I20260806 01:05:43.782874 24264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:05:43.783025 24264 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 01:05:43 dist-test-slave-69rg krb5kdc[23683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978343, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for HTTP/127.11.88.84@KRBTEST.COM
I20260806 01:05:43.799015 24264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/data/instance:
uuid: "6ded07ea411f42ac882e51af893dc66e"
format_stamp: "Formatted at 2026-08-06 01:05:43 on dist-test-slave-69rg"
server_key: "a9ac6f96d922bd6fa1a6367d62857cdc"
server_key_iv: "1df149ff9032726da9198d94b10f4525"
server_key_version: "kuduclusterkey@0"
I20260806 01:05:43.799700 24264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance:
uuid: "6ded07ea411f42ac882e51af893dc66e"
format_stamp: "Formatted at 2026-08-06 01:05:43 on dist-test-slave-69rg"
server_key: "a9ac6f96d922bd6fa1a6367d62857cdc"
server_key_iv: "1df149ff9032726da9198d94b10f4525"
server_key_version: "kuduclusterkey@0"
I20260806 01:05:43.805522 24264 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.000s
I20260806 01:05:43.821543 24279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:43.821790 24264 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260806 01:05:43.821941 24264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "6ded07ea411f42ac882e51af893dc66e"
format_stamp: "Formatted at 2026-08-06 01:05:43 on dist-test-slave-69rg"
server_key: "a9ac6f96d922bd6fa1a6367d62857cdc"
server_key_iv: "1df149ff9032726da9198d94b10f4525"
server_key_version: "kuduclusterkey@0"
I20260806 01:05:43.822075 24264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:05:43.851488 24264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:05:43.854466 24264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:05:43.854660 24264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:05:43.854959 24264 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:05:43.855448 24264 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:05:43.855505 24264 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:43.855540 24264 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:05:43.855597 24264 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:43.863916 24264 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:44955
I20260806 01:05:43.864526 24264 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
I20260806 01:05:43.866145 24399 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:44955 every 8 connection(s)
I20260806 01:05:43.871835 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 24264
I20260806 01:05:43.871987 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance
Aug 06 01:05:43 dist-test-slave-69rg krb5kdc[23683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978343, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:05:43.872218 11617 external_mini_cluster.cc:1428] Setting key 838645bcf30897458b8c1c5748af56f6
I20260806 01:05:43.877131 24403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:43.865598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:41077 (local address 127.11.88.126:44671)
0806 01:05:43.865768 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:43.865771 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:43.866037 (+ 266us) server_negotiation.cc:407] Connection header received
0806 01:05:43.866879 (+ 842us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:43.866880 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:43.866896 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:43.866945 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:43.867822 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:43.868409 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:43.869576 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:43.869885 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:43.869988 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:43.873036 (+ 3048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:43.873038 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:43.873039 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:43.873049 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:43.875158 (+ 2109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:43.875787 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:43.875789 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:43.875789 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:43.875869 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:43.876246 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:43.876248 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:43.876248 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:43.876414 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:43.876493 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:43.876914 (+ 421us) server_negotiation.cc:299] Negotiation successful
0806 01:05:43.877019 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":91,"threads_started":1}
I20260806 01:05:43.877319 24402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:43.865565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44671 (local address 127.11.88.65:41077)
0806 01:05:43.865890 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:43.865942 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:43.866735 (+ 793us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:43.867145 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:43.867150 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:43.867410 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:05:43.867689 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:43.867696 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:43.868539 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:43.868541 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:43.869455 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:43.869458 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:43.870024 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:43.870026 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:43.870164 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:43.870843 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:05:43.870853 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:05:43.872857 (+ 2004us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:05:43.875283 (+ 2426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:43.875295 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:43.875299 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:43.875689 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:43.875972 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:43.875974 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:43.875974 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:43.876147 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:43.876514 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:05:43.876521 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:05:43.876731 (+ 210us) client_negotiation.cc:769] Sending connection context
0806 01:05:43.876865 (+ 134us) client_negotiation.cc:240] Negotiation successful
0806 01:05:43.877048 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":88,"threads_started":1}
I20260806 01:05:43.878018 24400 heartbeater.cc:347] Connected to a master server at 127.11.88.126:44671
I20260806 01:05:43.878159 24400 heartbeater.cc:464] Registering TS with master...
I20260806 01:05:43.878388 24400 heartbeater.cc:511] Master 127.11.88.126:44671 requested a full tablet report, sending...
I20260806 01:05:43.879024 24179 ts_manager.cc:194] Registered new tserver with Master: 6ded07ea411f42ac882e51af893dc66e (127.11.88.65:44955)
I20260806 01:05:43.879976 24179 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.65@KRBTEST.COM'} at 127.11.88.65:41077
WARNING: no policy specified for kudu/127.11.88.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
I20260806 01:05:43.914690 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.88.84:55647/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:0
--local_ip_for_outbound_sockets=127.11.88.66
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:44671
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:40049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 01:05:44 dist-test-slave-69rg krb5kdc[23683](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785978344, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260806 01:05:44.040855 24406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:05:44.041234 24406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:05:44.041278 24406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:05:44.043404 24406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:05:44.043488 24406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:05:44.043534 24406 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:05:44.046092 24406 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.88.84:55647/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:44671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24406
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:05:44.046425 24406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:05:44.046727 24406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:05:44.053918 24417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:44.054432 24415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:44.054718 24414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:44.055207 24406 server_base.cc:1034] running on GCE node
I20260806 01:05:44.055481 24406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:05:44.055811 24406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:05:44.057072 24406 hybrid_clock.cc:648] HybridClock initialized: now 1785978344057039 us; error 49 us; skew 500 ppm
Aug 06 01:05:44 dist-test-slave-69rg krb5kdc[23683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978344, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:05:44.060868 24406 init.cc:377] Logged in from keytab as kudu/127.11.88.66@KRBTEST.COM (short username kudu)
I20260806 01:05:44.061458 24406 webserver.cc:460] Webserver started at http://127.11.88.66:33951/ using document root <none> and password file <none>
I20260806 01:05:44.061753 24406 fs_manager.cc:359] Metadata directory not provided
I20260806 01:05:44.061843 24406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:05:44.061988 24406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 01:05:44 dist-test-slave-69rg krb5kdc[23683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978344, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for HTTP/127.11.88.84@KRBTEST.COM
I20260806 01:05:44.083856 24406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/data/instance:
uuid: "3bf2b6475a584b8badf5e2ba245d1550"
format_stamp: "Formatted at 2026-08-06 01:05:44 on dist-test-slave-69rg"
server_key: "7c5b9bd8fa1427f6a8e0d63f180fad70"
server_key_iv: "91b7455c2c22587d6ab25072b0c7b977"
server_key_version: "kuduclusterkey@0"
I20260806 01:05:44.085752 24406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance:
uuid: "3bf2b6475a584b8badf5e2ba245d1550"
format_stamp: "Formatted at 2026-08-06 01:05:44 on dist-test-slave-69rg"
server_key: "7c5b9bd8fa1427f6a8e0d63f180fad70"
server_key_iv: "91b7455c2c22587d6ab25072b0c7b977"
server_key_version: "kuduclusterkey@0"
I20260806 01:05:44.088078 24406 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260806 01:05:44.103269 24424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:44.103649 24406 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:05:44.103762 24406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "3bf2b6475a584b8badf5e2ba245d1550"
format_stamp: "Formatted at 2026-08-06 01:05:44 on dist-test-slave-69rg"
server_key: "7c5b9bd8fa1427f6a8e0d63f180fad70"
server_key_iv: "91b7455c2c22587d6ab25072b0c7b977"
server_key_version: "kuduclusterkey@0"
I20260806 01:05:44.103874 24406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:05:44.115139 24406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:05:44.118022 24406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:05:44.118299 24406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:05:44.118590 24406 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:05:44.119035 24406 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:05:44.119148 24406 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:44.119241 24406 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:05:44.119309 24406 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:44.126533 24406 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:42831
I20260806 01:05:44.127125 24406 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
I20260806 01:05:44.131131 24542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:42831 every 8 connection(s)
I20260806 01:05:44.134404 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 24406
I20260806 01:05:44.134531 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance
I20260806 01:05:44.134743 11617 external_mini_cluster.cc:1428] Setting key 5671b1f2d03e0ddc82cafc153225875a
Aug 06 01:05:44 dist-test-slave-69rg krb5kdc[23683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978344, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.88.67@KRBTEST.COM; defaulting to no policy
I20260806 01:05:44.156339 24403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:44.132306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:50259 (local address 127.11.88.126:44671)
0806 01:05:44.132362 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:44.132365 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:44.139029 (+ 6664us) server_negotiation.cc:407] Connection header received
0806 01:05:44.139855 (+ 826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:44.139856 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:44.139876 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:44.139911 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:44.140885 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:44.141784 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:44.147514 (+ 5730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:44.147889 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:44.147947 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:44.151469 (+ 3522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:44.151471 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:44.151471 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:44.151482 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:44.153654 (+ 2172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:44.154309 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:44.154311 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:44.154311 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:44.154390 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:44.155100 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:44.155101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:44.155101 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:44.155277 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:44.155339 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:44.156077 (+ 738us) server_negotiation.cc:299] Negotiation successful
0806 01:05:44.156197 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.67@KRBTEST.COM" created.
I20260806 01:05:44.161226 24545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:44.131947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44671 (local address 127.11.88.66:50259)
0806 01:05:44.138858 (+ 6911us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:44.138925 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:44.139707 (+ 782us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:44.140145 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:44.140152 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:44.140439 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:05:44.140750 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:44.140756 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:44.144587 (+ 3831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:44.144588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:44.146103 (+ 1515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:44.146106 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:44.148091 (+ 1985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:44.148092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:44.148266 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:44.149211 (+ 945us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:05:44.149224 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:05:44.151322 (+ 2098us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:05:44.153782 (+ 2460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:44.153792 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:44.153796 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:44.154181 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:44.154474 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:44.154475 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:44.154475 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:44.154996 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:44.155379 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:05:44.155386 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:05:44.155646 (+ 260us) client_negotiation.cc:769] Sending connection context
0806 01:05:44.156789 (+ 1143us) client_negotiation.cc:240] Negotiation successful
0806 01:05:44.157097 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6843,"thread_start_us":131,"threads_started":1}
I20260806 01:05:44.162132 24543 heartbeater.cc:347] Connected to a master server at 127.11.88.126:44671
I20260806 01:05:44.162245 24543 heartbeater.cc:464] Registering TS with master...
I20260806 01:05:44.162464 24543 heartbeater.cc:511] Master 127.11.88.126:44671 requested a full tablet report, sending...
I20260806 01:05:44.162931 24179 ts_manager.cc:194] Registered new tserver with Master: 3bf2b6475a584b8badf5e2ba245d1550 (127.11.88.66:42831)
I20260806 01:05:44.163493 24179 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.66@KRBTEST.COM'} at 127.11.88.66:50259
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
I20260806 01:05:44.186050 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.88.84:55647/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:0
--local_ip_for_outbound_sockets=127.11.88.67
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:44671
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:40049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:05:44.340437 24548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:05:44.340826 24548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:05:44.340922 24548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:05:44.342868 24548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:05:44.343014 24548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:05:44.343122 24548 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:05:44.345548 24548 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.88.84:55647/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:44671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24548
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:05:44.346068 24548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:05:44.346433 24548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:05:44.354637 24557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:44.356947 24554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:44.357278 24555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:44.358644 24548 server_base.cc:1034] running on GCE node
I20260806 01:05:44.359050 24548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:05:44.359408 24548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:05:44.360611 24548 hybrid_clock.cc:648] HybridClock initialized: now 1785978344360588 us; error 49 us; skew 500 ppm
Aug 06 01:05:44 dist-test-slave-69rg krb5kdc[23683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978344, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:05:44.364503 24548 init.cc:377] Logged in from keytab as kudu/127.11.88.67@KRBTEST.COM (short username kudu)
I20260806 01:05:44.365159 24548 webserver.cc:460] Webserver started at http://127.11.88.67:35541/ using document root <none> and password file <none>
I20260806 01:05:44.365499 24548 fs_manager.cc:359] Metadata directory not provided
I20260806 01:05:44.365584 24548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:05:44.365738 24548 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 01:05:44 dist-test-slave-69rg krb5kdc[23683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978344, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for HTTP/127.11.88.84@KRBTEST.COM
I20260806 01:05:44.382757 24548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/data/instance:
uuid: "2cf244f2446547f2869564b125ddef44"
format_stamp: "Formatted at 2026-08-06 01:05:44 on dist-test-slave-69rg"
server_key: "e1cd756c6a0ac43577d3b3c511061695"
server_key_iv: "7e8d79d6309b30405c27939fbdedf9fd"
server_key_version: "kuduclusterkey@0"
I20260806 01:05:44.383409 24548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance:
uuid: "2cf244f2446547f2869564b125ddef44"
format_stamp: "Formatted at 2026-08-06 01:05:44 on dist-test-slave-69rg"
server_key: "e1cd756c6a0ac43577d3b3c511061695"
server_key_iv: "7e8d79d6309b30405c27939fbdedf9fd"
server_key_version: "kuduclusterkey@0"
I20260806 01:05:44.394356 24548 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.002s sys 0.000s
I20260806 01:05:44.411324 24564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:44.411999 24548 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260806 01:05:44.412127 24548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "2cf244f2446547f2869564b125ddef44"
format_stamp: "Formatted at 2026-08-06 01:05:44 on dist-test-slave-69rg"
server_key: "e1cd756c6a0ac43577d3b3c511061695"
server_key_iv: "7e8d79d6309b30405c27939fbdedf9fd"
server_key_version: "kuduclusterkey@0"
I20260806 01:05:44.412226 24548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:05:44.426270 24548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:05:44.431088 24548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:05:44.431281 24548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:05:44.431576 24548 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:05:44.432015 24548 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:05:44.432067 24548 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:44.432111 24548 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:05:44.432132 24548 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:44.441071 24548 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:43217
I20260806 01:05:44.441620 24548 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
I20260806 01:05:44.442006 24681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:43217 every 8 connection(s)
I20260806 01:05:44.446947 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 24548
I20260806 01:05:44.447052 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance
I20260806 01:05:44.447258 11617 external_mini_cluster.cc:1428] Setting key cbe75f464020ee1f5df999ef3b2c3cbf
Aug 06 01:05:44 dist-test-slave-69rg krb5kdc[23683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978344, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:05:44.454967 24403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:44.442904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:59681 (local address 127.11.88.126:44671)
0806 01:05:44.442956 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:44.442958 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:44.443227 (+ 269us) server_negotiation.cc:407] Connection header received
0806 01:05:44.443970 (+ 743us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:44.443972 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:44.443985 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:44.444019 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:44.444919 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:44.445729 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:44.447295 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:44.447618 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:44.447663 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:44.450522 (+ 2859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:44.450525 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:44.450525 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:44.450534 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:44.452330 (+ 1796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:44.452877 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:44.452879 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:44.452879 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:44.452954 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:44.454142 (+ 1188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:44.454143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:44.454144 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:44.454298 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:44.454342 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:44.454789 (+ 447us) server_negotiation.cc:299] Negotiation successful
0806 01:05:44.454874 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 01:05:44.455845 24684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:44.442903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44671 (local address 127.11.88.67:59681)
0806 01:05:44.443082 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:44.443132 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:44.443830 (+ 698us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:44.444218 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:44.444223 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:44.444492 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:05:44.444794 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:44.444801 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:44.445880 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:44.445881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:44.447180 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:44.447183 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:44.447908 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:44.447910 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:44.448063 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:44.448678 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:05:44.448689 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:05:44.450396 (+ 1707us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:05:44.452437 (+ 2041us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:44.452444 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:44.452447 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:44.452773 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:44.453901 (+ 1128us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:44.453902 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:44.453902 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:44.454051 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:44.454441 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:05:44.454447 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:05:44.454628 (+ 181us) client_negotiation.cc:769] Sending connection context
0806 01:05:44.455431 (+ 803us) client_negotiation.cc:240] Negotiation successful
0806 01:05:44.455608 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":98,"threads_started":1}
I20260806 01:05:44.456509 24682 heartbeater.cc:347] Connected to a master server at 127.11.88.126:44671
I20260806 01:05:44.456640 24682 heartbeater.cc:464] Registering TS with master...
I20260806 01:05:44.456864 24682 heartbeater.cc:511] Master 127.11.88.126:44671 requested a full tablet report, sending...
I20260806 01:05:44.457304 24179 ts_manager.cc:194] Registered new tserver with Master: 2cf244f2446547f2869564b125ddef44 (127.11.88.67:43217)
I20260806 01:05:44.457787 24179 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.67@KRBTEST.COM'} at 127.11.88.67:59681
I20260806 01:05:44.459349 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 01:05:44.460170 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 24264
I20260806 01:05:44.470961 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 24406
I20260806 01:05:44.476643 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 24548
I20260806 01:05:44.483177 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 24146
I20260806 01:05:44.489483 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:44671
--webserver_interface=127.11.88.126
--webserver_port=37393
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:40049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:44671
--ranger_config_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.88.84:55647/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.88.84:55647/kms with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:05:44.577384 24685 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:05:44.577598 24685 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:05:44.577621 24685 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:05:44.578896 24685 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:05:44.578944 24685 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:05:44.578959 24685 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:05:44.578972 24685 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:05:44.578984 24685 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:05:44.580657 24685 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.88.84:55647/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:44671
--ranger_config_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:44671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=37393
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24685
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:05:44.580894 24685 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:05:44.581164 24685 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:05:44.586321 24691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:44.586369 24692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:44.586407 24685 server_base.cc:1034] running on GCE node
W20260806 01:05:44.586529 24694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:44.586797 24685 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:05:44.587158 24685 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:05:44.588366 24685 hybrid_clock.cc:648] HybridClock initialized: now 1785978344588340 us; error 61 us; skew 500 ppm
Aug 06 01:05:44 dist-test-slave-69rg krb5kdc[23683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978344, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:05:44.591223 24685 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:05:44.591679 24685 webserver.cc:460] Webserver started at http://127.11.88.126:37393/ using document root <none> and password file <none>
I20260806 01:05:44.591924 24685 fs_manager.cc:359] Metadata directory not provided
I20260806 01:05:44.592005 24685 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 01:05:44 dist-test-slave-69rg krb5kdc[23683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978344, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for HTTP/127.11.88.84@KRBTEST.COM
I20260806 01:05:44.638550 24685 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:05:44.639405 24702 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:44.639642 24685 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:05:44.639760 24685 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "0a6ad8d5d2994b24a9dbceb61004474b"
format_stamp: "Formatted at 2026-08-06 01:05:42 on dist-test-slave-69rg"
server_key: "99073f14642216ea5876b9f8040e6029"
server_key_iv: "c8a96980af214227beac8e5ebd61805d"
server_key_version: "kuduclusterkey@0"
I20260806 01:05:44.640213 24685 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:05:44.663812 24685 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:05:44.666049 24685 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:05:44.666297 24685 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:05:44.670763 24685 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:44671
I20260806 01:05:44.670821 24754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:44671 every 8 connection(s)
I20260806 01:05:44.671218 24685 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:05:44.672546 24755 sys_catalog.cc:263] Verifying existing consensus state
I20260806 01:05:44.673324 24755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b: Bootstrap starting.
I20260806 01:05:44.676113 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 24685
I20260806 01:05:44.676497 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.88.84:55647/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:44955
--local_ip_for_outbound_sockets=127.11.88.65
--tserver_master_addrs=127.11.88.126:44671
--webserver_port=41073
--webserver_interface=127.11.88.65
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:40049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.88.84:55647/kms with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 01:05:44.682972 24755 log.cc:824] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b: Log is configured to *not* fsync() on all Append() calls
I20260806 01:05:44.685086 24755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 01:05:44.685441 24755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b: Bootstrap complete.
I20260806 01:05:44.688184 24755 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a6ad8d5d2994b24a9dbceb61004474b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44671 } }
I20260806 01:05:44.688450 24755 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a6ad8d5d2994b24a9dbceb61004474b, State: Initialized, Role: FOLLOWER
I20260806 01:05:44.688650 24755 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a6ad8d5d2994b24a9dbceb61004474b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44671 } }
I20260806 01:05:44.688735 24755 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:05:44.688802 24755 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:05:44.688856 24755 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [term 1 FOLLOWER]: Advancing to term 2
I20260806 01:05:44.690094 24755 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a6ad8d5d2994b24a9dbceb61004474b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44671 } }
I20260806 01:05:44.690223 24755 leader_election.cc:302] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0a6ad8d5d2994b24a9dbceb61004474b; no voters:
I20260806 01:05:44.690472 24755 leader_election.cc:288] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 01:05:44.690516 24759 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [term 2 FOLLOWER]: Leader election won for term 2
I20260806 01:05:44.690690 24759 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [term 2 LEADER]: Becoming Leader. State: Replica: 0a6ad8d5d2994b24a9dbceb61004474b, State: Running, Role: LEADER
I20260806 01:05:44.690795 24755 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:05:44.690899 24759 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a6ad8d5d2994b24a9dbceb61004474b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44671 } }
I20260806 01:05:44.691231 24759 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0a6ad8d5d2994b24a9dbceb61004474b. Latest consensus state: current_term: 2 leader_uuid: "0a6ad8d5d2994b24a9dbceb61004474b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a6ad8d5d2994b24a9dbceb61004474b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44671 } } }
I20260806 01:05:44.691239 24761 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "0a6ad8d5d2994b24a9dbceb61004474b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a6ad8d5d2994b24a9dbceb61004474b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44671 } } }
I20260806 01:05:44.691390 24759 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [sys.catalog]: This master's current role is: LEADER
I20260806 01:05:44.691629 24761 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b [sys.catalog]: This master's current role is: LEADER
I20260806 01:05:44.691905 24767 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:05:44.692515 24767 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:05:44.692670 24767 catalog_manager.cc:1259] Loaded cluster ID: 4dc4a15f929749d3bf4699f2bcb80d88
I20260806 01:05:44.692766 24767 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:05:44.693010 24755 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 01:05:44.693984 24767 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:05:44.694257 24767 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b: Loaded TSK: 0
I20260806 01:05:44.694551 24767 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 01:05:44.801718 24757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:05:44.802166 24757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:05:44.802278 24757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:05:44.804352 24757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:05:44.804610 24757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:05:44.804733 24757 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:05:44.807332 24757 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.88.84:55647/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:44955
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=41073
--tserver_master_addrs=127.11.88.126:44671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24757
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:05:44.807612 24757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:05:44.807955 24757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:05:44.814561 24794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:44.814567 24796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:44.814582 24793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:44.815304 24757 server_base.cc:1034] running on GCE node
I20260806 01:05:44.815527 24757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:05:44.815816 24757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:05:44.831328 24757 hybrid_clock.cc:648] HybridClock initialized: now 1785978344830789 us; error 551 us; skew 500 ppm
Aug 06 01:05:44 dist-test-slave-69rg krb5kdc[23683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978344, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:05:44.835160 24757 init.cc:377] Logged in from keytab as kudu/127.11.88.65@KRBTEST.COM (short username kudu)
I20260806 01:05:44.835778 24757 webserver.cc:460] Webserver started at http://127.11.88.65:41073/ using document root <none> and password file <none>
I20260806 01:05:44.836124 24757 fs_manager.cc:359] Metadata directory not provided
I20260806 01:05:44.836220 24757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 01:05:44 dist-test-slave-69rg krb5kdc[23683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978344, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for HTTP/127.11.88.84@KRBTEST.COM
I20260806 01:05:44.877357 24757 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260806 01:05:44.886520 24805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:44.886818 24757 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.001s sys 0.000s
I20260806 01:05:44.886930 24757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "6ded07ea411f42ac882e51af893dc66e"
format_stamp: "Formatted at 2026-08-06 01:05:43 on dist-test-slave-69rg"
server_key: "a9ac6f96d922bd6fa1a6367d62857cdc"
server_key_iv: "1df149ff9032726da9198d94b10f4525"
server_key_version: "kuduclusterkey@0"
I20260806 01:05:44.887487 24757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:05:44.908362 24757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:05:44.910981 24757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:05:44.911201 24757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:05:44.911495 24757 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:05:44.911939 24757 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:05:44.912005 24757 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:44.912052 24757 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:05:44.912087 24757 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:44.919591 24757 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:44955
I20260806 01:05:44.920073 24757 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
I20260806 01:05:44.921025 24922 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:44955 every 8 connection(s)
I20260806 01:05:44.927227 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 24757
I20260806 01:05:44.927580 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.88.84:55647/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:42831
--local_ip_for_outbound_sockets=127.11.88.66
--tserver_master_addrs=127.11.88.126:44671
--webserver_port=33951
--webserver_interface=127.11.88.66
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:40049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.88.84:55647/kms with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 01:05:44 dist-test-slave-69rg krb5kdc[23683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978344, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:05:44.937908 24925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:44.921687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44671 (local address 127.11.88.65:35019)
0806 01:05:44.922067 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:44.922124 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:44.922795 (+ 671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:44.923456 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:44.923461 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:44.923715 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:05:44.923991 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:44.923996 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:44.925936 (+ 1940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:44.925937 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:44.930254 (+ 4317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:44.930261 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:44.931235 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:44.931237 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:44.931396 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:44.932105 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:05:44.932116 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:05:44.933601 (+ 1485us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:05:44.935936 (+ 2335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:44.935945 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:44.935948 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:44.936226 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:44.936540 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:44.936541 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:44.936541 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:44.936673 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:44.937119 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:05:44.937126 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:05:44.937285 (+ 159us) client_negotiation.cc:769] Sending connection context
0806 01:05:44.937404 (+ 119us) client_negotiation.cc:240] Negotiation successful
0806 01:05:44.937607 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":90,"threads_started":1}
I20260806 01:05:44.937896 24926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:44.922057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:35019 (local address 127.11.88.126:44671)
0806 01:05:44.922291 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:44.922300 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:44.922341 (+ 41us) server_negotiation.cc:407] Connection header received
0806 01:05:44.923052 (+ 711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:44.923059 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:44.923136 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:44.923281 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:44.924158 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:44.925586 (+ 1428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:44.930420 (+ 4834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:44.931051 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:44.931218 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:44.933762 (+ 2544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:44.933769 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:44.933769 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:44.933784 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:44.935815 (+ 2031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:44.936334 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:44.936338 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:44.936339 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:44.936449 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:44.936749 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:44.936750 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:44.936751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:44.937034 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:44.937144 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:44.937479 (+ 335us) server_negotiation.cc:299] Negotiation successful
0806 01:05:44.937623 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":87,"threads_started":1}
I20260806 01:05:44.939242 24923 heartbeater.cc:347] Connected to a master server at 127.11.88.126:44671
I20260806 01:05:44.939374 24923 heartbeater.cc:464] Registering TS with master...
I20260806 01:05:44.939591 24923 heartbeater.cc:511] Master 127.11.88.126:44671 requested a full tablet report, sending...
W20260806 01:05:44.940495 24923 heartbeater.cc:644] Failed to heartbeat to 127.11.88.126:44671 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 01:05:44.940586 24923 heartbeater.cc:464] Registering TS with master...
I20260806 01:05:44.940663 24923 heartbeater.cc:511] Master 127.11.88.126:44671 requested a full tablet report, sending...
I20260806 01:05:44.940981 24923 heartbeater.cc:464] Registering TS with master...
I20260806 01:05:44.941075 24923 heartbeater.cc:511] Master 127.11.88.126:44671 requested a full tablet report, sending...
W20260806 01:05:44.941380 24923 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 01:05:45.060015 24927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:05:45.060359 24927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:05:45.060411 24927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:05:45.062476 24927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:05:45.062556 24927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:05:45.062604 24927 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:05:45.065201 24927 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.88.84:55647/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:42831
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=33951
--tserver_master_addrs=127.11.88.126:44671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24927
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:05:45.065534 24927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:05:45.065892 24927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:05:45.071846 24935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:45.071852 24933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:45.072233 24927 server_base.cc:1034] running on GCE node
W20260806 01:05:45.071825 24932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:45.072548 24927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:05:45.072870 24927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:05:45.074034 24927 hybrid_clock.cc:648] HybridClock initialized: now 1785978345074018 us; error 30 us; skew 500 ppm
Aug 06 01:05:45 dist-test-slave-69rg krb5kdc[23683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978345, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:05:45.077507 24927 init.cc:377] Logged in from keytab as kudu/127.11.88.66@KRBTEST.COM (short username kudu)
I20260806 01:05:45.078336 24927 webserver.cc:460] Webserver started at http://127.11.88.66:33951/ using document root <none> and password file <none>
I20260806 01:05:45.078631 24927 fs_manager.cc:359] Metadata directory not provided
I20260806 01:05:45.078728 24927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 01:05:45 dist-test-slave-69rg krb5kdc[23683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978345, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for HTTP/127.11.88.84@KRBTEST.COM
I20260806 01:05:45.094460 24927 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:05:45.095465 24944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:45.095651 24927 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:05:45.095752 24927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "3bf2b6475a584b8badf5e2ba245d1550"
format_stamp: "Formatted at 2026-08-06 01:05:44 on dist-test-slave-69rg"
server_key: "7c5b9bd8fa1427f6a8e0d63f180fad70"
server_key_iv: "91b7455c2c22587d6ab25072b0c7b977"
server_key_version: "kuduclusterkey@0"
I20260806 01:05:45.096163 24927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:05:45.127097 24927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:05:45.129112 24927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:05:45.129323 24927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:05:45.129635 24927 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:05:45.130079 24927 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:05:45.130141 24927 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:45.130182 24927 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:05:45.130209 24927 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:45.141480 24927 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:42831
I20260806 01:05:45.143121 25060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:42831 every 8 connection(s)
I20260806 01:05:45.143683 24927 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
Aug 06 01:05:45 dist-test-slave-69rg krb5kdc[23683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978345, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:05:45.153314 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 24927
I20260806 01:05:45.153668 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.88.84:55647/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:43217
--local_ip_for_outbound_sockets=127.11.88.67
--tserver_master_addrs=127.11.88.126:44671
--webserver_port=35541
--webserver_interface=127.11.88.67
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:40049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.88.84:55647/kms with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 01:05:45.159302 24926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:45.145469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:56593 (local address 127.11.88.126:44671)
0806 01:05:45.145519 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:45.145522 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:45.146007 (+ 485us) server_negotiation.cc:407] Connection header received
0806 01:05:45.146639 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:45.146641 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:45.146658 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:45.146689 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:45.147522 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:45.148340 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:45.149908 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:45.150225 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:45.150327 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:45.153891 (+ 3564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:45.153892 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:45.153893 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:45.153903 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:45.157460 (+ 3557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:45.158198 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:45.158201 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:45.158201 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:45.158270 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:45.158542 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:45.158543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:45.158543 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:45.158681 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:45.158734 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:45.159083 (+ 349us) server_negotiation.cc:299] Negotiation successful
0806 01:05:45.159194 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 01:05:45.159873 25063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:45.145165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44671 (local address 127.11.88.66:56593)
0806 01:05:45.145856 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:45.145905 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:45.146507 (+ 602us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:45.146883 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:45.146887 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:45.147131 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:05:45.147405 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:45.147412 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:45.148462 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:45.148463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:45.149790 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:45.149793 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:45.150367 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:45.150368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:45.150513 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:45.151160 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:05:45.151171 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:05:45.152988 (+ 1817us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:05:45.157587 (+ 4599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:45.157612 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:45.157615 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:45.158077 (+ 462us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:45.158343 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:45.158344 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:45.158344 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:45.158475 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:45.158763 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:05:45.158768 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:05:45.158940 (+ 172us) client_negotiation.cc:769] Sending connection context
0806 01:05:45.159453 (+ 513us) client_negotiation.cc:240] Negotiation successful
0806 01:05:45.159631 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":100,"threads_started":1}
I20260806 01:05:45.160363 25061 heartbeater.cc:347] Connected to a master server at 127.11.88.126:44671
I20260806 01:05:45.160494 25061 heartbeater.cc:464] Registering TS with master...
I20260806 01:05:45.160744 25061 heartbeater.cc:511] Master 127.11.88.126:44671 requested a full tablet report, sending...
W20260806 01:05:45.161487 25061 heartbeater.cc:644] Failed to heartbeat to 127.11.88.126:44671 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 01:05:45.161588 25061 heartbeater.cc:464] Registering TS with master...
I20260806 01:05:45.161671 25061 heartbeater.cc:511] Master 127.11.88.126:44671 requested a full tablet report, sending...
I20260806 01:05:45.162102 25061 heartbeater.cc:464] Registering TS with master...
I20260806 01:05:45.162195 25061 heartbeater.cc:511] Master 127.11.88.126:44671 requested a full tablet report, sending...
W20260806 01:05:45.162544 25061 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 01:05:45.271113 25064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:05:45.271358 25064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:05:45.271385 25064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:05:45.273191 25064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:05:45.273272 25064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:05:45.273315 25064 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:05:45.275602 25064 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.88.84:55647/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:43217
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=35541
--tserver_master_addrs=127.11.88.126:44671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25064
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:05:45.275874 25064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:05:45.276162 25064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:05:45.282058 25070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:45.282061 25074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:45.282769 25064 server_base.cc:1034] running on GCE node
W20260806 01:05:45.285249 25072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:45.285602 25064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:05:45.286005 25064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:05:45.287207 25064 hybrid_clock.cc:648] HybridClock initialized: now 1785978345287154 us; error 65 us; skew 500 ppm
Aug 06 01:05:45 dist-test-slave-69rg krb5kdc[23683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978345, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:05:45.290681 25064 init.cc:377] Logged in from keytab as kudu/127.11.88.67@KRBTEST.COM (short username kudu)
I20260806 01:05:45.291347 25064 webserver.cc:460] Webserver started at http://127.11.88.67:35541/ using document root <none> and password file <none>
I20260806 01:05:45.291656 25064 fs_manager.cc:359] Metadata directory not provided
I20260806 01:05:45.291749 25064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 01:05:45 dist-test-slave-69rg krb5kdc[23683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978345, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for HTTP/127.11.88.84@KRBTEST.COM
I20260806 01:05:45.315609 25064 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260806 01:05:45.316876 25082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:45.317217 25064 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:05:45.317337 25064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "2cf244f2446547f2869564b125ddef44"
format_stamp: "Formatted at 2026-08-06 01:05:44 on dist-test-slave-69rg"
server_key: "e1cd756c6a0ac43577d3b3c511061695"
server_key_iv: "7e8d79d6309b30405c27939fbdedf9fd"
server_key_version: "kuduclusterkey@0"
I20260806 01:05:45.317883 25064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:05:45.341215 25064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:05:45.344146 25064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:05:45.344336 25064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:05:45.344627 25064 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:05:45.345055 25064 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:05:45.345111 25064 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:45.345144 25064 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:05:45.345162 25064 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:45.352988 25064 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:43217
I20260806 01:05:45.353502 25064 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
I20260806 01:05:45.354072 25200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:43217 every 8 connection(s)
Aug 06 01:05:45 dist-test-slave-69rg krb5kdc[23683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978345, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:05:45.362624 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 25064
I20260806 01:05:45.368769 24926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:45.354787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:50089 (local address 127.11.88.126:44671)
0806 01:05:45.354843 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:45.354846 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:45.355072 (+ 226us) server_negotiation.cc:407] Connection header received
0806 01:05:45.355832 (+ 760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:45.355834 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:45.355850 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:45.355886 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:45.356817 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:45.357702 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:45.359444 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:45.359804 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:45.359855 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:45.363888 (+ 4033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:45.363889 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:45.363890 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:45.363898 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:45.365881 (+ 1983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:45.366442 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:45.366443 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:45.366444 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:45.366519 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:45.366893 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:45.366895 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:45.366895 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:45.367055 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:45.367106 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:45.368547 (+ 1441us) server_negotiation.cc:299] Negotiation successful
0806 01:05:45.368648 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 01:05:45.369644 25203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:45.354390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44671 (local address 127.11.88.67:50089)
0806 01:05:45.354934 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:45.354984 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:45.355666 (+ 682us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:45.356097 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:45.356103 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:45.356363 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:05:45.356673 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:45.356680 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:45.357873 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:45.357875 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:45.359324 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:45.359328 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:45.359980 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:45.359981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:45.360132 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:45.360828 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:05:45.360839 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:05:45.363758 (+ 2919us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:05:45.365992 (+ 2234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:45.366001 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:45.366004 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:45.366347 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:45.366616 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:45.366617 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:45.366618 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:45.366796 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:45.367161 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:05:45.367168 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:05:45.367356 (+ 188us) client_negotiation.cc:769] Sending connection context
0806 01:05:45.369172 (+ 1816us) client_negotiation.cc:240] Negotiation successful
0806 01:05:45.369377 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":85,"threads_started":1}
I20260806 01:05:45.370414 25201 heartbeater.cc:347] Connected to a master server at 127.11.88.126:44671
I20260806 01:05:45.370518 25201 heartbeater.cc:464] Registering TS with master...
I20260806 01:05:45.370746 25201 heartbeater.cc:511] Master 127.11.88.126:44671 requested a full tablet report, sending...
W20260806 01:05:45.371528 25201 heartbeater.cc:644] Failed to heartbeat to 127.11.88.126:44671 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 01:05:45.371623 25201 heartbeater.cc:464] Registering TS with master...
I20260806 01:05:45.371711 25201 heartbeater.cc:511] Master 127.11.88.126:44671 requested a full tablet report, sending...
I20260806 01:05:45.372031 25201 heartbeater.cc:464] Registering TS with master...
I20260806 01:05:45.372117 25201 heartbeater.cc:511] Master 127.11.88.126:44671 requested a full tablet report, sending...
W20260806 01:05:45.372452 25201 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 01:05:45.375349 25205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:45.363264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50002 (local address 127.11.88.126:44671)
0806 01:05:45.365955 (+ 2691us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:45.365957 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:45.365968 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:05:45.365994 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:45.365995 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:45.366010 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:45.366091 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:45.367493 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:45.368396 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:45.370297 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:45.370626 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:45.370710 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:45.372300 (+ 1590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:45.372301 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:45.372302 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:45.372309 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:45.374064 (+ 1755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:45.374519 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:45.374520 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:45.374521 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:45.374584 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:45.374837 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:45.374838 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:45.374838 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:45.374952 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:45.375080 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:45.375193 (+ 113us) server_negotiation.cc:299] Negotiation successful
0806 01:05:45.375266 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2655,"thread_start_us":79,"threads_started":1}
Aug 06 01:05:45 dist-test-slave-69rg krb5kdc[23683](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785978345, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:05:45.941614 24923 heartbeater.cc:464] Registering TS with master...
I20260806 01:05:45.941792 24923 heartbeater.cc:511] Master 127.11.88.126:44671 requested a full tablet report, sending...
I20260806 01:05:45.942245 24719 ts_manager.cc:194] Registered new tserver with Master: 6ded07ea411f42ac882e51af893dc66e (127.11.88.65:44955)
I20260806 01:05:45.943275 24719 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.65@KRBTEST.COM'} at 127.11.88.65:35019
I20260806 01:05:46.162734 25061 heartbeater.cc:464] Registering TS with master...
I20260806 01:05:46.162895 25061 heartbeater.cc:511] Master 127.11.88.126:44671 requested a full tablet report, sending...
I20260806 01:05:46.163161 24719 ts_manager.cc:194] Registered new tserver with Master: 3bf2b6475a584b8badf5e2ba245d1550 (127.11.88.66:42831)
I20260806 01:05:46.163581 24719 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.66@KRBTEST.COM'} at 127.11.88.66:56593
Aug 06 01:05:46 dist-test-slave-69rg krb5kdc[23683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978345, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for HTTP/127.11.88.84@KRBTEST.COM
I20260806 01:05:46.372679 25201 heartbeater.cc:464] Registering TS with master...
I20260806 01:05:46.372879 25201 heartbeater.cc:511] Master 127.11.88.126:44671 requested a full tablet report, sending...
I20260806 01:05:46.373270 24719 ts_manager.cc:194] Registered new tserver with Master: 2cf244f2446547f2869564b125ddef44 (127.11.88.67:43217)
I20260806 01:05:46.373914 24719 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.67@KRBTEST.COM'} at 127.11.88.67:50089
I20260806 01:05:46.378595 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 01:05:46.392584 25224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:46.379686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50016 (local address 127.11.88.126:44671)
0806 01:05:46.380036 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:46.380038 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:46.380154 (+ 116us) server_negotiation.cc:407] Connection header received
0806 01:05:46.380261 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:46.380262 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:46.380276 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:46.380324 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:46.381189 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.382077 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.383266 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.383619 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.383681 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:46.388778 (+ 5097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:46.388779 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:46.388780 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:46.388789 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:46.390965 (+ 2176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:46.391461 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:46.391463 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:46.391463 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:46.391530 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:46.391835 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:46.391835 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:46.391836 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:46.391986 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:46.392067 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:46.392349 (+ 282us) server_negotiation.cc:299] Negotiation successful
0806 01:05:46.392458 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":74,"threads_started":1}
I20260806 01:05:46.395569 24719 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50016:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 01:05:46.398180 24719 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:05:46.412320 25231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:46.402206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:42831 (local address 127.0.0.1:33992)
0806 01:05:46.406461 (+ 4255us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:46.406469 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:46.406502 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:46.406933 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:46.406937 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:46.406939 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:05:46.407017 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:46.407019 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.408855 (+ 1836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.408857 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:46.410657 (+ 1800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:46.410660 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.411980 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.411981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:46.412074 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:46.412092 (+ 18us) client_negotiation.cc:769] Sending connection context
0806 01:05:46.412145 (+ 53us) client_negotiation.cc:240] Negotiation successful
0806 01:05:46.412217 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4243,"thread_start_us":92,"threads_started":1}
I20260806 01:05:46.413148 25237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:46.402308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33992 (local address 127.11.88.66:42831)
0806 01:05:46.406652 (+ 4344us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:46.406658 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:46.406670 (+ 12us) server_negotiation.cc:407] Connection header received
0806 01:05:46.406710 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:46.406712 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:46.406729 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:46.406811 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:05:46.407108 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.408741 (+ 1633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.410771 (+ 2030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.411865 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.412575 (+ 710us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:46.412664 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:46.412694 (+ 30us) server_negotiation.cc:299] Negotiation successful
0806 01:05:46.412739 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4289,"thread_start_us":57,"threads_started":1}
I20260806 01:05:46.413949 24993 tablet_service.cc:1467] Processing CreateTablet for tablet 33b56513776f4f8f99dc73f7e936f835 (DEFAULT_TABLE table=test-table [id=3300f13a06da4ae98996ae462ee3b0c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:05:46.414363 24993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33b56513776f4f8f99dc73f7e936f835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:05:46.422873 25235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:46.401765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:44955 (local address 127.0.0.1:43066)
0806 01:05:46.406106 (+ 4341us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:46.406157 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:46.406231 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:46.418220 (+ 11989us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:46.418221 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:46.418223 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:05:46.418278 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:46.418279 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.420164 (+ 1885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.420165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:46.421346 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:46.421349 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.422598 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.422599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:46.422671 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:46.422676 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 01:05:46.422727 (+ 51us) client_negotiation.cc:240] Negotiation successful
0806 01:05:46.422775 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4304,"thread_start_us":102,"threads_started":1}
I20260806 01:05:46.423202 25232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:46.401882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43066 (local address 127.11.88.65:44955)
0806 01:05:46.411546 (+ 9664us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:46.411551 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:46.411561 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:05:46.411607 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:46.411609 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:46.411625 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:46.413557 (+ 1932us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:05:46.418382 (+ 4825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.419501 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.421506 (+ 2005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.422409 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.422479 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:46.422541 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:46.423079 (+ 538us) server_negotiation.cc:299] Negotiation successful
0806 01:05:46.423125 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9625,"thread_start_us":60,"threads_started":1}
I20260806 01:05:46.423929 24854 tablet_service.cc:1467] Processing CreateTablet for tablet 33b56513776f4f8f99dc73f7e936f835 (DEFAULT_TABLE table=test-table [id=3300f13a06da4ae98996ae462ee3b0c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:05:46.424330 24854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33b56513776f4f8f99dc73f7e936f835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:05:46.429045 25233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:46.402023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:43217 (local address 127.0.0.1:42030)
0806 01:05:46.406345 (+ 4322us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:46.406354 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:46.406390 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:46.410113 (+ 3723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:46.410114 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:46.410117 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:05:46.410168 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:46.410169 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.411735 (+ 1566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.411736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:46.412869 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:46.412871 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.428794 (+ 15923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.428795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:46.428871 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:46.428877 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 01:05:46.428907 (+ 30us) client_negotiation.cc:240] Negotiation successful
0806 01:05:46.428956 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4306,"thread_start_us":66,"threads_started":1}
I20260806 01:05:46.429539 25234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:46.402135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42030 (local address 127.11.88.67:43217)
0806 01:05:46.409914 (+ 7779us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:46.409919 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:46.409933 (+ 14us) server_negotiation.cc:407] Connection header received
0806 01:05:46.409968 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:46.409970 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:46.409987 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:46.410244 (+ 257us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:05:46.410335 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.411400 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.412977 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.428677 (+ 15700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.429290 (+ 613us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:46.429376 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:46.429407 (+ 31us) server_negotiation.cc:299] Negotiation successful
0806 01:05:46.429456 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7737,"thread_start_us":62,"threads_started":1}
I20260806 01:05:46.429929 25239 tablet_bootstrap.cc:492] T 33b56513776f4f8f99dc73f7e936f835 P 6ded07ea411f42ac882e51af893dc66e: Bootstrap starting.
I20260806 01:05:46.430305 25113 tablet_service.cc:1467] Processing CreateTablet for tablet 33b56513776f4f8f99dc73f7e936f835 (DEFAULT_TABLE table=test-table [id=3300f13a06da4ae98996ae462ee3b0c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:05:46.430629 25239 tablet_bootstrap.cc:654] T 33b56513776f4f8f99dc73f7e936f835 P 6ded07ea411f42ac882e51af893dc66e: Neither blocks nor log segments found. Creating new log.
I20260806 01:05:46.430682 25113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33b56513776f4f8f99dc73f7e936f835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:05:46.430922 25239 log.cc:824] T 33b56513776f4f8f99dc73f7e936f835 P 6ded07ea411f42ac882e51af893dc66e: Log is configured to *not* fsync() on all Append() calls
I20260806 01:05:46.431311 25238 tablet_bootstrap.cc:492] T 33b56513776f4f8f99dc73f7e936f835 P 3bf2b6475a584b8badf5e2ba245d1550: Bootstrap starting.
I20260806 01:05:46.431951 25238 tablet_bootstrap.cc:654] T 33b56513776f4f8f99dc73f7e936f835 P 3bf2b6475a584b8badf5e2ba245d1550: Neither blocks nor log segments found. Creating new log.
I20260806 01:05:46.432271 25238 log.cc:824] T 33b56513776f4f8f99dc73f7e936f835 P 3bf2b6475a584b8badf5e2ba245d1550: Log is configured to *not* fsync() on all Append() calls
I20260806 01:05:46.433097 25239 tablet_bootstrap.cc:492] T 33b56513776f4f8f99dc73f7e936f835 P 6ded07ea411f42ac882e51af893dc66e: No bootstrap required, opened a new log
I20260806 01:05:46.433158 25239 ts_tablet_manager.cc:1397] T 33b56513776f4f8f99dc73f7e936f835 P 6ded07ea411f42ac882e51af893dc66e: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260806 01:05:46.435704 25239 raft_consensus.cc:348] T 33b56513776f4f8f99dc73f7e936f835 P 6ded07ea411f42ac882e51af893dc66e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ded07ea411f42ac882e51af893dc66e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 44955 } } peers { permanent_uuid: "3bf2b6475a584b8badf5e2ba245d1550" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42831 } } peers { permanent_uuid: "2cf244f2446547f2869564b125ddef44" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43217 } }
I20260806 01:05:46.435881 25239 raft_consensus.cc:374] T 33b56513776f4f8f99dc73f7e936f835 P 6ded07ea411f42ac882e51af893dc66e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:05:46.435923 25239 raft_consensus.cc:729] T 33b56513776f4f8f99dc73f7e936f835 P 6ded07ea411f42ac882e51af893dc66e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ded07ea411f42ac882e51af893dc66e, State: Initialized, Role: FOLLOWER
I20260806 01:05:46.436057 25239 consensus_queue.cc:260] T 33b56513776f4f8f99dc73f7e936f835 P 6ded07ea411f42ac882e51af893dc66e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ded07ea411f42ac882e51af893dc66e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 44955 } } peers { permanent_uuid: "3bf2b6475a584b8badf5e2ba245d1550" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42831 } } peers { permanent_uuid: "2cf244f2446547f2869564b125ddef44" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43217 } }
I20260806 01:05:46.436328 25239 ts_tablet_manager.cc:1428] T 33b56513776f4f8f99dc73f7e936f835 P 6ded07ea411f42ac882e51af893dc66e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 01:05:46.436448 24923 heartbeater.cc:503] Master 127.11.88.126:44671 was elected leader, sending a full tablet report...
I20260806 01:05:46.437935 25238 tablet_bootstrap.cc:492] T 33b56513776f4f8f99dc73f7e936f835 P 3bf2b6475a584b8badf5e2ba245d1550: No bootstrap required, opened a new log
I20260806 01:05:46.438016 25238 ts_tablet_manager.cc:1397] T 33b56513776f4f8f99dc73f7e936f835 P 3bf2b6475a584b8badf5e2ba245d1550: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260806 01:05:46.440657 25238 raft_consensus.cc:348] T 33b56513776f4f8f99dc73f7e936f835 P 3bf2b6475a584b8badf5e2ba245d1550 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ded07ea411f42ac882e51af893dc66e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 44955 } } peers { permanent_uuid: "3bf2b6475a584b8badf5e2ba245d1550" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42831 } } peers { permanent_uuid: "2cf244f2446547f2869564b125ddef44" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43217 } }
I20260806 01:05:46.440835 25238 raft_consensus.cc:374] T 33b56513776f4f8f99dc73f7e936f835 P 3bf2b6475a584b8badf5e2ba245d1550 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:05:46.440877 25238 raft_consensus.cc:729] T 33b56513776f4f8f99dc73f7e936f835 P 3bf2b6475a584b8badf5e2ba245d1550 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bf2b6475a584b8badf5e2ba245d1550, State: Initialized, Role: FOLLOWER
I20260806 01:05:46.441015 25238 consensus_queue.cc:260] T 33b56513776f4f8f99dc73f7e936f835 P 3bf2b6475a584b8badf5e2ba245d1550 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ded07ea411f42ac882e51af893dc66e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 44955 } } peers { permanent_uuid: "3bf2b6475a584b8badf5e2ba245d1550" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42831 } } peers { permanent_uuid: "2cf244f2446547f2869564b125ddef44" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43217 } }
I20260806 01:05:46.441309 25238 ts_tablet_manager.cc:1428] T 33b56513776f4f8f99dc73f7e936f835 P 3bf2b6475a584b8badf5e2ba245d1550: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 01:05:46.441437 25061 heartbeater.cc:503] Master 127.11.88.126:44671 was elected leader, sending a full tablet report...
I20260806 01:05:46.443008 25242 tablet_bootstrap.cc:492] T 33b56513776f4f8f99dc73f7e936f835 P 2cf244f2446547f2869564b125ddef44: Bootstrap starting.
I20260806 01:05:46.443835 25242 tablet_bootstrap.cc:654] T 33b56513776f4f8f99dc73f7e936f835 P 2cf244f2446547f2869564b125ddef44: Neither blocks nor log segments found. Creating new log.
I20260806 01:05:46.444427 25242 log.cc:824] T 33b56513776f4f8f99dc73f7e936f835 P 2cf244f2446547f2869564b125ddef44: Log is configured to *not* fsync() on all Append() calls
I20260806 01:05:46.445498 25242 tablet_bootstrap.cc:492] T 33b56513776f4f8f99dc73f7e936f835 P 2cf244f2446547f2869564b125ddef44: No bootstrap required, opened a new log
I20260806 01:05:46.445580 25242 ts_tablet_manager.cc:1397] T 33b56513776f4f8f99dc73f7e936f835 P 2cf244f2446547f2869564b125ddef44: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 01:05:46.447778 25242 raft_consensus.cc:348] T 33b56513776f4f8f99dc73f7e936f835 P 2cf244f2446547f2869564b125ddef44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ded07ea411f42ac882e51af893dc66e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 44955 } } peers { permanent_uuid: "3bf2b6475a584b8badf5e2ba245d1550" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42831 } } peers { permanent_uuid: "2cf244f2446547f2869564b125ddef44" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43217 } }
I20260806 01:05:46.447966 25242 raft_consensus.cc:374] T 33b56513776f4f8f99dc73f7e936f835 P 2cf244f2446547f2869564b125ddef44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:05:46.448009 25242 raft_consensus.cc:729] T 33b56513776f4f8f99dc73f7e936f835 P 2cf244f2446547f2869564b125ddef44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cf244f2446547f2869564b125ddef44, State: Initialized, Role: FOLLOWER
I20260806 01:05:46.448124 25242 consensus_queue.cc:260] T 33b56513776f4f8f99dc73f7e936f835 P 2cf244f2446547f2869564b125ddef44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ded07ea411f42ac882e51af893dc66e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 44955 } } peers { permanent_uuid: "3bf2b6475a584b8badf5e2ba245d1550" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42831 } } peers { permanent_uuid: "2cf244f2446547f2869564b125ddef44" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43217 } }
I20260806 01:05:46.448388 25242 ts_tablet_manager.cc:1428] T 33b56513776f4f8f99dc73f7e936f835 P 2cf244f2446547f2869564b125ddef44: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 01:05:46.448526 25201 heartbeater.cc:503] Master 127.11.88.126:44671 was elected leader, sending a full tablet report...
W20260806 01:05:46.605311 25202 tablet.cc:2369] T 33b56513776f4f8f99dc73f7e936f835 P 2cf244f2446547f2869564b125ddef44: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 06 01:05:46 dist-test-slave-69rg krb5kdc[23683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978345, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for HTTP/127.11.88.84@KRBTEST.COM
I20260806 01:05:46.609122 25243 raft_consensus.cc:482] T 33b56513776f4f8f99dc73f7e936f835 P 6ded07ea411f42ac882e51af893dc66e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:05:46.609269 25243 raft_consensus.cc:504] T 33b56513776f4f8f99dc73f7e936f835 P 6ded07ea411f42ac882e51af893dc66e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ded07ea411f42ac882e51af893dc66e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 44955 } } peers { permanent_uuid: "3bf2b6475a584b8badf5e2ba245d1550" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42831 } } peers { permanent_uuid: "2cf244f2446547f2869564b125ddef44" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43217 } }
I20260806 01:05:46.609717 25243 leader_election.cc:288] T 33b56513776f4f8f99dc73f7e936f835 P 6ded07ea411f42ac882e51af893dc66e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bf2b6475a584b8badf5e2ba245d1550 (127.11.88.66:42831), 2cf244f2446547f2869564b125ddef44 (127.11.88.67:43217)
I20260806 01:05:46.620106 25237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:46.610130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:40103 (local address 127.11.88.66:42831)
0806 01:05:46.610202 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:46.610204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:46.615447 (+ 5243us) server_negotiation.cc:407] Connection header received
0806 01:05:46.615579 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:46.615580 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:46.615594 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:46.615632 (+ 38us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:05:46.615922 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.616656 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.619056 (+ 2400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.619641 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.619700 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:46.619709 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:46.619969 (+ 260us) server_negotiation.cc:299] Negotiation successful
0806 01:05:46.620019 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 01:05:46.620455 25249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:46.609896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:42831 (local address 127.11.88.65:40103)
0806 01:05:46.615343 (+ 5447us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:46.615361 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:46.615466 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:46.615725 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:46.615726 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:46.615728 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:05:46.615818 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:46.615820 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.616772 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.616773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:46.618936 (+ 2163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:46.618941 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.619801 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.619803 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:46.619874 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:46.619879 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 01:05:46.620286 (+ 407us) client_negotiation.cc:240] Negotiation successful
0806 01:05:46.620339 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5409,"thread_start_us":113,"threads_started":1}
I20260806 01:05:46.620894 25005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33b56513776f4f8f99dc73f7e936f835" candidate_uuid: "6ded07ea411f42ac882e51af893dc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf2b6475a584b8badf5e2ba245d1550" is_pre_election: true
I20260806 01:05:46.621114 25005 raft_consensus.cc:2454] T 33b56513776f4f8f99dc73f7e936f835 P 3bf2b6475a584b8badf5e2ba245d1550 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ded07ea411f42ac882e51af893dc66e in term 0.
I20260806 01:05:46.621405 24807 leader_election.cc:302] T 33b56513776f4f8f99dc73f7e936f835 P 6ded07ea411f42ac882e51af893dc66e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf2b6475a584b8badf5e2ba245d1550, 6ded07ea411f42ac882e51af893dc66e; no voters:
I20260806 01:05:46.621577 25243 raft_consensus.cc:2781] T 33b56513776f4f8f99dc73f7e936f835 P 6ded07ea411f42ac882e51af893dc66e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:05:46.621634 25243 raft_consensus.cc:482] T 33b56513776f4f8f99dc73f7e936f835 P 6ded07ea411f42ac882e51af893dc66e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:05:46.621665 25243 raft_consensus.cc:3037] T 33b56513776f4f8f99dc73f7e936f835 P 6ded07ea411f42ac882e51af893dc66e [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:05:46.622776 25243 raft_consensus.cc:504] T 33b56513776f4f8f99dc73f7e936f835 P 6ded07ea411f42ac882e51af893dc66e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ded07ea411f42ac882e51af893dc66e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 44955 } } peers { permanent_uuid: "3bf2b6475a584b8badf5e2ba245d1550" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42831 } } peers { permanent_uuid: "2cf244f2446547f2869564b125ddef44" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43217 } }
I20260806 01:05:46.622938 25243 leader_election.cc:288] T 33b56513776f4f8f99dc73f7e936f835 P 6ded07ea411f42ac882e51af893dc66e [CANDIDATE]: Term 1 election: Requested vote from peers 3bf2b6475a584b8badf5e2ba245d1550 (127.11.88.66:42831), 2cf244f2446547f2869564b125ddef44 (127.11.88.67:43217)
I20260806 01:05:46.623072 25246 raft_consensus.cc:482] T 33b56513776f4f8f99dc73f7e936f835 P 2cf244f2446547f2869564b125ddef44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:05:46.623175 25246 raft_consensus.cc:504] T 33b56513776f4f8f99dc73f7e936f835 P 2cf244f2446547f2869564b125ddef44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ded07ea411f42ac882e51af893dc66e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 44955 } } peers { permanent_uuid: "3bf2b6475a584b8badf5e2ba245d1550" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42831 } } peers { permanent_uuid: "2cf244f2446547f2869564b125ddef44" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43217 } }
I20260806 01:05:46.623528 25246 leader_election.cc:288] T 33b56513776f4f8f99dc73f7e936f835 P 2cf244f2446547f2869564b125ddef44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ded07ea411f42ac882e51af893dc66e (127.11.88.65:44955), 3bf2b6475a584b8badf5e2ba245d1550 (127.11.88.66:42831)
I20260806 01:05:46.624521 25005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33b56513776f4f8f99dc73f7e936f835" candidate_uuid: "6ded07ea411f42ac882e51af893dc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf2b6475a584b8badf5e2ba245d1550"
I20260806 01:05:46.624624 25005 raft_consensus.cc:3037] T 33b56513776f4f8f99dc73f7e936f835 P 3bf2b6475a584b8badf5e2ba245d1550 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:05:46.624850 25234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:46.610191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:41017 (local address 127.11.88.67:43217)
0806 01:05:46.610236 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:46.610239 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:46.615638 (+ 5399us) server_negotiation.cc:407] Connection header received
0806 01:05:46.620947 (+ 5309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:46.620949 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:46.620962 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:46.621014 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:05:46.621225 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.622090 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.623767 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.624409 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.624461 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:46.624470 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:46.624728 (+ 258us) server_negotiation.cc:299] Negotiation successful
0806 01:05:46.624780 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 01:05:46.625085 25248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:46.609948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:43217 (local address 127.11.88.65:41017)
0806 01:05:46.615545 (+ 5597us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:46.615560 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:46.620814 (+ 5254us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:46.621070 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:46.621071 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:46.621074 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:05:46.621134 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:46.621135 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.622288 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.622289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:46.623654 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:46.623658 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.624536 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.624536 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:46.624632 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:46.624637 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 01:05:46.624942 (+ 305us) client_negotiation.cc:240] Negotiation successful
0806 01:05:46.624995 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5573,"thread_start_us":115,"threads_started":1}
I20260806 01:05:46.625592 25005 raft_consensus.cc:2454] T 33b56513776f4f8f99dc73f7e936f835 P 3bf2b6475a584b8badf5e2ba245d1550 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ded07ea411f42ac882e51af893dc66e in term 1.
I20260806 01:05:46.625576 25154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33b56513776f4f8f99dc73f7e936f835" candidate_uuid: "6ded07ea411f42ac882e51af893dc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cf244f2446547f2869564b125ddef44" is_pre_election: true
I20260806 01:05:46.625686 25154 raft_consensus.cc:2454] T 33b56513776f4f8f99dc73f7e936f835 P 2cf244f2446547f2869564b125ddef44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ded07ea411f42ac882e51af893dc66e in term 0.
I20260806 01:05:46.625795 24807 leader_election.cc:302] T 33b56513776f4f8f99dc73f7e936f835 P 6ded07ea411f42ac882e51af893dc66e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bf2b6475a584b8badf5e2ba245d1550, 6ded07ea411f42ac882e51af893dc66e; no voters:
I20260806 01:05:46.625837 25153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33b56513776f4f8f99dc73f7e936f835" candidate_uuid: "6ded07ea411f42ac882e51af893dc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cf244f2446547f2869564b125ddef44"
I20260806 01:05:46.625921 25243 raft_consensus.cc:2781] T 33b56513776f4f8f99dc73f7e936f835 P 6ded07ea411f42ac882e51af893dc66e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:05:46.625916 25153 raft_consensus.cc:3037] T 33b56513776f4f8f99dc73f7e936f835 P 2cf244f2446547f2869564b125ddef44 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:05:46.626148 25243 raft_consensus.cc:686] T 33b56513776f4f8f99dc73f7e936f835 P 6ded07ea411f42ac882e51af893dc66e [term 1 LEADER]: Becoming Leader. State: Replica: 6ded07ea411f42ac882e51af893dc66e, State: Running, Role: LEADER
I20260806 01:05:46.626260 25243 consensus_queue.cc:237] T 33b56513776f4f8f99dc73f7e936f835 P 6ded07ea411f42ac882e51af893dc66e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ded07ea411f42ac882e51af893dc66e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 44955 } } peers { permanent_uuid: "3bf2b6475a584b8badf5e2ba245d1550" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42831 } } peers { permanent_uuid: "2cf244f2446547f2869564b125ddef44" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43217 } }
I20260806 01:05:46.626839 25153 raft_consensus.cc:2454] T 33b56513776f4f8f99dc73f7e936f835 P 2cf244f2446547f2869564b125ddef44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ded07ea411f42ac882e51af893dc66e in term 1.
I20260806 01:05:46.627161 24719 catalog_manager.cc:5495] T 33b56513776f4f8f99dc73f7e936f835 P 6ded07ea411f42ac882e51af893dc66e reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ded07ea411f42ac882e51af893dc66e (127.11.88.65). New cstate: current_term: 1 leader_uuid: "6ded07ea411f42ac882e51af893dc66e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ded07ea411f42ac882e51af893dc66e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 44955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bf2b6475a584b8badf5e2ba245d1550" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cf244f2446547f2869564b125ddef44" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43217 } health_report { overall_health: UNKNOWN } } }
I20260806 01:05:46.632411 25232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:46.624302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:59431 (local address 127.11.88.65:44955)
0806 01:05:46.624375 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:46.624377 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:46.628942 (+ 4565us) server_negotiation.cc:407] Connection header received
0806 01:05:46.629034 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:46.629035 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:46.629044 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:46.629072 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:05:46.629275 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.630094 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.631484 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.631999 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.632051 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:46.632061 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:46.632296 (+ 235us) server_negotiation.cc:299] Negotiation successful
0806 01:05:46.632337 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 01:05:46.632694 25250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:46.624060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:44955 (local address 127.11.88.67:59431)
0806 01:05:46.628887 (+ 4827us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:46.628896 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:46.628966 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:46.629129 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:46.629130 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:46.629131 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:05:46.629197 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:46.629199 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.630199 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.630200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:46.631373 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:46.631376 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.632148 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.632149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:46.632218 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:46.632222 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:05:46.632523 (+ 301us) client_negotiation.cc:240] Negotiation successful
0806 01:05:46.632583 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4813,"thread_start_us":74,"threads_started":1}
I20260806 01:05:46.633181 24875 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33b56513776f4f8f99dc73f7e936f835" candidate_uuid: "2cf244f2446547f2869564b125ddef44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ded07ea411f42ac882e51af893dc66e" is_pre_election: true
I20260806 01:05:46.637187 25237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:46.624263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:40833 (local address 127.11.88.66:42831)
0806 01:05:46.624345 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:46.624347 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:46.628886 (+ 4539us) server_negotiation.cc:407] Connection header received
0806 01:05:46.628921 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:46.628922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:46.628933 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:46.628989 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:05:46.634391 (+ 5402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.635033 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.636270 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.636786 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.636840 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:46.636850 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:46.637069 (+ 219us) server_negotiation.cc:299] Negotiation successful
0806 01:05:46.637115 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 01:05:46.637434 25251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:46.623757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:42831 (local address 127.11.88.67:40833)
0806 01:05:46.628724 (+ 4967us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:46.628739 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:46.628805 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:46.634134 (+ 5329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:46.634136 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:46.634138 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:05:46.634209 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:46.634211 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.635142 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.635143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:46.636151 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:46.636154 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.636915 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.636916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:46.636984 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:46.636988 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:05:46.637296 (+ 308us) client_negotiation.cc:240] Negotiation successful
0806 01:05:46.637353 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4943,"thread_start_us":124,"threads_started":1}
I20260806 01:05:46.637666 25005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33b56513776f4f8f99dc73f7e936f835" candidate_uuid: "2cf244f2446547f2869564b125ddef44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bf2b6475a584b8badf5e2ba245d1550" is_pre_election: true
I20260806 01:05:46.637809 25005 raft_consensus.cc:2379] T 33b56513776f4f8f99dc73f7e936f835 P 3bf2b6475a584b8badf5e2ba245d1550 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2cf244f2446547f2869564b125ddef44 in current term 1: Already voted for candidate 6ded07ea411f42ac882e51af893dc66e in this term.
I20260806 01:05:46.638185 25084 leader_election.cc:302] T 33b56513776f4f8f99dc73f7e936f835 P 2cf244f2446547f2869564b125ddef44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2cf244f2446547f2869564b125ddef44; no voters: 3bf2b6475a584b8badf5e2ba245d1550, 6ded07ea411f42ac882e51af893dc66e
I20260806 01:05:46.638389 25246 raft_consensus.cc:2726] T 33b56513776f4f8f99dc73f7e936f835 P 2cf244f2446547f2869564b125ddef44 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260806 01:05:46.643352 25232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:46.639963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43078 (local address 127.11.88.65:44955)
0806 01:05:46.640019 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:46.640021 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:46.640028 (+ 7us) server_negotiation.cc:407] Connection header received
0806 01:05:46.640076 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:46.640077 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:46.640099 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:46.640175 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:05:46.640365 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.641036 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.642156 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:46.642425 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:46.642490 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:46.642752 (+ 262us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:05:46.642918 (+ 166us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:05:46.643011 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:46.643232 (+ 221us) server_negotiation.cc:299] Negotiation successful
0806 01:05:46.643255 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
W20260806 01:05:46.645507 25062 tablet.cc:2369] T 33b56513776f4f8f99dc73f7e936f835 P 3bf2b6475a584b8badf5e2ba245d1550: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 01:05:46.647317 25153 raft_consensus.cc:1261] T 33b56513776f4f8f99dc73f7e936f835 P 2cf244f2446547f2869564b125ddef44 [term 1 FOLLOWER]: Refusing update from remote peer 6ded07ea411f42ac882e51af893dc66e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:05:46.647709 25005 raft_consensus.cc:1261] T 33b56513776f4f8f99dc73f7e936f835 P 3bf2b6475a584b8badf5e2ba245d1550 [term 1 FOLLOWER]: Refusing update from remote peer 6ded07ea411f42ac882e51af893dc66e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:05:46.648042 25252 consensus_queue.cc:1035] T 33b56513776f4f8f99dc73f7e936f835 P 6ded07ea411f42ac882e51af893dc66e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bf2b6475a584b8badf5e2ba245d1550" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 42831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:05:46.648170 25243 consensus_queue.cc:1035] T 33b56513776f4f8f99dc73f7e936f835 P 6ded07ea411f42ac882e51af893dc66e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cf244f2446547f2869564b125ddef44" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:05:46.659339 25255 mvcc.cc:205] Tried to move back new op lower bound from 7315367307863478272 to 7315367307781734400. Current Snapshot: MvccSnapshot[applied={T|T < 7315367307863478272}]
I20260806 01:05:46.661649 24718 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50016:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:05:46.661784 24718 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50016:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:05:46.662220 25257 mvcc.cc:205] Tried to move back new op lower bound from 7315367307863478272 to 7315367307781734400. Current Snapshot: MvccSnapshot[applied={T|T < 7315367307863478272}]
I20260806 01:05:46.662348 25256 mvcc.cc:205] Tried to move back new op lower bound from 7315367307863478272 to 7315367307781734400. Current Snapshot: MvccSnapshot[applied={T|T < 7315367307863478272}]
I20260806 01:05:46.662607 24718 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0a6ad8d5d2994b24a9dbceb61004474b: Sending DeleteTablet for 3 replicas of tablet 33b56513776f4f8f99dc73f7e936f835
I20260806 01:05:46.663023 24854 tablet_service.cc:1514] Processing DeleteTablet for tablet 33b56513776f4f8f99dc73f7e936f835 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:05:46 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:43066
I20260806 01:05:46.663026 24993 tablet_service.cc:1514] Processing DeleteTablet for tablet 33b56513776f4f8f99dc73f7e936f835 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:05:46 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:33992
I20260806 01:05:46.663292 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 24757
I20260806 01:05:46.663271 25113 tablet_service.cc:1514] Processing DeleteTablet for tablet 33b56513776f4f8f99dc73f7e936f835 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:05:46 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:42030
I20260806 01:05:46.666755 25266 tablet_replica.cc:330] T 33b56513776f4f8f99dc73f7e936f835 P 3bf2b6475a584b8badf5e2ba245d1550: stopping tablet replica
I20260806 01:05:46.666890 25266 raft_consensus.cc:2229] T 33b56513776f4f8f99dc73f7e936f835 P 3bf2b6475a584b8badf5e2ba245d1550 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:05:46.667012 25266 raft_consensus.cc:2258] T 33b56513776f4f8f99dc73f7e936f835 P 3bf2b6475a584b8badf5e2ba245d1550 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:05:46.672497 25266 ts_tablet_manager.cc:1905] T 33b56513776f4f8f99dc73f7e936f835 P 3bf2b6475a584b8badf5e2ba245d1550: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:05:46.674746 25267 tablet_replica.cc:330] T 33b56513776f4f8f99dc73f7e936f835 P 2cf244f2446547f2869564b125ddef44: stopping tablet replica
I20260806 01:05:46.674875 25266 ts_tablet_manager.cc:1918] T 33b56513776f4f8f99dc73f7e936f835 P 3bf2b6475a584b8badf5e2ba245d1550: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:05:46.674901 25267 raft_consensus.cc:2229] T 33b56513776f4f8f99dc73f7e936f835 P 2cf244f2446547f2869564b125ddef44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:05:46.674968 25266 log.cc:1196] T 33b56513776f4f8f99dc73f7e936f835 P 3bf2b6475a584b8badf5e2ba245d1550: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-1/wal/wals/33b56513776f4f8f99dc73f7e936f835
I20260806 01:05:46.675038 25267 raft_consensus.cc:2258] T 33b56513776f4f8f99dc73f7e936f835 P 2cf244f2446547f2869564b125ddef44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:05:46.675276 25266 ts_tablet_manager.cc:1939] T 33b56513776f4f8f99dc73f7e936f835 P 3bf2b6475a584b8badf5e2ba245d1550: Deleting consensus metadata
I20260806 01:05:46.675603 25267 ts_tablet_manager.cc:1905] T 33b56513776f4f8f99dc73f7e936f835 P 2cf244f2446547f2869564b125ddef44: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:05:46.675848 24704 catalog_manager.cc:4841] TS 3bf2b6475a584b8badf5e2ba245d1550 (127.11.88.66:42831): tablet 33b56513776f4f8f99dc73f7e936f835 (table test-table [id=3300f13a06da4ae98996ae462ee3b0c3]) successfully deleted
W20260806 01:05:46.677618 24703 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.88.65:44955 (error 108)
I20260806 01:05:46.677778 25267 ts_tablet_manager.cc:1918] T 33b56513776f4f8f99dc73f7e936f835 P 2cf244f2446547f2869564b125ddef44: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:05:46.677886 25267 log.cc:1196] T 33b56513776f4f8f99dc73f7e936f835 P 2cf244f2446547f2869564b125ddef44: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785978186227899-11617-0/minicluster-data/ts-2/wal/wals/33b56513776f4f8f99dc73f7e936f835
I20260806 01:05:46.678194 25267 ts_tablet_manager.cc:1939] T 33b56513776f4f8f99dc73f7e936f835 P 2cf244f2446547f2869564b125ddef44: Deleting consensus metadata
I20260806 01:05:46.678471 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 24927
I20260806 01:05:46.687871 24703 catalog_manager.cc:4841] TS 2cf244f2446547f2869564b125ddef44 (127.11.88.67:43217): tablet 33b56513776f4f8f99dc73f7e936f835 (table test-table [id=3300f13a06da4ae98996ae462ee3b0c3]) successfully deleted
I20260806 01:05:46.688196 25233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:46.687805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:44955 (local address 127.0.0.1:43080)
0806 01:05:46.688032 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:46.688158 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.65:44955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204}
W20260806 01:05:46.688364 24703 catalog_manager.cc:4584] TS 6ded07ea411f42ac882e51af893dc66e (127.11.88.65:44955): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 33b56513776f4f8f99dc73f7e936f835: Network error: Client connection negotiation failed: client connection to 127.11.88.65:44955: connect: Connection refused (error 111)
I20260806 01:05:46.691828 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 25064
I20260806 01:05:46.699911 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 24685
I20260806 01:05:46.708223 11617 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 01:05:47.052904 11617 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 01:05:47.053007 11617 mini_ranger.cc:66] Stopping Ranger...
I20260806 01:05:47.398211 11617 mini_ranger.cc:68] Stopped Ranger
2026-08-06 01:05:47.398 UTC [23715] LOG: received smart shutdown request
2026-08-06 01:05:47.403 UTC [23715] LOG: background worker "logical replication launcher" (PID 23724) exited with exit code 1
2026-08-06 01:05:47.404 UTC [23719] LOG: shutting down
2026-08-06 01:05:47.597 UTC [23715] LOG: database system is shut down
2026-08-06T01:05:47Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (51946 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:05:47 dist-test-slave-69rg krb5kdc[25278](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:05:47 dist-test-slave-69rg krb5kdc[25278](info): set up 2 sockets
Aug 06 01:05:47 dist-test-slave-69rg krb5kdc[25278](info): commencing operation
krb5kdc: starting...
W20260806 01:05:48.806753 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.074s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:05:48 dist-test-slave-69rg krb5kdc[25278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978348, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:05:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:05:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:05:48.942329 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:40065
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:38961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:40065,127.11.88.125:38555,127.11.88.124:34575
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:05:49.029270 25292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:05:49.029543 25292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:05:49.029587 25292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:05:49.030846 25292 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:05:49.030932 25292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:05:49.030957 25292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:05:49.030982 25292 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:05:49.031009 25292 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:05:49.033275 25292 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:38961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:40065,127.11.88.125:38555,127.11.88.124:34575
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:40065
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25292
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:05:49.033646 25292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:05:49.033959 25292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 01:05:49.039758 25292 server_base.cc:1034] running on GCE node
W20260806 01:05:49.039703 25301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:49.039731 25297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:49.039724 25299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:49.040257 25292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:05:49.040539 25292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:05:49.041693 25292 hybrid_clock.cc:648] HybridClock initialized: now 1785978349041672 us; error 43 us; skew 500 ppm
Aug 06 01:05:49 dist-test-slave-69rg krb5kdc[25278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978349, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:05:49.044799 25292 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:05:49.045440 25292 webserver.cc:460] Webserver started at http://127.11.88.126:34625/ using document root <none> and password file <none>
I20260806 01:05:49.045708 25292 fs_manager.cc:359] Metadata directory not provided
I20260806 01:05:49.045761 25292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:05:49.045997 25292 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:05:49.047251 25292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "ce964fa069ac4f97bcc2169faed31f1e"
format_stamp: "Formatted at 2026-08-06 01:05:49 on dist-test-slave-69rg"
server_key: "054ca928a527638373fdcf724e0b0cd7"
server_key_iv: "930a456fe77103aa333641bca59e577b"
server_key_version: "encryptionkey@0"
I20260806 01:05:49.047688 25292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "ce964fa069ac4f97bcc2169faed31f1e"
format_stamp: "Formatted at 2026-08-06 01:05:49 on dist-test-slave-69rg"
server_key: "054ca928a527638373fdcf724e0b0cd7"
server_key_iv: "930a456fe77103aa333641bca59e577b"
server_key_version: "encryptionkey@0"
I20260806 01:05:49.049237 25292 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 01:05:49.050215 25308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:49.050474 25292 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:05:49.050607 25292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "ce964fa069ac4f97bcc2169faed31f1e"
format_stamp: "Formatted at 2026-08-06 01:05:49 on dist-test-slave-69rg"
server_key: "054ca928a527638373fdcf724e0b0cd7"
server_key_iv: "930a456fe77103aa333641bca59e577b"
server_key_version: "encryptionkey@0"
I20260806 01:05:49.050676 25292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:05:49.067960 25292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:05:49.070537 25292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:05:49.070699 25292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:05:49.075065 25292 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:40065
I20260806 01:05:49.075150 25362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:40065 every 8 connection(s)
I20260806 01:05:49.075519 25292 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:05:49.076464 25363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:05:49.078205 25363 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40065 } has no permanent_uuid. Determining permanent_uuid...
I20260806 01:05:49.078509 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 25292
I20260806 01:05:49.078612 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:05:49.078815 11617 external_mini_cluster.cc:1428] Setting key 2f6683028f0d49a959d7e558642126fd
Aug 06 01:05:49 dist-test-slave-69rg krb5kdc[25278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978349, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.88.125@KRBTEST.COM; defaulting to no policy
I20260806 01:05:49.089902 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.079177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:40065 (local address 127.0.0.1:47506)
0806 01:05:49.079357 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:49.079401 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:49.079926 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:49.080265 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:49.080267 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:49.080652 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:05:49.080920 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:49.080927 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.082037 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.082038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:49.083250 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:49.083253 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.083796 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.083798 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:49.083890 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:49.084491 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:05:49.084503 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:05:49.086257 (+ 1754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:05:49.088332 (+ 2075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:49.088340 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:49.088342 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:49.088540 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:49.088830 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:49.088831 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:49.088831 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:49.088961 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:49.089356 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:05:49.089362 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:05:49.089423 (+ 61us) client_negotiation.cc:769] Sending connection context
0806 01:05:49.089501 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 01:05:49.089642 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":96,"threads_started":1}
I20260806 01:05:49.089906 25366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.079395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47506 (local address 127.11.88.126:40065)
0806 01:05:49.079572 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:49.079577 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:49.079623 (+ 46us) server_negotiation.cc:407] Connection header received
0806 01:05:49.080085 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:49.080088 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:49.080112 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:49.080232 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:49.081035 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.081944 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.083369 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.083692 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.083786 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:49.086354 (+ 2568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:49.086362 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:49.086362 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:49.086370 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:49.088201 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.088644 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.088647 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.088647 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.088749 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.089037 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.089038 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.089039 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.089282 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:49.089359 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:49.089555 (+ 196us) server_negotiation.cc:299] Negotiation successful
0806 01:05:49.089711 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":66,"server-negotiator.queue_time_us":134,"thread_start_us":75,"threads_started":1}
I20260806 01:05:49.090677 25363 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38555 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.125@KRBTEST.COM" created.
I20260806 01:05:49.091166 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.090996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:38555 (local address 127.0.0.1:60986)
0806 01:05:49.091089 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:49.091146 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.125:38555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260806 01:05:49.091367 25312 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.88.125:38555: connect: Connection refused (error 111)
I20260806 01:05:49.091863 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.091759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:38555 (local address 127.0.0.1:60990)
0806 01:05:49.091813 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:49.091844 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.125:38555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260806 01:05:49.091969 25363 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.88.125:38555: Network error: Client connection negotiation failed: client connection to 127.11.88.125:38555: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.125.keytab.
Entry for principal kudu/127.11.88.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.125.keytab.
I20260806 01:05:49.109184 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.125:38555
--webserver_interface=127.11.88.125
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.125.keytab
--principal=kudu/127.11.88.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:38961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:40065,127.11.88.125:38555,127.11.88.124:34575
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 01:05:49.141271 25363 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38555 } attempt: 1
I20260806 01:05:49.141923 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.141713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:38555 (local address 127.0.0.1:32774)
0806 01:05:49.141798 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:49.141887 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.125:38555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260806 01:05:49.142341 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.142229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:38555 (local address 127.0.0.1:32780)
0806 01:05:49.142282 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:49.142311 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.125:38555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260806 01:05:49.142441 25363 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.88.125:38555: Network error: Client connection negotiation failed: client connection to 127.11.88.125:38555: connect: Connection refused (error 111)
W20260806 01:05:49.202006 25370 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:05:49.202349 25370 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:05:49.202399 25370 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:05:49.203765 25370 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:05:49.203855 25370 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:05:49.203886 25370 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:05:49.203917 25370 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:05:49.203950 25370 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:05:49.205780 25370 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:38961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:40065,127.11.88.125:38555,127.11.88.124:34575
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.125.keytab
--principal=kudu/127.11.88.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.125:38555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.88.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25370
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:05:49.206143 25370 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:05:49.206414 25370 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 01:05:49.210577 25363 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38555 } attempt: 2
I20260806 01:05:49.211115 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.210970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:38555 (local address 127.0.0.1:55372)
0806 01:05:49.211044 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:49.211084 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.125:38555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260806 01:05:49.211563 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.211428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:38555 (local address 127.0.0.1:55380)
0806 01:05:49.211507 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:49.211541 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.125:38555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260806 01:05:49.211688 25363 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.88.125:38555: Network error: Client connection negotiation failed: client connection to 127.11.88.125:38555: connect: Connection refused (error 111)
I20260806 01:05:49.212167 25370 server_base.cc:1034] running on GCE node
W20260806 01:05:49.212132 25375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:49.212157 25376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:49.212132 25378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:49.212697 25370 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:05:49.213050 25370 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:05:49.214237 25370 hybrid_clock.cc:648] HybridClock initialized: now 1785978349214223 us; error 50 us; skew 500 ppm
Aug 06 01:05:49 dist-test-slave-69rg krb5kdc[25278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978349, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:05:49.217144 25370 init.cc:377] Logged in from keytab as kudu/127.11.88.125@KRBTEST.COM (short username kudu)
I20260806 01:05:49.217670 25370 webserver.cc:460] Webserver started at http://127.11.88.125:41213/ using document root <none> and password file <none>
I20260806 01:05:49.218019 25370 fs_manager.cc:359] Metadata directory not provided
I20260806 01:05:49.218119 25370 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:05:49.218269 25370 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:05:49.219535 25370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-1/data/instance:
uuid: "3a83daa7b9744865996084b4543e8670"
format_stamp: "Formatted at 2026-08-06 01:05:49 on dist-test-slave-69rg"
server_key: "159e6c7c6eff9dd31bb17d9a1af3ded2"
server_key_iv: "43cdfe91673fc474692bb1e786d10279"
server_key_version: "encryptionkey@0"
I20260806 01:05:49.219959 25370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-1/wal/instance:
uuid: "3a83daa7b9744865996084b4543e8670"
format_stamp: "Formatted at 2026-08-06 01:05:49 on dist-test-slave-69rg"
server_key: "159e6c7c6eff9dd31bb17d9a1af3ded2"
server_key_iv: "43cdfe91673fc474692bb1e786d10279"
server_key_version: "encryptionkey@0"
I20260806 01:05:49.221527 25370 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:05:49.222569 25385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:49.222919 25370 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:05:49.223059 25370 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-1/wal
uuid: "3a83daa7b9744865996084b4543e8670"
format_stamp: "Formatted at 2026-08-06 01:05:49 on dist-test-slave-69rg"
server_key: "159e6c7c6eff9dd31bb17d9a1af3ded2"
server_key_iv: "43cdfe91673fc474692bb1e786d10279"
server_key_version: "encryptionkey@0"
I20260806 01:05:49.223150 25370 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:05:49.238787 25370 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:05:49.241063 25370 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:05:49.241245 25370 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:05:49.245748 25370 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.125:38555
I20260806 01:05:49.245893 25439 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.125:38555 every 8 connection(s)
I20260806 01:05:49.246223 25370 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-1/data/info.pb
I20260806 01:05:49.247193 25440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:05:49.248901 25440 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40065 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 01:05:49 dist-test-slave-69rg krb5kdc[25278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978349, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.125@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:05:49.255538 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 25370
I20260806 01:05:49.255626 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-1/wal/instance
I20260806 01:05:49.255870 11617 external_mini_cluster.cc:1428] Setting key 3fb4465644d5b7f9319b57b030d9f4f8
I20260806 01:05:49.259591 25366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.249737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41758 (local address 127.11.88.126:40065)
0806 01:05:49.249874 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:49.249877 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:49.250130 (+ 253us) server_negotiation.cc:407] Connection header received
0806 01:05:49.250688 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:49.250689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:49.250703 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:49.250778 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:49.251463 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.251973 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.253010 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.253228 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.253315 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:49.256212 (+ 2897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:49.256214 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:49.256214 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:49.256228 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:49.257735 (+ 1507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.258340 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.258341 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.258342 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.258415 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.258803 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.258804 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.258805 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.258949 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:49.259013 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:49.259413 (+ 400us) server_negotiation.cc:299] Negotiation successful
0806 01:05:49.259509 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 01:05:49.259845 25442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.249625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:40065 (local address 127.0.0.1:41758)
0806 01:05:49.249927 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:49.249984 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:49.250543 (+ 559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:49.250862 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:49.250866 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:49.251142 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:05:49.251358 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:49.251362 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.252090 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.252091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:49.252907 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:49.252909 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.253324 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.253325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:49.253464 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:49.254311 (+ 847us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:05:49.254321 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:05:49.256102 (+ 1781us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:05:49.257847 (+ 1745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:49.257857 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:49.257860 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:49.258233 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:49.258509 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:49.258511 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:49.258511 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:49.258668 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:49.259028 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:05:49.259044 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:05:49.259229 (+ 185us) client_negotiation.cc:769] Sending connection context
0806 01:05:49.259342 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 01:05:49.259547 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":109,"threads_started":1}
I20260806 01:05:49.260644 25440 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38555 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.88.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.124@KRBTEST.COM" created.
Aug 06 01:05:49 dist-test-slave-69rg krb5kdc[25278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978349, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.125@KRBTEST.COM for kudu/127.11.88.125@KRBTEST.COM
I20260806 01:05:49.272883 25442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.260962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:38555 (local address 127.0.0.1:55382)
0806 01:05:49.261047 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:49.261061 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:49.261117 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:49.261486 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:49.261487 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:49.261655 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:05:49.261743 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:49.261746 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.262758 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.262759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:49.263621 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:49.263624 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.264145 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.264146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:49.264239 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:49.264676 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:05:49.264682 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:05:49.268970 (+ 4288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:05:49.271611 (+ 2641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:49.271612 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:49.271613 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:49.271799 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:49.272058 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:49.272059 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:49.272059 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:49.272125 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:49.272466 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:05:49.272467 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:05:49.272511 (+ 44us) client_negotiation.cc:769] Sending connection context
0806 01:05:49.272585 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 01:05:49.272719 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260806 01:05:49.272907 25444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.261121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55382 (local address 127.11.88.125:38555)
0806 01:05:49.261331 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:49.261336 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:49.261355 (+ 19us) server_negotiation.cc:407] Connection header received
0806 01:05:49.261373 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:49.261375 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:49.261387 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:49.261451 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:49.261879 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.262658 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.263714 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.264050 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.264123 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:49.269096 (+ 4973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:49.269114 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:49.269115 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:49.269122 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:49.271509 (+ 2387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.271908 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.271912 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.271912 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.271980 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.272198 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.272199 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.272200 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.272382 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:49.272492 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:49.272633 (+ 141us) server_negotiation.cc:299] Negotiation successful
0806 01:05:49.272779 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":71,"server-negotiator.queue_time_us":166,"thread_start_us":114,"threads_started":1}
I20260806 01:05:49.273708 25440 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 } has no permanent_uuid. Determining permanent_uuid...
I20260806 01:05:49.274184 25442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.274047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:34575 (local address 127.0.0.1:38128)
0806 01:05:49.274107 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:49.274160 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:34575: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260806 01:05:49.274330 25387 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.88.124:34575: connect: Connection refused (error 111)
I20260806 01:05:49.274806 25442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.274705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:34575 (local address 127.0.0.1:38138)
0806 01:05:49.274756 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:49.274782 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:34575: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260806 01:05:49.274930 25440 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.88.124:34575: Network error: Client connection negotiation failed: client connection to 127.11.88.124:34575: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.124.keytab.
Entry for principal kudu/127.11.88.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.124.keytab.
I20260806 01:05:49.289587 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.124:34575
--webserver_interface=127.11.88.124
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.124.keytab
--principal=kudu/127.11.88.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:38961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:40065,127.11.88.125:38555,127.11.88.124:34575
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 01:05:49.302891 25363 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38555 } attempt: 3
Aug 06 01:05:49 dist-test-slave-69rg krb5kdc[25278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978349, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for kudu/127.11.88.125@KRBTEST.COM
I20260806 01:05:49.310885 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.303368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:38555 (local address 127.0.0.1:55392)
0806 01:05:49.303455 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:49.303476 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:49.303589 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:49.303790 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:49.303791 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:49.303974 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:05:49.304052 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:49.304055 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.304837 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.304839 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:49.305390 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:49.305392 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.305851 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.305853 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:49.305947 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:49.306612 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:05:49.306618 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:05:49.307914 (+ 1296us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:05:49.309880 (+ 1966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:49.309882 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:49.309882 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:49.310056 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:49.310294 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:49.310295 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:49.310295 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:49.310348 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:49.310635 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:05:49.310635 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:05:49.310677 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 01:05:49.310730 (+ 53us) client_negotiation.cc:240] Negotiation successful
0806 01:05:49.310811 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260806 01:05:49.310987 25444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.303469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55392 (local address 127.11.88.125:38555)
0806 01:05:49.303549 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:49.303552 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:49.303564 (+ 12us) server_negotiation.cc:407] Connection header received
0806 01:05:49.303682 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:49.303683 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:49.303698 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:49.303781 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:49.304160 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.304732 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.305490 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.305736 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.305829 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:49.308026 (+ 2197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:49.308028 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:49.308028 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:49.308039 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:49.309734 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.310141 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.310143 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.310143 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.310223 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.310410 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.310411 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.310411 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.310565 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:49.310641 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:49.310776 (+ 135us) server_negotiation.cc:299] Negotiation successful
0806 01:05:49.310873 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 01:05:49.311406 25363 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 } has no permanent_uuid. Determining permanent_uuid...
I20260806 01:05:49.311769 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.311659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:34575 (local address 127.0.0.1:38142)
0806 01:05:49.311711 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:49.311740 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:34575: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260806 01:05:49.312156 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.312038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:34575 (local address 127.0.0.1:38150)
0806 01:05:49.312118 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:49.312141 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:34575: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260806 01:05:49.312274 25363 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.88.124:34575: Network error: Client connection negotiation failed: client connection to 127.11.88.124:34575: connect: Connection refused (error 111)
I20260806 01:05:49.324185 25440 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 } attempt: 1
I20260806 01:05:49.324788 25442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.324636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:34575 (local address 127.0.0.1:38162)
0806 01:05:49.324707 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:49.324755 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:34575: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260806 01:05:49.325194 25442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.325084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:34575 (local address 127.0.0.1:38172)
0806 01:05:49.325137 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:49.325170 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:34575: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260806 01:05:49.325304 25440 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.88.124:34575: Network error: Client connection negotiation failed: client connection to 127.11.88.124:34575: connect: Connection refused (error 111)
I20260806 01:05:49.343433 25363 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 } attempt: 1
I20260806 01:05:49.343997 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.343816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:34575 (local address 127.0.0.1:38174)
0806 01:05:49.343895 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:49.343951 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:34575: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260806 01:05:49.344501 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.344385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:34575 (local address 127.0.0.1:38190)
0806 01:05:49.344442 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:49.344477 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:34575: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260806 01:05:49.344624 25363 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.88.124:34575: Network error: Client connection negotiation failed: client connection to 127.11.88.124:34575: connect: Connection refused (error 111)
W20260806 01:05:49.382983 25447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:05:49.383188 25447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:05:49.383210 25447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:05:49.384367 25447 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:05:49.384411 25447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:05:49.384426 25447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:05:49.384438 25447 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:05:49.384450 25447 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:05:49.386055 25447 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:38961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:40065,127.11.88.125:38555,127.11.88.124:34575
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.124.keytab
--principal=kudu/127.11.88.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.124:34575
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.88.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25447
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:05:49.386327 25447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:05:49.386581 25447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:05:49.392535 25457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:49.392560 25453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:49.392549 25452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:49.392782 25447 server_base.cc:1034] running on GCE node
I20260806 01:05:49.393196 25447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:05:49.393457 25440 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 } attempt: 2
I20260806 01:05:49.393569 25447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:05:49.393981 25442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.393860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:34575 (local address 127.0.0.1:38196)
0806 01:05:49.393915 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:49.393949 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:34575: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260806 01:05:49.394304 25442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.394243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:34575 (local address 127.0.0.1:38202)
0806 01:05:49.394266 (+ 23us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:49.394289 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:34575: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12}
W20260806 01:05:49.394393 25440 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.88.124:34575: Network error: Client connection negotiation failed: client connection to 127.11.88.124:34575: connect: Connection refused (error 111)
I20260806 01:05:49.394807 25447 hybrid_clock.cc:648] HybridClock initialized: now 1785978349394783 us; error 37 us; skew 500 ppm
Aug 06 01:05:49 dist-test-slave-69rg krb5kdc[25278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978349, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:05:49.397555 25447 init.cc:377] Logged in from keytab as kudu/127.11.88.124@KRBTEST.COM (short username kudu)
I20260806 01:05:49.398152 25447 webserver.cc:460] Webserver started at http://127.11.88.124:42033/ using document root <none> and password file <none>
I20260806 01:05:49.398408 25447 fs_manager.cc:359] Metadata directory not provided
I20260806 01:05:49.398480 25447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:05:49.398640 25447 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:05:49.399756 25447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-2/data/instance:
uuid: "532d110f0b3c4021a94718c3fc78cfe0"
format_stamp: "Formatted at 2026-08-06 01:05:49 on dist-test-slave-69rg"
server_key: "e01cb88ed95ecd720507d20aee68a9c7"
server_key_iv: "62adc4e6a2110d5ba055f847d9ab36ec"
server_key_version: "encryptionkey@0"
I20260806 01:05:49.400141 25447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-2/wal/instance:
uuid: "532d110f0b3c4021a94718c3fc78cfe0"
format_stamp: "Formatted at 2026-08-06 01:05:49 on dist-test-slave-69rg"
server_key: "e01cb88ed95ecd720507d20aee68a9c7"
server_key_iv: "62adc4e6a2110d5ba055f847d9ab36ec"
server_key_version: "encryptionkey@0"
I20260806 01:05:49.401579 25447 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:05:49.402549 25467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:49.402765 25447 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:05:49.402877 25447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-2/wal
uuid: "532d110f0b3c4021a94718c3fc78cfe0"
format_stamp: "Formatted at 2026-08-06 01:05:49 on dist-test-slave-69rg"
server_key: "e01cb88ed95ecd720507d20aee68a9c7"
server_key_iv: "62adc4e6a2110d5ba055f847d9ab36ec"
server_key_version: "encryptionkey@0"
I20260806 01:05:49.402956 25447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:05:49.412707 25447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:05:49.414803 25447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:05:49.414968 25447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:05:49.419256 25447 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.124:34575
I20260806 01:05:49.419291 25521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.124:34575 every 8 connection(s)
I20260806 01:05:49.419668 25447 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-2/data/info.pb
I20260806 01:05:49.419806 25363 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 } attempt: 2
I20260806 01:05:49.420619 25522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:05:49.422621 25522 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40065 } has no permanent_uuid. Determining permanent_uuid...
I20260806 01:05:49.425930 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 25447
I20260806 01:05:49.426043 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785978186227899-11617-0/minicluster-data/master-2/wal/instance
I20260806 01:05:49.426237 11617 external_mini_cluster.cc:1428] Setting key ca3692a4f374e7582f2df820c44283ed
Aug 06 01:05:49 dist-test-slave-69rg krb5kdc[25278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978349, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for kudu/127.11.88.124@KRBTEST.COM
Aug 06 01:05:49 dist-test-slave-69rg krb5kdc[25278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978349, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.124@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:05:49.431245 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.420188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:34575 (local address 127.0.0.1:38216)
0806 01:05:49.420262 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:49.420276 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:49.420343 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:49.421355 (+ 1012us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:49.421356 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:49.421533 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:05:49.421589 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:49.421591 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.423192 (+ 1601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.423193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:49.424097 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:49.424101 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.424930 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.424931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:49.425016 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:49.425566 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:05:49.425573 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:05:49.427314 (+ 1741us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:05:49.429710 (+ 2396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:49.429711 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:49.429712 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:49.429941 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:49.430225 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:49.430226 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:49.430226 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:49.430293 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:49.430788 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:05:49.430789 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:05:49.430839 (+ 50us) client_negotiation.cc:769] Sending connection context
0806 01:05:49.430930 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 01:05:49.431107 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260806 01:05:49.431399 25524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.420360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38216 (local address 127.11.88.124:34575)
0806 01:05:49.420590 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:49.420605 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:49.420632 (+ 27us) server_negotiation.cc:407] Connection header received
0806 01:05:49.421151 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:49.421158 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:49.421209 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:49.421333 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:49.421731 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.423078 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.424187 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.424840 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.424948 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:49.427445 (+ 2497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:49.427453 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:49.427454 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:49.427466 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:49.429603 (+ 2137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.430015 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.430019 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.430019 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.430138 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.430344 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.430346 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.430346 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.430693 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:49.430795 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:49.431001 (+ 206us) server_negotiation.cc:299] Negotiation successful
0806 01:05:49.431143 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":125,"threads_started":1}
Aug 06 01:05:49 dist-test-slave-69rg krb5kdc[25278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978348, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.124@KRBTEST.COM
I20260806 01:05:49.432881 25525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.423236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:40065 (local address 127.0.0.1:41772)
0806 01:05:49.423408 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:49.423453 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:49.423528 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:49.423725 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:49.423728 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:49.424083 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:05:49.424183 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:49.424186 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.425020 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.425021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:49.426122 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:49.426125 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.426792 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.426793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:49.426879 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:49.427483 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:05:49.427489 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:05:49.429231 (+ 1742us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:05:49.431346 (+ 2115us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:49.431355 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:49.431357 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:49.431613 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:49.431904 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:49.431904 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:49.431905 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:49.431975 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:49.432467 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:05:49.432475 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:05:49.432543 (+ 68us) client_negotiation.cc:769] Sending connection context
0806 01:05:49.432665 (+ 122us) client_negotiation.cc:240] Negotiation successful
0806 01:05:49.432782 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":103,"threads_started":1}
I20260806 01:05:49.432909 25366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.423290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41772 (local address 127.11.88.126:40065)
0806 01:05:49.423358 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:49.423360 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:49.423525 (+ 165us) server_negotiation.cc:407] Connection header received
0806 01:05:49.423614 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:49.423615 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:49.423624 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:49.423672 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:49.424267 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.424926 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.426231 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.426525 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.426610 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:49.429324 (+ 2714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:49.429326 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:49.429326 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:49.429333 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:49.431248 (+ 1915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.431711 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.431712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.431712 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.431794 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.432191 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.432192 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.432192 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.432377 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:49.432459 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:49.432691 (+ 232us) server_negotiation.cc:299] Negotiation successful
0806 01:05:49.432775 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 01:05:49.433588 25363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce964fa069ac4f97bcc2169faed31f1e: Bootstrap starting.
I20260806 01:05:49.434839 25363 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce964fa069ac4f97bcc2169faed31f1e: Neither blocks nor log segments found. Creating new log.
I20260806 01:05:49.435216 25363 log.cc:824] T 00000000000000000000000000000000 P ce964fa069ac4f97bcc2169faed31f1e: Log is configured to *not* fsync() on all Append() calls
I20260806 01:05:49.435850 25522 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38555 } has no permanent_uuid. Determining permanent_uuid...
I20260806 01:05:49.436204 25363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce964fa069ac4f97bcc2169faed31f1e: No bootstrap required, opened a new log
I20260806 01:05:49.437655 25526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.426601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38230 (local address 127.11.88.124:34575)
0806 01:05:49.426718 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:49.426721 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:49.426831 (+ 110us) server_negotiation.cc:407] Connection header received
0806 01:05:49.426902 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:49.426903 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:49.426914 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:49.426985 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:49.427980 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.428649 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.429750 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.430069 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.430140 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:49.433622 (+ 3482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:49.433624 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:49.433624 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:49.433632 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:49.436248 (+ 2616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.436716 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.436718 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.436718 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.436798 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.437031 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.437032 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.437033 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.437161 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:49.437320 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:49.437410 (+ 90us) server_negotiation.cc:299] Negotiation successful
0806 01:05:49.437503 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":69,"threads_started":1}
I20260806 01:05:49.438570 25363 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce964fa069ac4f97bcc2169faed31f1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce964fa069ac4f97bcc2169faed31f1e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40065 } } peers { permanent_uuid: "3a83daa7b9744865996084b4543e8670" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38555 } } peers { permanent_uuid: "532d110f0b3c4021a94718c3fc78cfe0" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 } }
I20260806 01:05:49.438751 25363 raft_consensus.cc:374] T 00000000000000000000000000000000 P ce964fa069ac4f97bcc2169faed31f1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:05:49.438803 25363 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce964fa069ac4f97bcc2169faed31f1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce964fa069ac4f97bcc2169faed31f1e, State: Initialized, Role: FOLLOWER
I20260806 01:05:49.438938 25363 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce964fa069ac4f97bcc2169faed31f1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce964fa069ac4f97bcc2169faed31f1e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40065 } } peers { permanent_uuid: "3a83daa7b9744865996084b4543e8670" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38555 } } peers { permanent_uuid: "532d110f0b3c4021a94718c3fc78cfe0" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 } }
I20260806 01:05:49.439334 25363 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce964fa069ac4f97bcc2169faed31f1e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:05:49.439580 25529 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce964fa069ac4f97bcc2169faed31f1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce964fa069ac4f97bcc2169faed31f1e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40065 } } peers { permanent_uuid: "3a83daa7b9744865996084b4543e8670" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38555 } } peers { permanent_uuid: "532d110f0b3c4021a94718c3fc78cfe0" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 } } }
I20260806 01:05:49.439769 25529 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce964fa069ac4f97bcc2169faed31f1e [sys.catalog]: This master's current role is: FOLLOWER
Aug 06 01:05:49 dist-test-slave-69rg krb5kdc[25278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978349, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.124@KRBTEST.COM for kudu/127.11.88.125@KRBTEST.COM
W20260806 01:05:49.441628 25540 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ce964fa069ac4f97bcc2169faed31f1e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 01:05:49.441733 25540 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 06 01:05:49 dist-test-slave-69rg krb5kdc[25278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978348, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:05:49.444519 25444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.436314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55406 (local address 127.11.88.125:38555)
0806 01:05:49.436363 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:49.436366 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:49.436375 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:05:49.436447 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:49.436448 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:49.436460 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:49.436534 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:49.436849 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.437562 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.438588 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.438870 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.438921 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:49.441190 (+ 2269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:49.441191 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:49.441192 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:49.441200 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:49.443173 (+ 1973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.443602 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.443604 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.443604 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.443693 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.443942 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.443943 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.443943 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.444079 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:49.444124 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:49.444340 (+ 216us) server_negotiation.cc:299] Negotiation successful
0806 01:05:49.444424 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 01:05:49.445092 25525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.436233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:38555 (local address 127.0.0.1:55406)
0806 01:05:49.436341 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:49.436351 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:49.436385 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:49.436545 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:49.436545 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:49.436692 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:05:49.436738 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:49.436741 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.437667 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.437668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:49.438463 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:49.438466 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.439004 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.439005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:49.439068 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:49.439492 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:05:49.439497 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:05:49.441077 (+ 1580us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:05:49.443274 (+ 2197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:49.443275 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:49.443276 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:49.443485 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:49.443787 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:49.443789 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:49.443789 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:49.443863 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:49.444175 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:05:49.444176 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:05:49.444223 (+ 47us) client_negotiation.cc:769] Sending connection context
0806 01:05:49.444801 (+ 578us) client_negotiation.cc:240] Negotiation successful
0806 01:05:49.444909 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92}
I20260806 01:05:49.446153 25522 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 } has no permanent_uuid. Determining permanent_uuid...
I20260806 01:05:49.442889 25292 master_runner.cc:186] Error getting master registration for 127.11.88.125:38555: OK, instance_id { permanent_uuid: "3a83daa7b9744865996084b4543e8670" instance_seqno: 1785978349244384 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 01:05:49.446739 25292 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 01:05:49.447995 25366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.438493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41774 (local address 127.11.88.126:40065)
0806 01:05:49.438538 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:49.438540 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:49.438548 (+ 8us) server_negotiation.cc:407] Connection header received
0806 01:05:49.438630 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:49.438630 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:49.438641 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:49.438702 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:49.439416 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.440184 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.441325 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.441667 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.441739 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:49.444738 (+ 2999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:49.444739 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:49.444740 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:49.444748 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:49.446671 (+ 1923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.447129 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.447131 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.447131 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.447197 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.447431 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.447432 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.447432 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.447578 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:49.447755 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:49.447826 (+ 71us) server_negotiation.cc:299] Negotiation successful
0806 01:05:49.447911 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
Aug 06 01:05:49 dist-test-slave-69rg krb5kdc[25278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978349, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.124@KRBTEST.COM for kudu/127.11.88.124@KRBTEST.COM
Aug 06 01:05:49 dist-test-slave-69rg krb5kdc[25278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978348, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.125@KRBTEST.COM
I20260806 01:05:49.455001 25526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.446472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38242 (local address 127.11.88.124:34575)
0806 01:05:49.446514 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:49.446517 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:49.446563 (+ 46us) server_negotiation.cc:407] Connection header received
0806 01:05:49.446650 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:49.446652 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:49.446661 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:49.446688 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:49.447019 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.447825 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.448641 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.449006 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.449079 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:49.451156 (+ 2077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:49.451157 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:49.451158 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:49.451166 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:49.452915 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.453306 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.453307 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.453307 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.453362 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.454248 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.454249 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.454250 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.454460 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:49.454544 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:49.454733 (+ 189us) server_negotiation.cc:299] Negotiation successful
0806 01:05:49.454841 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 01:05:49.455056 25525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.446411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:34575 (local address 127.0.0.1:38242)
0806 01:05:49.446502 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:49.446512 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:49.446586 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:49.446738 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:49.446738 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:49.446887 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:05:49.446923 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:49.446925 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.447930 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.447931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:49.448525 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:49.448528 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.449083 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.449084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:49.449148 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:49.449581 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:05:49.449586 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:05:49.451053 (+ 1467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:05:49.453042 (+ 1989us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:49.453043 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:49.453043 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:49.453225 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:49.454098 (+ 873us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:49.454099 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:49.454100 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:49.454167 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:49.454560 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:05:49.454561 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:05:49.454611 (+ 50us) client_negotiation.cc:769] Sending connection context
0806 01:05:49.454697 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 01:05:49.454911 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74,"mutex_wait_us":53}
I20260806 01:05:49.457401 25522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 532d110f0b3c4021a94718c3fc78cfe0: Bootstrap starting.
I20260806 01:05:49.458245 25522 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 532d110f0b3c4021a94718c3fc78cfe0: Neither blocks nor log segments found. Creating new log.
I20260806 01:05:49.458460 25444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.448911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55416 (local address 127.11.88.125:38555)
0806 01:05:49.448982 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:49.448984 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:49.448998 (+ 14us) server_negotiation.cc:407] Connection header received
0806 01:05:49.449089 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:49.449090 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:49.449103 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:49.449137 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:49.449686 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.450400 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.451374 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.451676 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.451755 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:49.454762 (+ 3007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:49.454763 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:49.454764 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:49.454771 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:49.456451 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.456839 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.456841 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.456841 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.456906 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.457152 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.457153 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.457153 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.457278 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:49.458208 (+ 930us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:49.458248 (+ 40us) server_negotiation.cc:299] Negotiation successful
0806 01:05:49.458360 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 01:05:49.458559 25522 log.cc:824] T 00000000000000000000000000000000 P 532d110f0b3c4021a94718c3fc78cfe0: Log is configured to *not* fsync() on all Append() calls
I20260806 01:05:49.459527 25522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 532d110f0b3c4021a94718c3fc78cfe0: No bootstrap required, opened a new log
I20260806 01:05:49.459918 11617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 01:05:49.461557 25522 raft_consensus.cc:348] T 00000000000000000000000000000000 P 532d110f0b3c4021a94718c3fc78cfe0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce964fa069ac4f97bcc2169faed31f1e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40065 } } peers { permanent_uuid: "3a83daa7b9744865996084b4543e8670" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38555 } } peers { permanent_uuid: "532d110f0b3c4021a94718c3fc78cfe0" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 } }
I20260806 01:05:49.461793 25522 raft_consensus.cc:374] T 00000000000000000000000000000000 P 532d110f0b3c4021a94718c3fc78cfe0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:05:49.461920 25522 raft_consensus.cc:729] T 00000000000000000000000000000000 P 532d110f0b3c4021a94718c3fc78cfe0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 532d110f0b3c4021a94718c3fc78cfe0, State: Initialized, Role: FOLLOWER
I20260806 01:05:49.462116 25522 consensus_queue.cc:260] T 00000000000000000000000000000000 P 532d110f0b3c4021a94718c3fc78cfe0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce964fa069ac4f97bcc2169faed31f1e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40065 } } peers { permanent_uuid: "3a83daa7b9744865996084b4543e8670" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38555 } } peers { permanent_uuid: "532d110f0b3c4021a94718c3fc78cfe0" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 } }
I20260806 01:05:49.462481 25522 sys_catalog.cc:564] T 00000000000000000000000000000000 P 532d110f0b3c4021a94718c3fc78cfe0 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 01:05:49.464641 25562 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 532d110f0b3c4021a94718c3fc78cfe0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 01:05:49.464743 25562 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 01:05:49.465235 25550 sys_catalog.cc:455] T 00000000000000000000000000000000 P 532d110f0b3c4021a94718c3fc78cfe0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce964fa069ac4f97bcc2169faed31f1e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40065 } } peers { permanent_uuid: "3a83daa7b9744865996084b4543e8670" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38555 } } peers { permanent_uuid: "532d110f0b3c4021a94718c3fc78cfe0" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 } } }
I20260806 01:05:49.465379 25550 sys_catalog.cc:458] T 00000000000000000000000000000000 P 532d110f0b3c4021a94718c3fc78cfe0 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 01:05:49.467088 25447 master_runner.cc:186] Error getting master registration for 127.11.88.125:38555: OK, instance_id { permanent_uuid: "3a83daa7b9744865996084b4543e8670" instance_seqno: 1785978349244384 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 01:05:49.470192 25447 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 01:05:49.475085 25366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.461769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41782 (local address 127.11.88.126:40065)
0806 01:05:49.461838 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:49.461840 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:49.461849 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:05:49.461874 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:49.461875 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:49.461887 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:49.461943 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:49.462921 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.463776 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.468826 (+ 5050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.469169 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.469214 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:49.471831 (+ 2617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:49.471833 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:49.471833 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:49.471841 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:49.473700 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.474194 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.474196 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.474196 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.474257 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.474451 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.474452 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.474452 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.474591 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:49.474669 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:49.474903 (+ 234us) server_negotiation.cc:299] Negotiation successful
0806 01:05:49.474986 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 01:05:49.475102 25526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.461864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38244 (local address 127.11.88.124:34575)
0806 01:05:49.461904 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:49.461906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:49.462445 (+ 539us) server_negotiation.cc:407] Connection header received
0806 01:05:49.462554 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:49.462555 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:49.462566 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:49.462612 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:49.463271 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.464032 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.467983 (+ 3951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.468319 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.468367 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:49.470471 (+ 2104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:49.470473 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:49.470474 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:49.470483 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:49.472631 (+ 2148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.474080 (+ 1449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.474081 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.474082 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.474142 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.474397 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.474398 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.474398 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.474531 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:49.474630 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:49.474908 (+ 278us) server_negotiation.cc:299] Negotiation successful
0806 01:05:49.475001 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 01:05:49.475114 25444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.461383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55420 (local address 127.11.88.125:38555)
0806 01:05:49.461427 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:49.461429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:49.462021 (+ 592us) server_negotiation.cc:407] Connection header received
0806 01:05:49.462126 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:49.462127 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:49.462137 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:49.462170 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:49.464485 (+ 2315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.465208 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.468781 (+ 3573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.469094 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.469157 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:49.470827 (+ 1670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:49.470829 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:49.470829 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:49.470839 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:49.473433 (+ 2594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.474041 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.474043 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.474043 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.474123 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.474384 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.474385 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.474386 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.474531 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:49.474639 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:49.474905 (+ 266us) server_negotiation.cc:299] Negotiation successful
0806 01:05:49.475000 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 01:05:49.485553 25440 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 } attempt: 3
Aug 06 01:05:49 dist-test-slave-69rg krb5kdc[25278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978349, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.125@KRBTEST.COM for kudu/127.11.88.124@KRBTEST.COM
I20260806 01:05:49.494884 25526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.486045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38246 (local address 127.11.88.124:34575)
0806 01:05:49.486106 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:49.486108 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:49.486118 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:05:49.486172 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:49.486173 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:49.486184 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:49.486251 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:49.486651 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.487402 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.488502 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.488815 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.488885 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:49.491631 (+ 2746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:49.491633 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:49.491633 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:49.491641 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:49.493470 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.493988 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.493990 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.493990 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.494055 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:49.494291 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:49.494292 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:49.494293 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:49.494435 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:49.494505 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:49.494703 (+ 198us) server_negotiation.cc:299] Negotiation successful
0806 01:05:49.494783 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 01:05:49.494894 25442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:49.485996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:34575 (local address 127.0.0.1:38246)
0806 01:05:49.486045 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:49.486059 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:49.486108 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:49.486272 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:49.486273 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:49.486487 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:05:49.486548 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:49.486550 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.487496 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.487497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:49.488395 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:49.488398 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:49.488900 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:49.488902 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:49.488969 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:49.489524 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:05:49.489530 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:05:49.491533 (+ 2003us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:05:49.493605 (+ 2072us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:49.493606 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:49.493607 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:49.493908 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:49.494139 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:49.494140 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:49.494140 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:49.494217 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:49.494513 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:05:49.494515 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:05:49.494571 (+ 56us) client_negotiation.cc:769] Sending connection context
0806 01:05:49.494665 (+ 94us) client_negotiation.cc:240] Negotiation successful
0806 01:05:49.494776 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260806 01:05:49.497274 25440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670: Bootstrap starting.
I20260806 01:05:49.498231 25440 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670: Neither blocks nor log segments found. Creating new log.
I20260806 01:05:49.498618 25440 log.cc:824] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670: Log is configured to *not* fsync() on all Append() calls
I20260806 01:05:49.500399 25440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670: No bootstrap required, opened a new log
I20260806 01:05:49.502770 25440 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce964fa069ac4f97bcc2169faed31f1e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40065 } } peers { permanent_uuid: "3a83daa7b9744865996084b4543e8670" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38555 } } peers { permanent_uuid: "532d110f0b3c4021a94718c3fc78cfe0" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 } }
I20260806 01:05:49.502933 25440 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:05:49.502971 25440 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a83daa7b9744865996084b4543e8670, State: Initialized, Role: FOLLOWER
I20260806 01:05:49.503193 25440 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce964fa069ac4f97bcc2169faed31f1e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40065 } } peers { permanent_uuid: "3a83daa7b9744865996084b4543e8670" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38555 } } peers { permanent_uuid: "532d110f0b3c4021a94718c3fc78cfe0" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 } }
I20260806 01:05:49.503628 25440 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:05:49.503585 25565 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce964fa069ac4f97bcc2169faed31f1e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40065 } } peers { permanent_uuid: "3a83daa7b9744865996084b4543e8670" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38555 } } peers { permanent_uuid: "532d110f0b3c4021a94718c3fc78cfe0" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 } } }
I20260806 01:05:49.503808 25565 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [sys.catalog]: This master's current role is: FOLLOWER
W20260806 01:05:49.505749 25578 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 01:05:49.505900 25578 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 01:05:49.508397 25370 master_runner.cc:263] No leader master found from master 3a83daa7b9744865996084b4543e8670
I20260806 01:05:49.508467 25370 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260806 01:05:49.571682 25314 tablet.cc:2369] T 00000000000000000000000000000000 P ce964fa069ac4f97bcc2169faed31f1e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 01:05:49.665620 25473 tablet.cc:2369] T 00000000000000000000000000000000 P 532d110f0b3c4021a94718c3fc78cfe0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 01:05:49.742161 25392 tablet.cc:2369] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 01:05:49.794142 25565 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:05:49.794337 25565 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce964fa069ac4f97bcc2169faed31f1e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40065 } } peers { permanent_uuid: "3a83daa7b9744865996084b4543e8670" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38555 } } peers { permanent_uuid: "532d110f0b3c4021a94718c3fc78cfe0" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 } }
I20260806 01:05:49.794632 25565 leader_election.cc:288] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce964fa069ac4f97bcc2169faed31f1e (127.11.88.126:40065), 532d110f0b3c4021a94718c3fc78cfe0 (127.11.88.124:34575)
I20260806 01:05:49.795109 25495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3a83daa7b9744865996084b4543e8670" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532d110f0b3c4021a94718c3fc78cfe0" is_pre_election: true
I20260806 01:05:49.795295 25495 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 532d110f0b3c4021a94718c3fc78cfe0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a83daa7b9744865996084b4543e8670 in term 0.
I20260806 01:05:49.795213 25336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3a83daa7b9744865996084b4543e8670" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce964fa069ac4f97bcc2169faed31f1e" is_pre_election: true
I20260806 01:05:49.795581 25387 leader_election.cc:302] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a83daa7b9744865996084b4543e8670, 532d110f0b3c4021a94718c3fc78cfe0; no voters:
I20260806 01:05:49.795693 25336 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ce964fa069ac4f97bcc2169faed31f1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a83daa7b9744865996084b4543e8670 in term 0.
I20260806 01:05:49.795743 25565 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:05:49.795814 25565 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:05:49.795847 25565 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:05:49.796911 25565 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce964fa069ac4f97bcc2169faed31f1e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40065 } } peers { permanent_uuid: "3a83daa7b9744865996084b4543e8670" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38555 } } peers { permanent_uuid: "532d110f0b3c4021a94718c3fc78cfe0" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 } }
I20260806 01:05:49.797092 25565 leader_election.cc:288] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [CANDIDATE]: Term 1 election: Requested vote from peers ce964fa069ac4f97bcc2169faed31f1e (127.11.88.126:40065), 532d110f0b3c4021a94718c3fc78cfe0 (127.11.88.124:34575)
I20260806 01:05:49.797232 25336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3a83daa7b9744865996084b4543e8670" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce964fa069ac4f97bcc2169faed31f1e"
I20260806 01:05:49.797268 25495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3a83daa7b9744865996084b4543e8670" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532d110f0b3c4021a94718c3fc78cfe0"
I20260806 01:05:49.797351 25336 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce964fa069ac4f97bcc2169faed31f1e [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:05:49.797379 25495 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 532d110f0b3c4021a94718c3fc78cfe0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:05:49.798276 25495 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 532d110f0b3c4021a94718c3fc78cfe0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a83daa7b9744865996084b4543e8670 in term 1.
I20260806 01:05:49.798286 25336 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ce964fa069ac4f97bcc2169faed31f1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a83daa7b9744865996084b4543e8670 in term 1.
I20260806 01:05:49.798462 25387 leader_election.cc:302] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a83daa7b9744865996084b4543e8670, 532d110f0b3c4021a94718c3fc78cfe0; no voters:
I20260806 01:05:49.798570 25565 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:05:49.798715 25565 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [term 1 LEADER]: Becoming Leader. State: Replica: 3a83daa7b9744865996084b4543e8670, State: Running, Role: LEADER
I20260806 01:05:49.798834 25565 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce964fa069ac4f97bcc2169faed31f1e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40065 } } peers { permanent_uuid: "3a83daa7b9744865996084b4543e8670" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38555 } } peers { permanent_uuid: "532d110f0b3c4021a94718c3fc78cfe0" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 } }
I20260806 01:05:49.799239 25580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a83daa7b9744865996084b4543e8670. Latest consensus state: current_term: 1 leader_uuid: "3a83daa7b9744865996084b4543e8670" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce964fa069ac4f97bcc2169faed31f1e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40065 } } peers { permanent_uuid: "3a83daa7b9744865996084b4543e8670" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38555 } } peers { permanent_uuid: "532d110f0b3c4021a94718c3fc78cfe0" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 } } }
I20260806 01:05:49.799341 25580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [sys.catalog]: This master's current role is: LEADER
I20260806 01:05:49.799551 25582 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:05:49.799747 25582 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:05:49.801173 25336 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ce964fa069ac4f97bcc2169faed31f1e [term 1 FOLLOWER]: Refusing update from remote peer 3a83daa7b9744865996084b4543e8670: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:05:49.801172 25495 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 532d110f0b3c4021a94718c3fc78cfe0 [term 1 FOLLOWER]: Refusing update from remote peer 3a83daa7b9744865996084b4543e8670: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:05:49.801496 25580 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [LEADER]: Connected to new peer: Peer: permanent_uuid: "532d110f0b3c4021a94718c3fc78cfe0" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:05:49.801609 25565 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce964fa069ac4f97bcc2169faed31f1e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:05:49.802851 25529 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce964fa069ac4f97bcc2169faed31f1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a83daa7b9744865996084b4543e8670. Latest consensus state: current_term: 1 leader_uuid: "3a83daa7b9744865996084b4543e8670" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce964fa069ac4f97bcc2169faed31f1e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40065 } } peers { permanent_uuid: "3a83daa7b9744865996084b4543e8670" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38555 } } peers { permanent_uuid: "532d110f0b3c4021a94718c3fc78cfe0" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 } } }
I20260806 01:05:49.802877 25550 sys_catalog.cc:455] T 00000000000000000000000000000000 P 532d110f0b3c4021a94718c3fc78cfe0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a83daa7b9744865996084b4543e8670. Latest consensus state: current_term: 1 leader_uuid: "3a83daa7b9744865996084b4543e8670" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce964fa069ac4f97bcc2169faed31f1e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40065 } } peers { permanent_uuid: "3a83daa7b9744865996084b4543e8670" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38555 } } peers { permanent_uuid: "532d110f0b3c4021a94718c3fc78cfe0" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 } } }
I20260806 01:05:49.802946 25529 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce964fa069ac4f97bcc2169faed31f1e [sys.catalog]: This master's current role is: FOLLOWER
I20260806 01:05:49.802959 25550 sys_catalog.cc:458] T 00000000000000000000000000000000 P 532d110f0b3c4021a94718c3fc78cfe0 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 01:05:49.803999 25580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3a83daa7b9744865996084b4543e8670" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce964fa069ac4f97bcc2169faed31f1e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40065 } } peers { permanent_uuid: "3a83daa7b9744865996084b4543e8670" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38555 } } peers { permanent_uuid: "532d110f0b3c4021a94718c3fc78cfe0" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 } } }
I20260806 01:05:49.804117 25580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [sys.catalog]: This master's current role is: LEADER
I20260806 01:05:49.804175 25580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3a83daa7b9744865996084b4543e8670" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce964fa069ac4f97bcc2169faed31f1e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40065 } } peers { permanent_uuid: "3a83daa7b9744865996084b4543e8670" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38555 } } peers { permanent_uuid: "532d110f0b3c4021a94718c3fc78cfe0" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 } } }
I20260806 01:05:49.804157 25550 sys_catalog.cc:455] T 00000000000000000000000000000000 P 532d110f0b3c4021a94718c3fc78cfe0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3a83daa7b9744865996084b4543e8670" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce964fa069ac4f97bcc2169faed31f1e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40065 } } peers { permanent_uuid: "3a83daa7b9744865996084b4543e8670" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38555 } } peers { permanent_uuid: "532d110f0b3c4021a94718c3fc78cfe0" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 } } }
I20260806 01:05:49.804225 25580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670 [sys.catalog]: This master's current role is: LEADER
I20260806 01:05:49.804250 25550 sys_catalog.cc:458] T 00000000000000000000000000000000 P 532d110f0b3c4021a94718c3fc78cfe0 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 01:05:49.804271 25583 mvcc.cc:205] Tried to move back new op lower bound from 7315367320783159296 to 7315367320776806400. Current Snapshot: MvccSnapshot[applied={T|T < 7315367320783159296}]
I20260806 01:05:49.804442 25582 catalog_manager.cc:1347] Generated new cluster ID: 28d28edf498b40feb33c7e0b4527e443
I20260806 01:05:49.804483 25582 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:05:49.804771 25529 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce964fa069ac4f97bcc2169faed31f1e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3a83daa7b9744865996084b4543e8670" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce964fa069ac4f97bcc2169faed31f1e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 40065 } } peers { permanent_uuid: "3a83daa7b9744865996084b4543e8670" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 38555 } } peers { permanent_uuid: "532d110f0b3c4021a94718c3fc78cfe0" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 34575 } } }
I20260806 01:05:49.804867 25529 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce964fa069ac4f97bcc2169faed31f1e [sys.catalog]: This master's current role is: FOLLOWER
I20260806 01:05:49.818967 25582 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:05:49.819651 25582 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:05:49.827297 25582 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a83daa7b9744865996084b4543e8670: Generated new TSK 0
I20260806 01:05:49.827617 25582 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:05:50.442325 25540 catalog_manager.cc:1259] Loaded cluster ID: 28d28edf498b40feb33c7e0b4527e443
I20260806 01:05:50.442412 25540 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ce964fa069ac4f97bcc2169faed31f1e: loading cluster ID for follower catalog manager: success
I20260806 01:05:50.443271 25540 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ce964fa069ac4f97bcc2169faed31f1e: acquiring CA information for follower catalog manager: success
I20260806 01:05:50.443540 25540 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ce964fa069ac4f97bcc2169faed31f1e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 01:05:50.465246 25562 catalog_manager.cc:1259] Loaded cluster ID: 28d28edf498b40feb33c7e0b4527e443
I20260806 01:05:50.465329 25562 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 532d110f0b3c4021a94718c3fc78cfe0: loading cluster ID for follower catalog manager: success
I20260806 01:05:50.466192 25562 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 532d110f0b3c4021a94718c3fc78cfe0: acquiring CA information for follower catalog manager: success
I20260806 01:05:50.466538 25562 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 532d110f0b3c4021a94718c3fc78cfe0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 01:05:50.902840 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 25292
I20260806 01:05:50.909650 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 25370
I20260806 01:05:50.915488 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 25447
2026-08-06T01:05:50Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3203 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:05:50 dist-test-slave-69rg krb5kdc[25599](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:05:50 dist-test-slave-69rg krb5kdc[25599](info): set up 2 sockets
Aug 06 01:05:50 dist-test-slave-69rg krb5kdc[25599](info): commencing operation
krb5kdc: starting...
W20260806 01:05:52.015486 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.079s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:05:52 dist-test-slave-69rg krb5kdc[25599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978352, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:05:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:05:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:05:52.165472 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:39671
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:34763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:39671
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:05:52.256513 25613 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:05:52.256796 25613 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:05:52.256824 25613 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:05:52.258126 25613 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:05:52.258184 25613 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:05:52.258200 25613 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:05:52.258213 25613 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:05:52.258226 25613 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:05:52.259876 25613 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:34763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:39671
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:39671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25613
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:05:52.260233 25613 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:05:52.260455 25613 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:05:52.266515 25619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:52.266629 25618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:52.266629 25621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:52.267346 25613 server_base.cc:1034] running on GCE node
I20260806 01:05:52.267601 25613 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:05:52.267916 25613 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:05:52.269112 25613 hybrid_clock.cc:648] HybridClock initialized: now 1785978352269091 us; error 35 us; skew 500 ppm
Aug 06 01:05:52 dist-test-slave-69rg krb5kdc[25599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978352, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:05:52.278812 25613 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:05:52.279726 25613 webserver.cc:460] Webserver started at http://127.11.88.126:45231/ using document root <none> and password file <none>
I20260806 01:05:52.280061 25613 fs_manager.cc:359] Metadata directory not provided
I20260806 01:05:52.280170 25613 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:05:52.280341 25613 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:05:52.281617 25613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "68eed98465b84c8c8a3fc459602bd4d5"
format_stamp: "Formatted at 2026-08-06 01:05:52 on dist-test-slave-69rg"
server_key: "f3bec05bd0f63172765acd7a07f0daae"
server_key_iv: "9e593417d6e81cf68e43437ad9a68b3f"
server_key_version: "encryptionkey@0"
I20260806 01:05:52.282092 25613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "68eed98465b84c8c8a3fc459602bd4d5"
format_stamp: "Formatted at 2026-08-06 01:05:52 on dist-test-slave-69rg"
server_key: "f3bec05bd0f63172765acd7a07f0daae"
server_key_iv: "9e593417d6e81cf68e43437ad9a68b3f"
server_key_version: "encryptionkey@0"
I20260806 01:05:52.283872 25613 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260806 01:05:52.284855 25628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:52.285105 25613 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:05:52.285226 25613 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "68eed98465b84c8c8a3fc459602bd4d5"
format_stamp: "Formatted at 2026-08-06 01:05:52 on dist-test-slave-69rg"
server_key: "f3bec05bd0f63172765acd7a07f0daae"
server_key_iv: "9e593417d6e81cf68e43437ad9a68b3f"
server_key_version: "encryptionkey@0"
I20260806 01:05:52.285332 25613 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:05:52.294052 25613 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:05:52.296208 25613 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:05:52.296434 25613 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:05:52.301123 25613 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:39671
I20260806 01:05:52.301192 25681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:39671 every 8 connection(s)
I20260806 01:05:52.301596 25613 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:05:52.302182 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 25613
I20260806 01:05:52.302311 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:05:52.302503 11617 external_mini_cluster.cc:1428] Setting key d994ea71fadc1b585c70e7502ddaf084
I20260806 01:05:52.302688 25682 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:05:52.306222 25682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68eed98465b84c8c8a3fc459602bd4d5: Bootstrap starting.
I20260806 01:05:52.306962 25682 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68eed98465b84c8c8a3fc459602bd4d5: Neither blocks nor log segments found. Creating new log.
I20260806 01:05:52.307301 25682 log.cc:824] T 00000000000000000000000000000000 P 68eed98465b84c8c8a3fc459602bd4d5: Log is configured to *not* fsync() on all Append() calls
I20260806 01:05:52.308085 25682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68eed98465b84c8c8a3fc459602bd4d5: No bootstrap required, opened a new log
Aug 06 01:05:52 dist-test-slave-69rg krb5kdc[25599](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978352, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:05:52.310679 25682 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68eed98465b84c8c8a3fc459602bd4d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68eed98465b84c8c8a3fc459602bd4d5" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39671 } }
I20260806 01:05:52.310881 25682 raft_consensus.cc:374] T 00000000000000000000000000000000 P 68eed98465b84c8c8a3fc459602bd4d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:05:52.310925 25682 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68eed98465b84c8c8a3fc459602bd4d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68eed98465b84c8c8a3fc459602bd4d5, State: Initialized, Role: FOLLOWER
I20260806 01:05:52.311066 25682 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68eed98465b84c8c8a3fc459602bd4d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68eed98465b84c8c8a3fc459602bd4d5" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39671 } }
I20260806 01:05:52.311154 25682 raft_consensus.cc:388] T 00000000000000000000000000000000 P 68eed98465b84c8c8a3fc459602bd4d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:05:52.311178 25682 raft_consensus.cc:482] T 00000000000000000000000000000000 P 68eed98465b84c8c8a3fc459602bd4d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:05:52.311239 25682 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68eed98465b84c8c8a3fc459602bd4d5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:05:52.311866 25682 raft_consensus.cc:504] T 00000000000000000000000000000000 P 68eed98465b84c8c8a3fc459602bd4d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68eed98465b84c8c8a3fc459602bd4d5" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39671 } }
I20260806 01:05:52.311995 25682 leader_election.cc:302] T 00000000000000000000000000000000 P 68eed98465b84c8c8a3fc459602bd4d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68eed98465b84c8c8a3fc459602bd4d5; no voters:
I20260806 01:05:52.312192 25682 leader_election.cc:288] T 00000000000000000000000000000000 P 68eed98465b84c8c8a3fc459602bd4d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:05:52.312263 25687 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 68eed98465b84c8c8a3fc459602bd4d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:05:52.312456 25687 raft_consensus.cc:686] T 00000000000000000000000000000000 P 68eed98465b84c8c8a3fc459602bd4d5 [term 1 LEADER]: Becoming Leader. State: Replica: 68eed98465b84c8c8a3fc459602bd4d5, State: Running, Role: LEADER
I20260806 01:05:52.312505 25682 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68eed98465b84c8c8a3fc459602bd4d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:05:52.312624 25687 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68eed98465b84c8c8a3fc459602bd4d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68eed98465b84c8c8a3fc459602bd4d5" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39671 } }
I20260806 01:05:52.313344 25687 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68eed98465b84c8c8a3fc459602bd4d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68eed98465b84c8c8a3fc459602bd4d5. Latest consensus state: current_term: 1 leader_uuid: "68eed98465b84c8c8a3fc459602bd4d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68eed98465b84c8c8a3fc459602bd4d5" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39671 } } }
I20260806 01:05:52.313444 25687 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68eed98465b84c8c8a3fc459602bd4d5 [sys.catalog]: This master's current role is: LEADER
I20260806 01:05:52.313422 25689 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68eed98465b84c8c8a3fc459602bd4d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "68eed98465b84c8c8a3fc459602bd4d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68eed98465b84c8c8a3fc459602bd4d5" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39671 } } }
I20260806 01:05:52.313511 25689 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68eed98465b84c8c8a3fc459602bd4d5 [sys.catalog]: This master's current role is: LEADER
I20260806 01:05:52.314162 25695 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:05:52.314461 25685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:52.303081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58968 (local address 127.11.88.126:39671)
0806 01:05:52.303292 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:52.303301 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:52.303336 (+ 35us) server_negotiation.cc:407] Connection header received
0806 01:05:52.303863 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:52.303869 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:52.303916 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:52.304033 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:52.304884 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:52.305756 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:52.306820 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:52.307281 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:52.307362 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:52.310117 (+ 2755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:52.310122 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:52.310123 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:52.310142 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:52.312434 (+ 2292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:52.312931 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:52.312935 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:52.312935 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:52.313060 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:52.313287 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:52.313288 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:52.313288 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:52.313607 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:52.313742 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:52.314089 (+ 347us) server_negotiation.cc:299] Negotiation successful
0806 01:05:52.314248 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":111,"threads_started":1}
I20260806 01:05:52.315129 25695 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:05:52.315688 11617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 01:05:52.316911 25695 catalog_manager.cc:1347] Generated new cluster ID: ced881ca059943a98bc7181d6381b7f3
I20260806 01:05:52.316967 25695 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:05:52.329319 25695 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:05:52.330080 25695 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:05:52.333405 25695 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 68eed98465b84c8c8a3fc459602bd4d5: Generated new TSK 0
I20260806 01:05:52.333652 25695 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:05:52.370028 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 25613
2026-08-06T01:05:52Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1453 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:05:52 dist-test-slave-69rg krb5kdc[25712](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:05:52 dist-test-slave-69rg krb5kdc[25712](info): set up 2 sockets
Aug 06 01:05:52 dist-test-slave-69rg krb5kdc[25712](info): commencing operation
krb5kdc: starting...
W20260806 01:05:53.478886 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.090s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:05:53 dist-test-slave-69rg krb5kdc[25712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978353, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:05:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:05:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:05:53.612833 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:42229
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:40623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:42229
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:05:53.698159 25726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:05:53.698518 25726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:05:53.698566 25726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:05:53.699880 25726 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:05:53.699980 25726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:05:53.700008 25726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:05:53.700040 25726 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:05:53.700063 25726 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:05:53.702075 25726 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:42229
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:42229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25726
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:05:53.702411 25726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:05:53.702669 25726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:05:53.708216 25734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:53.708209 25732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:53.708216 25731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:53.708353 25726 server_base.cc:1034] running on GCE node
I20260806 01:05:53.708719 25726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:05:53.709055 25726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:05:53.710215 25726 hybrid_clock.cc:648] HybridClock initialized: now 1785978353710194 us; error 45 us; skew 500 ppm
Aug 06 01:05:53 dist-test-slave-69rg krb5kdc[25712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978353, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:05:53.712949 25726 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:05:53.713526 25726 webserver.cc:460] Webserver started at http://127.11.88.126:35867/ using document root <none> and password file <none>
I20260806 01:05:53.713852 25726 fs_manager.cc:359] Metadata directory not provided
I20260806 01:05:53.713948 25726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:05:53.714123 25726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:05:53.715241 25726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "0338673d295e4fa2a4b7c938441dfb0b"
format_stamp: "Formatted at 2026-08-06 01:05:53 on dist-test-slave-69rg"
server_key: "6d358b7212a97664e23a5a678ef2d0ed"
server_key_iv: "06c0aa044843510cf92bf6cf441bb9de"
server_key_version: "encryptionkey@0"
I20260806 01:05:53.715648 25726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "0338673d295e4fa2a4b7c938441dfb0b"
format_stamp: "Formatted at 2026-08-06 01:05:53 on dist-test-slave-69rg"
server_key: "6d358b7212a97664e23a5a678ef2d0ed"
server_key_iv: "06c0aa044843510cf92bf6cf441bb9de"
server_key_version: "encryptionkey@0"
I20260806 01:05:53.717222 25726 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:05:53.718201 25742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:53.718461 25726 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:05:53.718586 25726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "0338673d295e4fa2a4b7c938441dfb0b"
format_stamp: "Formatted at 2026-08-06 01:05:53 on dist-test-slave-69rg"
server_key: "6d358b7212a97664e23a5a678ef2d0ed"
server_key_iv: "06c0aa044843510cf92bf6cf441bb9de"
server_key_version: "encryptionkey@0"
I20260806 01:05:53.718672 25726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:05:53.750226 25726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:05:53.752660 25726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:05:53.752877 25726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:05:53.757597 25726 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:42229
I20260806 01:05:53.757630 25795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:42229 every 8 connection(s)
I20260806 01:05:53.758061 25726 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:05:53.759120 25796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:05:53.759174 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 25726
I20260806 01:05:53.759308 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:05:53.759531 11617 external_mini_cluster.cc:1428] Setting key 471fa15838835c4ec810704da4d8fac7
I20260806 01:05:53.763000 25796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b: Bootstrap starting.
I20260806 01:05:53.763887 25796 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b: Neither blocks nor log segments found. Creating new log.
I20260806 01:05:53.764206 25796 log.cc:824] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b: Log is configured to *not* fsync() on all Append() calls
I20260806 01:05:53.764974 25796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b: No bootstrap required, opened a new log
I20260806 01:05:53.767292 25796 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0338673d295e4fa2a4b7c938441dfb0b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42229 } }
I20260806 01:05:53.767508 25796 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:05:53.767550 25796 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0338673d295e4fa2a4b7c938441dfb0b, State: Initialized, Role: FOLLOWER
Aug 06 01:05:53 dist-test-slave-69rg krb5kdc[25712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978353, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:05:53.767721 25796 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0338673d295e4fa2a4b7c938441dfb0b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42229 } }
I20260806 01:05:53.767859 25796 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:05:53.767910 25796 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:05:53.767972 25796 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:05:53.768585 25796 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0338673d295e4fa2a4b7c938441dfb0b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42229 } }
I20260806 01:05:53.768769 25796 leader_election.cc:302] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0338673d295e4fa2a4b7c938441dfb0b; no voters:
I20260806 01:05:53.768960 25796 leader_election.cc:288] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:05:53.769029 25801 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:05:53.769260 25796 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:05:53.769266 25801 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [term 1 LEADER]: Becoming Leader. State: Replica: 0338673d295e4fa2a4b7c938441dfb0b, State: Running, Role: LEADER
I20260806 01:05:53.769496 25801 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0338673d295e4fa2a4b7c938441dfb0b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42229 } }
I20260806 01:05:53.769919 25803 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0338673d295e4fa2a4b7c938441dfb0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0338673d295e4fa2a4b7c938441dfb0b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42229 } } }
I20260806 01:05:53.769940 25804 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0338673d295e4fa2a4b7c938441dfb0b. Latest consensus state: current_term: 1 leader_uuid: "0338673d295e4fa2a4b7c938441dfb0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0338673d295e4fa2a4b7c938441dfb0b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42229 } } }
I20260806 01:05:53.770076 25803 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [sys.catalog]: This master's current role is: LEADER
I20260806 01:05:53.770090 25804 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [sys.catalog]: This master's current role is: LEADER
I20260806 01:05:53.770354 25812 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:05:53.771034 25812 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:05:53.772924 25799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:53.760261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59076 (local address 127.11.88.126:42229)
0806 01:05:53.760544 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:53.760552 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:53.760581 (+ 29us) server_negotiation.cc:407] Connection header received
0806 01:05:53.761023 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:53.761030 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:53.761079 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:53.761340 (+ 261us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:53.762115 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:53.763883 (+ 1768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:53.764858 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:53.765325 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:53.765465 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:53.768369 (+ 2904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:53.768374 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:53.768374 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:53.768389 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:53.770690 (+ 2301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:53.771173 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:53.771176 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:53.771177 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:53.771367 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:53.771599 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:53.771600 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:53.771600 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:53.771931 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:53.772491 (+ 560us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:53.772566 (+ 75us) server_negotiation.cc:299] Negotiation successful
0806 01:05:53.772709 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":114,"threads_started":1}
I20260806 01:05:53.774202 25812 catalog_manager.cc:1347] Generated new cluster ID: a2df001b86784077826b493ae46d554e
I20260806 01:05:53.774258 25812 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:05:53.782972 25812 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:05:53.783578 25812 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:05:53.794718 25812 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b: Generated new TSK 0
I20260806 01:05:53.794993 25812 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.88.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
I20260806 01:05:53.832959 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:0
--local_ip_for_outbound_sockets=127.11.88.65
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:42229
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:40623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:05:53.927534 25825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:05:53.927757 25825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:05:53.927783 25825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:05:53.929049 25825 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:05:53.929095 25825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:05:53.929122 25825 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:05:53.930680 25825 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:42229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25825
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:05:53.930948 25825 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:05:53.931207 25825 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 01:05:53.936787 25825 server_base.cc:1034] running on GCE node
W20260806 01:05:53.936780 25831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:53.936946 25833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:53.936780 25830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:53.937255 25825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:05:53.937542 25825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:05:53.938717 25825 hybrid_clock.cc:648] HybridClock initialized: now 1785978353938692 us; error 40 us; skew 500 ppm
Aug 06 01:05:53 dist-test-slave-69rg krb5kdc[25712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978353, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:05:53.941428 25825 init.cc:377] Logged in from keytab as kudu/127.11.88.65@KRBTEST.COM (short username kudu)
I20260806 01:05:53.942018 25825 webserver.cc:460] Webserver started at http://127.11.88.65:32969/ using document root <none> and password file <none>
I20260806 01:05:53.942281 25825 fs_manager.cc:359] Metadata directory not provided
I20260806 01:05:53.942328 25825 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:05:53.942487 25825 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:05:53.943603 25825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/data/instance:
uuid: "135f875c21224ad2afd55b3d38ed6421"
format_stamp: "Formatted at 2026-08-06 01:05:53 on dist-test-slave-69rg"
server_key: "b5952fbe24952a48d674f884e1da7cf9"
server_key_iv: "ced809bf255401fa4a34a5706adf814b"
server_key_version: "encryptionkey@0"
I20260806 01:05:53.943989 25825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance:
uuid: "135f875c21224ad2afd55b3d38ed6421"
format_stamp: "Formatted at 2026-08-06 01:05:53 on dist-test-slave-69rg"
server_key: "b5952fbe24952a48d674f884e1da7cf9"
server_key_iv: "ced809bf255401fa4a34a5706adf814b"
server_key_version: "encryptionkey@0"
I20260806 01:05:53.945392 25825 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:05:53.946357 25840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:53.946591 25825 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 01:05:53.946702 25825 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "135f875c21224ad2afd55b3d38ed6421"
format_stamp: "Formatted at 2026-08-06 01:05:53 on dist-test-slave-69rg"
server_key: "b5952fbe24952a48d674f884e1da7cf9"
server_key_iv: "ced809bf255401fa4a34a5706adf814b"
server_key_version: "encryptionkey@0"
I20260806 01:05:53.946763 25825 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:05:53.965523 25825 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:05:53.967950 25825 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:05:53.968087 25825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:05:53.968302 25825 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:05:53.968683 25825 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:05:53.968722 25825 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:53.968778 25825 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:05:53.968807 25825 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:53.976198 25825 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:43119
I20260806 01:05:53.976253 25956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:43119 every 8 connection(s)
I20260806 01:05:53.976625 25825 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
I20260806 01:05:53.979688 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 25825
I20260806 01:05:53.979790 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance
I20260806 01:05:53.979987 11617 external_mini_cluster.cc:1428] Setting key 9fbf05940ebf0062fc5ed2aecbf056d3
Aug 06 01:05:53 dist-test-slave-69rg krb5kdc[25712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978353, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:05:53.987514 25799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:53.977376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:57045 (local address 127.11.88.126:42229)
0806 01:05:53.977478 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:53.977481 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:53.977676 (+ 195us) server_negotiation.cc:407] Connection header received
0806 01:05:53.978338 (+ 662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:53.978340 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:53.978354 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:53.978428 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:53.979546 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:53.980245 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:53.981376 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:53.981624 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:53.981726 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:53.984218 (+ 2492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:53.984220 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:53.984221 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:53.984229 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:53.985895 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:53.986370 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:53.986372 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:53.986372 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:53.986443 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:53.986759 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:53.986760 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:53.986760 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:53.986892 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:53.986985 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:53.987308 (+ 323us) server_negotiation.cc:299] Negotiation successful
0806 01:05:53.987407 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 01:05:53.987735 25959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:53.977322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.65:57045)
0806 01:05:53.977524 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:53.977578 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:53.978214 (+ 636us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:53.978502 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:53.978507 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:53.979179 (+ 672us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:05:53.979398 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:53.979404 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:53.980357 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:53.980358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:53.981266 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:53.981269 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:53.981741 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:53.981742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:53.981946 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:53.982568 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:05:53.982578 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:05:53.984097 (+ 1519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:05:53.986006 (+ 1909us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:53.986016 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:53.986018 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:53.986276 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:53.986545 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:53.986546 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:53.986547 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:53.986671 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:53.986974 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:05:53.986983 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:05:53.987145 (+ 162us) client_negotiation.cc:769] Sending connection context
0806 01:05:53.987269 (+ 124us) client_negotiation.cc:240] Negotiation successful
0806 01:05:53.987453 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":88,"threads_started":1}
WARNING: no policy specified for kudu/127.11.88.66@KRBTEST.COM; defaulting to no policy
I20260806 01:05:53.988332 25957 heartbeater.cc:347] Connected to a master server at 127.11.88.126:42229
I20260806 01:05:53.988467 25957 heartbeater.cc:464] Registering TS with master...
I20260806 01:05:53.988678 25957 heartbeater.cc:511] Master 127.11.88.126:42229 requested a full tablet report, sending...
I20260806 01:05:53.989274 25759 ts_manager.cc:194] Registered new tserver with Master: 135f875c21224ad2afd55b3d38ed6421 (127.11.88.65:43119)
I20260806 01:05:53.990010 25759 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.65@KRBTEST.COM'} at 127.11.88.65:57045
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
I20260806 01:05:54.010370 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:0
--local_ip_for_outbound_sockets=127.11.88.66
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:42229
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:40623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:05:54.100498 25963 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:05:54.100725 25963 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:05:54.100759 25963 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:05:54.102234 25963 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:05:54.102295 25963 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:05:54.102326 25963 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:05:54.103936 25963 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:42229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25963
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:05:54.104233 25963 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:05:54.104516 25963 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:05:54.110142 25971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:54.110138 25968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:54.110162 25963 server_base.cc:1034] running on GCE node
W20260806 01:05:54.110169 25969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:54.110544 25963 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:05:54.110841 25963 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:05:54.111996 25963 hybrid_clock.cc:648] HybridClock initialized: now 1785978354111962 us; error 56 us; skew 500 ppm
Aug 06 01:05:54 dist-test-slave-69rg krb5kdc[25712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978354, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:05:54.114806 25963 init.cc:377] Logged in from keytab as kudu/127.11.88.66@KRBTEST.COM (short username kudu)
I20260806 01:05:54.115278 25963 webserver.cc:460] Webserver started at http://127.11.88.66:34581/ using document root <none> and password file <none>
I20260806 01:05:54.115538 25963 fs_manager.cc:359] Metadata directory not provided
I20260806 01:05:54.115584 25963 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:05:54.115748 25963 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:05:54.116842 25963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/data/instance:
uuid: "6b8932de895a4214b5d81b61483465a5"
format_stamp: "Formatted at 2026-08-06 01:05:54 on dist-test-slave-69rg"
server_key: "83541741b813cff1b788a92cec709dba"
server_key_iv: "b3adcc80e46a59f8c281e1ba2dee40da"
server_key_version: "encryptionkey@0"
I20260806 01:05:54.117219 25963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance:
uuid: "6b8932de895a4214b5d81b61483465a5"
format_stamp: "Formatted at 2026-08-06 01:05:54 on dist-test-slave-69rg"
server_key: "83541741b813cff1b788a92cec709dba"
server_key_iv: "b3adcc80e46a59f8c281e1ba2dee40da"
server_key_version: "encryptionkey@0"
I20260806 01:05:54.118781 25963 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:05:54.119746 25978 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:54.119946 25963 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:05:54.120106 25963 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "6b8932de895a4214b5d81b61483465a5"
format_stamp: "Formatted at 2026-08-06 01:05:54 on dist-test-slave-69rg"
server_key: "83541741b813cff1b788a92cec709dba"
server_key_iv: "b3adcc80e46a59f8c281e1ba2dee40da"
server_key_version: "encryptionkey@0"
I20260806 01:05:54.120206 25963 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:05:54.141088 25963 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:05:54.144027 25963 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:05:54.144253 25963 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:05:54.144557 25963 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:05:54.144937 25963 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:05:54.145005 25963 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:54.145066 25963 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:05:54.145105 25963 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:54.152144 25963 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:36765
I20260806 01:05:54.152182 26094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:36765 every 8 connection(s)
I20260806 01:05:54.152547 25963 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
I20260806 01:05:54.157195 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 25963
I20260806 01:05:54.157316 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance
I20260806 01:05:54.157531 11617 external_mini_cluster.cc:1428] Setting key a97e3d6b9239e5db9da28306c65ab790
Aug 06 01:05:54 dist-test-slave-69rg krb5kdc[25712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978354, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:05:54.164366 25799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:54.153420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:57661 (local address 127.11.88.126:42229)
0806 01:05:54.153515 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:54.153517 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:54.153742 (+ 225us) server_negotiation.cc:407] Connection header received
0806 01:05:54.154326 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:54.154328 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:54.154339 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:54.154407 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:54.155418 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.155983 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.157201 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.157536 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.157631 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:54.160550 (+ 2919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:54.160552 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:54.160552 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:54.160560 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:54.162583 (+ 2023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:54.163162 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:54.163164 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:54.163164 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:54.163236 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:54.163525 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:54.163527 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:54.163527 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:54.163690 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:54.163771 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:54.164203 (+ 432us) server_negotiation.cc:299] Negotiation successful
0806 01:05:54.164294 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 01:05:54.164773 26097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:54.153368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.66:57661)
0806 01:05:54.153541 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:54.153587 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:54.154195 (+ 608us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:54.154461 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:54.154464 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:54.155076 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:05:54.155296 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:54.155301 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.156117 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.156118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:54.157034 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:54.157036 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.157664 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.157665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:54.157810 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:54.158601 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:05:54.158611 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:05:54.160396 (+ 1785us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:05:54.162704 (+ 2308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:54.162712 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:54.162715 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:54.162976 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:54.163332 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:54.163333 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:54.163333 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:54.163450 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:54.163820 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:05:54.163829 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:05:54.164026 (+ 197us) client_negotiation.cc:769] Sending connection context
0806 01:05:54.164178 (+ 152us) client_negotiation.cc:240] Negotiation successful
0806 01:05:54.164392 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":95,"threads_started":1}
I20260806 01:05:54.165457 26095 heartbeater.cc:347] Connected to a master server at 127.11.88.126:42229
I20260806 01:05:54.165565 26095 heartbeater.cc:464] Registering TS with master...
I20260806 01:05:54.165791 26095 heartbeater.cc:511] Master 127.11.88.126:42229 requested a full tablet report, sending...
I20260806 01:05:54.166268 25759 ts_manager.cc:194] Registered new tserver with Master: 6b8932de895a4214b5d81b61483465a5 (127.11.88.66:36765)
I20260806 01:05:54.166685 25759 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.66@KRBTEST.COM'} at 127.11.88.66:57661
WARNING: no policy specified for kudu/127.11.88.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
I20260806 01:05:54.189424 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:0
--local_ip_for_outbound_sockets=127.11.88.67
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:42229
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:40623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:05:54.280875 26100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:05:54.281273 26100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:05:54.281364 26100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:05:54.283004 26100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:05:54.283077 26100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:05:54.283108 26100 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:05:54.284746 26100 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:42229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26100
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:05:54.285049 26100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:05:54.285301 26100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:05:54.290927 26105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:54.290897 26106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:54.291124 26100 server_base.cc:1034] running on GCE node
W20260806 01:05:54.290871 26108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:54.291420 26100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:05:54.291661 26100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:05:54.292867 26100 hybrid_clock.cc:648] HybridClock initialized: now 1785978354292857 us; error 39 us; skew 500 ppm
Aug 06 01:05:54 dist-test-slave-69rg krb5kdc[25712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978354, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:05:54.296048 26100 init.cc:377] Logged in from keytab as kudu/127.11.88.67@KRBTEST.COM (short username kudu)
I20260806 01:05:54.296569 26100 webserver.cc:460] Webserver started at http://127.11.88.67:37933/ using document root <none> and password file <none>
I20260806 01:05:54.296821 26100 fs_manager.cc:359] Metadata directory not provided
I20260806 01:05:54.296868 26100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:05:54.297015 26100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:05:54.298269 26100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/data/instance:
uuid: "3d2d8e61aa62403995a43776d3bc778a"
format_stamp: "Formatted at 2026-08-06 01:05:54 on dist-test-slave-69rg"
server_key: "0fac01d94a30a7c5e862a8a442eb1879"
server_key_iv: "78eea951f3fea773818b2c489568811e"
server_key_version: "encryptionkey@0"
I20260806 01:05:54.298640 26100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance:
uuid: "3d2d8e61aa62403995a43776d3bc778a"
format_stamp: "Formatted at 2026-08-06 01:05:54 on dist-test-slave-69rg"
server_key: "0fac01d94a30a7c5e862a8a442eb1879"
server_key_iv: "78eea951f3fea773818b2c489568811e"
server_key_version: "encryptionkey@0"
I20260806 01:05:54.300102 26100 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 01:05:54.301118 26116 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:54.301450 26100 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:05:54.301533 26100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "3d2d8e61aa62403995a43776d3bc778a"
format_stamp: "Formatted at 2026-08-06 01:05:54 on dist-test-slave-69rg"
server_key: "0fac01d94a30a7c5e862a8a442eb1879"
server_key_iv: "78eea951f3fea773818b2c489568811e"
server_key_version: "encryptionkey@0"
I20260806 01:05:54.301645 26100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:05:54.315610 26100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:05:54.318138 26100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:05:54.318308 26100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:05:54.318570 26100 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:05:54.318913 26100 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:05:54.318959 26100 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:54.318982 26100 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:05:54.318995 26100 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:54.325783 26100 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:43461
I20260806 01:05:54.325891 26233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:43461 every 8 connection(s)
I20260806 01:05:54.326231 26100 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
Aug 06 01:05:54 dist-test-slave-69rg krb5kdc[25712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978354, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:05:54.335968 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 26100
I20260806 01:05:54.336077 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance
I20260806 01:05:54.336076 25799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:54.327029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:48977 (local address 127.11.88.126:42229)
0806 01:05:54.327127 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:54.327129 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:54.327333 (+ 204us) server_negotiation.cc:407] Connection header received
0806 01:05:54.327903 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:54.327905 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:54.327919 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:54.327971 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:54.328987 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.329523 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.330648 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.330870 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.330955 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:54.333349 (+ 2394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:54.333351 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:54.333351 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:54.333358 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:54.334727 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:54.335121 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:54.335121 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:54.335122 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:54.335177 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:54.335411 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:54.335411 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:54.335412 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:54.335521 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:54.335573 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:54.335862 (+ 289us) server_negotiation.cc:299] Negotiation successful
0806 01:05:54.335957 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 01:05:54.336203 26236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:54.326983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.67:48977)
0806 01:05:54.327203 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:54.327241 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:54.327778 (+ 537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:54.328039 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:54.328045 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:54.328658 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:05:54.328873 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:54.328878 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.329641 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.329642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:54.330529 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:54.330532 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.330966 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.330968 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:54.331097 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:54.331711 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:05:54.331720 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:05:54.333240 (+ 1520us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:05:54.334810 (+ 1570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:54.334817 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:54.334819 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:54.335048 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:54.335243 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:54.335244 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:54.335244 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:54.335350 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:54.335579 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:05:54.335583 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:05:54.335709 (+ 126us) client_negotiation.cc:769] Sending connection context
0806 01:05:54.335808 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 01:05:54.335938 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":91,"threads_started":1}
I20260806 01:05:54.336249 11617 external_mini_cluster.cc:1428] Setting key 25862bf3601a8defc248828e68c13253
I20260806 01:05:54.336835 26234 heartbeater.cc:347] Connected to a master server at 127.11.88.126:42229
I20260806 01:05:54.336944 26234 heartbeater.cc:464] Registering TS with master...
I20260806 01:05:54.337153 26234 heartbeater.cc:511] Master 127.11.88.126:42229 requested a full tablet report, sending...
I20260806 01:05:54.337563 25759 ts_manager.cc:194] Registered new tserver with Master: 3d2d8e61aa62403995a43776d3bc778a (127.11.88.67:43461)
I20260806 01:05:54.337970 25759 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.67@KRBTEST.COM'} at 127.11.88.67:48977
I20260806 01:05:54.348344 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 01:05:54.356215 25799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:54.349949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59082 (local address 127.11.88.126:42229)
0806 01:05:54.350018 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:54.350020 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:54.350103 (+ 83us) server_negotiation.cc:407] Connection header received
0806 01:05:54.350163 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:54.350163 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:54.350173 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:54.350230 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:54.350931 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.351469 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.352202 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.352426 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.352484 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:54.353743 (+ 1259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:54.353744 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:54.353745 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:54.353751 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:54.355104 (+ 1353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:54.355447 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:54.355448 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:54.355448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:54.355500 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:54.355696 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:54.355697 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:54.355697 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:54.355882 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:54.355967 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:54.356079 (+ 112us) server_negotiation.cc:299] Negotiation successful
0806 01:05:54.356143 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 01:05:54.358093 25759 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59082:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 01:05:54.359764 25759 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:05:54.366676 26245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:54.362259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:43119 (local address 127.0.0.1:55576)
0806 01:05:54.362954 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:54.362965 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:54.363015 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:54.363315 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:54.363316 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:54.363318 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:05:54.363365 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:54.363367 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.364583 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.364584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:54.365516 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:54.365519 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.366331 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.366332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:54.366420 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:54.366436 (+ 16us) client_negotiation.cc:769] Sending connection context
0806 01:05:54.366510 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 01:05:54.366571 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":680,"thread_start_us":95,"threads_started":1}
I20260806 01:05:54.366830 26246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:54.362240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:36765 (local address 127.0.0.1:54366)
0806 01:05:54.362415 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:54.362459 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:54.362531 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:54.362886 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:54.362889 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:54.362891 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:05:54.362973 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:54.362975 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.364288 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.364289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:54.365511 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:54.365514 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.366501 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.366502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:54.366574 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:54.366579 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 01:05:54.366613 (+ 34us) client_negotiation.cc:240] Negotiation successful
0806 01:05:54.366656 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":13,"thread_start_us":117,"threads_started":1}
I20260806 01:05:54.366910 26247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:54.362241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:43461 (local address 127.0.0.1:54596)
0806 01:05:54.362642 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:54.362652 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:54.362704 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:54.362990 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:54.362991 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:54.362993 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:05:54.363056 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:54.363057 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.364085 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.364086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:54.365511 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:54.365514 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.366468 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.366469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:54.366532 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:54.366534 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 01:05:54.366584 (+ 50us) client_negotiation.cc:240] Negotiation successful
0806 01:05:54.366620 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"mutex_wait_us":61,"thread_start_us":73,"threads_started":1}
I20260806 01:05:54.366953 26248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:54.362469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54366 (local address 127.11.88.66:36765)
0806 01:05:54.362677 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:54.362683 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:54.362694 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:05:54.362738 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:54.362740 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:54.362757 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:54.362845 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:05:54.363067 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.364174 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.365618 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.366394 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.366730 (+ 336us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:54.366809 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:54.366840 (+ 31us) server_negotiation.cc:299] Negotiation successful
0806 01:05:54.366882 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":86,"threads_started":1}
I20260806 01:05:54.367057 26250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:54.362523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55576 (local address 127.11.88.65:43119)
0806 01:05:54.362745 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:54.362749 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:54.363081 (+ 332us) server_negotiation.cc:407] Connection header received
0806 01:05:54.363130 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:54.363132 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:54.363148 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:54.363218 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:05:54.363459 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.364473 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.365608 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.366226 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.366329 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:54.366395 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:54.366903 (+ 508us) server_negotiation.cc:299] Negotiation successful
0806 01:05:54.366957 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":104,"threads_started":1}
I20260806 01:05:54.366742 26249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:54.362513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54596 (local address 127.11.88.67:43461)
0806 01:05:54.362710 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:54.362713 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:54.362774 (+ 61us) server_negotiation.cc:407] Connection header received
0806 01:05:54.362817 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:54.362819 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:54.362834 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:54.362904 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:05:54.363139 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.363975 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.365618 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.366394 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.366472 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:54.366531 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:54.366596 (+ 65us) server_negotiation.cc:299] Negotiation successful
0806 01:05:54.366638 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":91,"threads_started":1}
I20260806 01:05:54.367851 26027 tablet_service.cc:1467] Processing CreateTablet for tablet 7875ec46e3c640a2b6313e38dfc61c8b (DEFAULT_TABLE table=test-table [id=abf2fdaa8a99433b8275126a463939d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:05:54.368253 26027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7875ec46e3c640a2b6313e38dfc61c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:05:54.368471 26167 tablet_service.cc:1467] Processing CreateTablet for tablet 7875ec46e3c640a2b6313e38dfc61c8b (DEFAULT_TABLE table=test-table [id=abf2fdaa8a99433b8275126a463939d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:05:54.368768 26167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7875ec46e3c640a2b6313e38dfc61c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:05:54.371217 26251 tablet_bootstrap.cc:492] T 7875ec46e3c640a2b6313e38dfc61c8b P 6b8932de895a4214b5d81b61483465a5: Bootstrap starting.
I20260806 01:05:54.371590 26252 tablet_bootstrap.cc:492] T 7875ec46e3c640a2b6313e38dfc61c8b P 3d2d8e61aa62403995a43776d3bc778a: Bootstrap starting.
I20260806 01:05:54.371740 25889 tablet_service.cc:1467] Processing CreateTablet for tablet 7875ec46e3c640a2b6313e38dfc61c8b (DEFAULT_TABLE table=test-table [id=abf2fdaa8a99433b8275126a463939d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:05:54.371973 26251 tablet_bootstrap.cc:654] T 7875ec46e3c640a2b6313e38dfc61c8b P 6b8932de895a4214b5d81b61483465a5: Neither blocks nor log segments found. Creating new log.
I20260806 01:05:54.372083 25889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7875ec46e3c640a2b6313e38dfc61c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:05:54.372196 26252 tablet_bootstrap.cc:654] T 7875ec46e3c640a2b6313e38dfc61c8b P 3d2d8e61aa62403995a43776d3bc778a: Neither blocks nor log segments found. Creating new log.
I20260806 01:05:54.372552 26251 log.cc:824] T 7875ec46e3c640a2b6313e38dfc61c8b P 6b8932de895a4214b5d81b61483465a5: Log is configured to *not* fsync() on all Append() calls
I20260806 01:05:54.372584 26252 log.cc:824] T 7875ec46e3c640a2b6313e38dfc61c8b P 3d2d8e61aa62403995a43776d3bc778a: Log is configured to *not* fsync() on all Append() calls
I20260806 01:05:54.373268 26252 tablet_bootstrap.cc:492] T 7875ec46e3c640a2b6313e38dfc61c8b P 3d2d8e61aa62403995a43776d3bc778a: No bootstrap required, opened a new log
I20260806 01:05:54.373313 26252 ts_tablet_manager.cc:1397] T 7875ec46e3c640a2b6313e38dfc61c8b P 3d2d8e61aa62403995a43776d3bc778a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 01:05:54.374593 26251 tablet_bootstrap.cc:492] T 7875ec46e3c640a2b6313e38dfc61c8b P 6b8932de895a4214b5d81b61483465a5: No bootstrap required, opened a new log
I20260806 01:05:54.374672 26251 ts_tablet_manager.cc:1397] T 7875ec46e3c640a2b6313e38dfc61c8b P 6b8932de895a4214b5d81b61483465a5: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260806 01:05:54.374963 26255 tablet_bootstrap.cc:492] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421: Bootstrap starting.
I20260806 01:05:54.375164 26252 raft_consensus.cc:348] T 7875ec46e3c640a2b6313e38dfc61c8b P 3d2d8e61aa62403995a43776d3bc778a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } } peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } }
I20260806 01:05:54.375331 26252 raft_consensus.cc:374] T 7875ec46e3c640a2b6313e38dfc61c8b P 3d2d8e61aa62403995a43776d3bc778a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:05:54.375365 26252 raft_consensus.cc:729] T 7875ec46e3c640a2b6313e38dfc61c8b P 3d2d8e61aa62403995a43776d3bc778a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d2d8e61aa62403995a43776d3bc778a, State: Initialized, Role: FOLLOWER
I20260806 01:05:54.375487 26252 consensus_queue.cc:260] T 7875ec46e3c640a2b6313e38dfc61c8b P 3d2d8e61aa62403995a43776d3bc778a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } } peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } }
I20260806 01:05:54.375612 26255 tablet_bootstrap.cc:654] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421: Neither blocks nor log segments found. Creating new log.
I20260806 01:05:54.375783 26252 ts_tablet_manager.cc:1428] T 7875ec46e3c640a2b6313e38dfc61c8b P 3d2d8e61aa62403995a43776d3bc778a: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260806 01:05:54.375823 26234 heartbeater.cc:503] Master 127.11.88.126:42229 was elected leader, sending a full tablet report...
I20260806 01:05:54.376417 26255 log.cc:824] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421: Log is configured to *not* fsync() on all Append() calls
I20260806 01:05:54.376724 26251 raft_consensus.cc:348] T 7875ec46e3c640a2b6313e38dfc61c8b P 6b8932de895a4214b5d81b61483465a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } } peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } }
I20260806 01:05:54.376885 26251 raft_consensus.cc:374] T 7875ec46e3c640a2b6313e38dfc61c8b P 6b8932de895a4214b5d81b61483465a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:05:54.376929 26251 raft_consensus.cc:729] T 7875ec46e3c640a2b6313e38dfc61c8b P 6b8932de895a4214b5d81b61483465a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b8932de895a4214b5d81b61483465a5, State: Initialized, Role: FOLLOWER
I20260806 01:05:54.377038 26251 consensus_queue.cc:260] T 7875ec46e3c640a2b6313e38dfc61c8b P 6b8932de895a4214b5d81b61483465a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } } peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } }
I20260806 01:05:54.377271 26255 tablet_bootstrap.cc:492] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421: No bootstrap required, opened a new log
I20260806 01:05:54.377338 26255 ts_tablet_manager.cc:1397] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 01:05:54.377388 26251 ts_tablet_manager.cc:1428] T 7875ec46e3c640a2b6313e38dfc61c8b P 6b8932de895a4214b5d81b61483465a5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 01:05:54.377410 26095 heartbeater.cc:503] Master 127.11.88.126:42229 was elected leader, sending a full tablet report...
I20260806 01:05:54.378995 26255 raft_consensus.cc:348] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } } peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } }
I20260806 01:05:54.379117 26255 raft_consensus.cc:374] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:05:54.379138 26255 raft_consensus.cc:729] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 135f875c21224ad2afd55b3d38ed6421, State: Initialized, Role: FOLLOWER
I20260806 01:05:54.379288 26255 consensus_queue.cc:260] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } } peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } }
I20260806 01:05:54.379603 26255 ts_tablet_manager.cc:1428] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260806 01:05:54.379622 25957 heartbeater.cc:503] Master 127.11.88.126:42229 was elected leader, sending a full tablet report...
W20260806 01:05:54.403187 26096 tablet.cc:2369] T 7875ec46e3c640a2b6313e38dfc61c8b P 6b8932de895a4214b5d81b61483465a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 01:05:54.477463 25958 tablet.cc:2369] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 01:05:54.576871 26235 tablet.cc:2369] T 7875ec46e3c640a2b6313e38dfc61c8b P 3d2d8e61aa62403995a43776d3bc778a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 01:05:54.586045 26259 raft_consensus.cc:482] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:05:54.586179 26259 raft_consensus.cc:504] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } } peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } }
I20260806 01:05:54.586650 26259 leader_election.cc:288] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b8932de895a4214b5d81b61483465a5 (127.11.88.66:36765), 3d2d8e61aa62403995a43776d3bc778a (127.11.88.67:43461)
I20260806 01:05:54.589771 26248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:54.586893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:44989 (local address 127.11.88.66:36765)
0806 01:05:54.586944 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:54.586946 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:54.587067 (+ 121us) server_negotiation.cc:407] Connection header received
0806 01:05:54.587186 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:54.587187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:54.587195 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:54.587268 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:05:54.587455 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.587935 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.588985 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.589403 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.589497 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:54.589507 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:54.589655 (+ 148us) server_negotiation.cc:299] Negotiation successful
0806 01:05:54.589694 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 01:05:54.589797 26260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:54.586826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:36765 (local address 127.11.88.65:44989)
0806 01:05:54.586994 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:54.587007 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:54.587083 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:54.587275 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:54.587276 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:54.587278 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:05:54.587363 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:54.587370 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.588030 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.588031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:54.588876 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:54.588878 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.589496 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.589497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:54.589570 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:54.589574 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:05:54.589649 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 01:05:54.589694 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":77,"threads_started":1}
I20260806 01:05:54.589774 26249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:54.587087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:34943 (local address 127.11.88.67:43461)
0806 01:05:54.587140 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:54.587142 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:54.587200 (+ 58us) server_negotiation.cc:407] Connection header received
0806 01:05:54.587300 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:54.587300 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:54.587308 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:54.587378 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:05:54.587542 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.588003 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.588978 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.589414 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.589504 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:54.589512 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:54.589661 (+ 149us) server_negotiation.cc:299] Negotiation successful
0806 01:05:54.589701 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 01:05:54.589856 26261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:54.586971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:43461 (local address 127.11.88.65:34943)
0806 01:05:54.587114 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:54.587125 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:54.587216 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:54.587382 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:54.587383 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:54.587385 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:05:54.587469 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:54.587471 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.588092 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.588093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:54.588883 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:54.588885 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.589504 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.589505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:54.589583 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:54.589586 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:05:54.589656 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 01:05:54.589703 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":62,"threads_started":1}
I20260806 01:05:54.590209 26047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7875ec46e3c640a2b6313e38dfc61c8b" candidate_uuid: "135f875c21224ad2afd55b3d38ed6421" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b8932de895a4214b5d81b61483465a5" is_pre_election: true
I20260806 01:05:54.590207 26187 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7875ec46e3c640a2b6313e38dfc61c8b" candidate_uuid: "135f875c21224ad2afd55b3d38ed6421" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d2d8e61aa62403995a43776d3bc778a" is_pre_election: true
I20260806 01:05:54.590385 26047 raft_consensus.cc:2454] T 7875ec46e3c640a2b6313e38dfc61c8b P 6b8932de895a4214b5d81b61483465a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 135f875c21224ad2afd55b3d38ed6421 in term 0.
I20260806 01:05:54.590385 26187 raft_consensus.cc:2454] T 7875ec46e3c640a2b6313e38dfc61c8b P 3d2d8e61aa62403995a43776d3bc778a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 135f875c21224ad2afd55b3d38ed6421 in term 0.
I20260806 01:05:54.590684 25843 leader_election.cc:302] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 135f875c21224ad2afd55b3d38ed6421, 3d2d8e61aa62403995a43776d3bc778a; no voters:
I20260806 01:05:54.590847 26259 raft_consensus.cc:2781] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:05:54.590915 26259 raft_consensus.cc:482] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:05:54.590945 26259 raft_consensus.cc:3037] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:05:54.591728 26259 raft_consensus.cc:504] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } } peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } }
I20260806 01:05:54.591883 26259 leader_election.cc:288] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421 [CANDIDATE]: Term 1 election: Requested vote from peers 6b8932de895a4214b5d81b61483465a5 (127.11.88.66:36765), 3d2d8e61aa62403995a43776d3bc778a (127.11.88.67:43461)
I20260806 01:05:54.592093 26187 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7875ec46e3c640a2b6313e38dfc61c8b" candidate_uuid: "135f875c21224ad2afd55b3d38ed6421" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d2d8e61aa62403995a43776d3bc778a"
I20260806 01:05:54.592115 26047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7875ec46e3c640a2b6313e38dfc61c8b" candidate_uuid: "135f875c21224ad2afd55b3d38ed6421" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b8932de895a4214b5d81b61483465a5"
I20260806 01:05:54.592185 26047 raft_consensus.cc:3037] T 7875ec46e3c640a2b6313e38dfc61c8b P 6b8932de895a4214b5d81b61483465a5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:05:54.592185 26187 raft_consensus.cc:3037] T 7875ec46e3c640a2b6313e38dfc61c8b P 3d2d8e61aa62403995a43776d3bc778a [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:05:54.593111 26047 raft_consensus.cc:2454] T 7875ec46e3c640a2b6313e38dfc61c8b P 6b8932de895a4214b5d81b61483465a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 135f875c21224ad2afd55b3d38ed6421 in term 1.
I20260806 01:05:54.593111 26187 raft_consensus.cc:2454] T 7875ec46e3c640a2b6313e38dfc61c8b P 3d2d8e61aa62403995a43776d3bc778a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 135f875c21224ad2afd55b3d38ed6421 in term 1.
I20260806 01:05:54.593346 25843 leader_election.cc:302] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 135f875c21224ad2afd55b3d38ed6421, 3d2d8e61aa62403995a43776d3bc778a; no voters:
I20260806 01:05:54.593451 26259 raft_consensus.cc:2781] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:05:54.593629 26259 raft_consensus.cc:686] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421 [term 1 LEADER]: Becoming Leader. State: Replica: 135f875c21224ad2afd55b3d38ed6421, State: Running, Role: LEADER
I20260806 01:05:54.593741 26259 consensus_queue.cc:237] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } } peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } }
I20260806 01:05:54.594681 25759 catalog_manager.cc:5495] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421 reported cstate change: term changed from 0 to 1, leader changed from <none> to 135f875c21224ad2afd55b3d38ed6421 (127.11.88.65). New cstate: current_term: 1 leader_uuid: "135f875c21224ad2afd55b3d38ed6421" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } health_report { overall_health: UNKNOWN } } }
I20260806 01:05:54.600708 26250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:54.598463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55580 (local address 127.11.88.65:43119)
0806 01:05:54.598522 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:54.598526 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:54.598539 (+ 13us) server_negotiation.cc:407] Connection header received
0806 01:05:54.598567 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:54.598568 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:54.598583 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:54.598641 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:05:54.598765 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.599208 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.600014 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.600188 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.600237 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:54.600392 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:05:54.600481 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:05:54.600543 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:54.600636 (+ 93us) server_negotiation.cc:299] Negotiation successful
0806 01:05:54.600653 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 01:05:54.602593 26187 raft_consensus.cc:1261] T 7875ec46e3c640a2b6313e38dfc61c8b P 3d2d8e61aa62403995a43776d3bc778a [term 1 FOLLOWER]: Refusing update from remote peer 135f875c21224ad2afd55b3d38ed6421: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:05:54.602648 26047 raft_consensus.cc:1261] T 7875ec46e3c640a2b6313e38dfc61c8b P 6b8932de895a4214b5d81b61483465a5 [term 1 FOLLOWER]: Refusing update from remote peer 135f875c21224ad2afd55b3d38ed6421: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:05:54.602978 26262 consensus_queue.cc:1035] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:05:54.603178 26259 consensus_queue.cc:1035] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:05:54.605752 26265 mvcc.cc:205] Tried to move back new op lower bound from 7315367340449509376 to 7315367340416815104. Current Snapshot: MvccSnapshot[applied={T|T < 7315367340449509376}]
I20260806 01:05:54.607143 26267 mvcc.cc:205] Tried to move back new op lower bound from 7315367340449509376 to 7315367340416815104. Current Snapshot: MvccSnapshot[applied={T|T < 7315367340449509376 or (T in {7315367340449509376})}]
I20260806 01:05:54.607295 26266 mvcc.cc:205] Tried to move back new op lower bound from 7315367340449509376 to 7315367340416815104. Current Snapshot: MvccSnapshot[applied={T|T < 7315367340449509376 or (T in {7315367340449509376})}]
I20260806 01:05:54.608271 25758 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59082:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:05:54.608378 25758 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59082:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:05:54.609273 25758 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b: Sending DeleteTablet for 3 replicas of tablet 7875ec46e3c640a2b6313e38dfc61c8b
I20260806 01:05:54.609638 26167 tablet_service.cc:1514] Processing DeleteTablet for tablet 7875ec46e3c640a2b6313e38dfc61c8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:05:54 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:54596
I20260806 01:05:54.609714 26027 tablet_service.cc:1514] Processing DeleteTablet for tablet 7875ec46e3c640a2b6313e38dfc61c8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:05:54 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:54366
I20260806 01:05:54.609736 25889 tablet_service.cc:1514] Processing DeleteTablet for tablet 7875ec46e3c640a2b6313e38dfc61c8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:05:54 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:55576
I20260806 01:05:54.609969 26277 tablet_replica.cc:330] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421: stopping tablet replica
I20260806 01:05:54.610055 26274 tablet_replica.cc:330] T 7875ec46e3c640a2b6313e38dfc61c8b P 3d2d8e61aa62403995a43776d3bc778a: stopping tablet replica
I20260806 01:05:54.610088 26277 raft_consensus.cc:2229] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421 [term 1 LEADER]: Raft consensus shutting down.
I20260806 01:05:54.610100 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 25825
I20260806 01:05:54.610140 26274 raft_consensus.cc:2229] T 7875ec46e3c640a2b6313e38dfc61c8b P 3d2d8e61aa62403995a43776d3bc778a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:05:54.610180 26277 raft_consensus.cc:2258] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:05:54.610234 26274 raft_consensus.cc:2258] T 7875ec46e3c640a2b6313e38dfc61c8b P 3d2d8e61aa62403995a43776d3bc778a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:05:54.611025 26275 tablet_replica.cc:330] T 7875ec46e3c640a2b6313e38dfc61c8b P 6b8932de895a4214b5d81b61483465a5: stopping tablet replica
I20260806 01:05:54.611186 26275 raft_consensus.cc:2229] T 7875ec46e3c640a2b6313e38dfc61c8b P 6b8932de895a4214b5d81b61483465a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:05:54.611285 26275 raft_consensus.cc:2258] T 7875ec46e3c640a2b6313e38dfc61c8b P 6b8932de895a4214b5d81b61483465a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:05:54.611554 26274 ts_tablet_manager.cc:1905] T 7875ec46e3c640a2b6313e38dfc61c8b P 3d2d8e61aa62403995a43776d3bc778a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:05:54.611771 26275 ts_tablet_manager.cc:1905] T 7875ec46e3c640a2b6313e38dfc61c8b P 6b8932de895a4214b5d81b61483465a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:05:54.613360 26275 ts_tablet_manager.cc:1918] T 7875ec46e3c640a2b6313e38dfc61c8b P 6b8932de895a4214b5d81b61483465a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:05:54.613448 26275 log.cc:1196] T 7875ec46e3c640a2b6313e38dfc61c8b P 6b8932de895a4214b5d81b61483465a5: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/wal/wals/7875ec46e3c640a2b6313e38dfc61c8b
I20260806 01:05:54.613531 26274 ts_tablet_manager.cc:1918] T 7875ec46e3c640a2b6313e38dfc61c8b P 3d2d8e61aa62403995a43776d3bc778a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:05:54.613608 26274 log.cc:1196] T 7875ec46e3c640a2b6313e38dfc61c8b P 3d2d8e61aa62403995a43776d3bc778a: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/wal/wals/7875ec46e3c640a2b6313e38dfc61c8b
I20260806 01:05:54.613750 26275 ts_tablet_manager.cc:1939] T 7875ec46e3c640a2b6313e38dfc61c8b P 6b8932de895a4214b5d81b61483465a5: Deleting consensus metadata
I20260806 01:05:54.613920 26274 ts_tablet_manager.cc:1939] T 7875ec46e3c640a2b6313e38dfc61c8b P 3d2d8e61aa62403995a43776d3bc778a: Deleting consensus metadata
I20260806 01:05:54.614305 25746 catalog_manager.cc:4841] TS 6b8932de895a4214b5d81b61483465a5 (127.11.88.66:36765): tablet 7875ec46e3c640a2b6313e38dfc61c8b (table test-table [id=abf2fdaa8a99433b8275126a463939d5]) successfully deleted
I20260806 01:05:54.614678 25744 catalog_manager.cc:4841] TS 3d2d8e61aa62403995a43776d3bc778a (127.11.88.67:43461): tablet 7875ec46e3c640a2b6313e38dfc61c8b (table test-table [id=abf2fdaa8a99433b8275126a463939d5]) successfully deleted
W20260806 01:05:54.618752 25743 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.88.65:43119 (error 108)
I20260806 01:05:54.619046 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 25963
I20260806 01:05:54.619374 26245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:54.619224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:43119 (local address 127.0.0.1:55584)
0806 01:05:54.619300 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:54.619334 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.65:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260806 01:05:54.619791 25743 catalog_manager.cc:4584] TS 135f875c21224ad2afd55b3d38ed6421 (127.11.88.65:43119): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7875ec46e3c640a2b6313e38dfc61c8b: Network error: Client connection negotiation failed: client connection to 127.11.88.65:43119: connect: Connection refused (error 111)
I20260806 01:05:54.624861 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 26100
I20260806 01:05:54.630318 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 25726
I20260806 01:05:54.636461 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:42229
--webserver_interface=127.11.88.126
--webserver_port=35867
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:40623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:42229
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:05:54.720971 26279 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:05:54.721246 26279 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:05:54.721287 26279 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:05:54.722576 26279 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:05:54.722654 26279 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:05:54.722679 26279 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:05:54.722703 26279 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:05:54.722725 26279 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:05:54.724319 26279 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:42229
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:42229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=35867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26279
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:05:54.724615 26279 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:05:54.724864 26279 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:05:54.735430 26286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:54.735584 26279 server_base.cc:1034] running on GCE node
W20260806 01:05:54.735430 26288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:54.735688 26285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:54.735994 26279 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:05:54.736366 26279 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:05:54.737550 26279 hybrid_clock.cc:648] HybridClock initialized: now 1785978354737539 us; error 41 us; skew 500 ppm
Aug 06 01:05:54 dist-test-slave-69rg krb5kdc[25712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978354, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:05:54.740337 26279 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:05:54.740865 26279 webserver.cc:460] Webserver started at http://127.11.88.126:35867/ using document root <none> and password file <none>
I20260806 01:05:54.741127 26279 fs_manager.cc:359] Metadata directory not provided
I20260806 01:05:54.741227 26279 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:05:54.742740 26279 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:05:54.743454 26295 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:54.743633 26279 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 01:05:54.743749 26279 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "0338673d295e4fa2a4b7c938441dfb0b"
format_stamp: "Formatted at 2026-08-06 01:05:53 on dist-test-slave-69rg"
server_key: "6d358b7212a97664e23a5a678ef2d0ed"
server_key_iv: "06c0aa044843510cf92bf6cf441bb9de"
server_key_version: "encryptionkey@0"
I20260806 01:05:54.744174 26279 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:05:54.753583 26279 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:05:54.756112 26279 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:05:54.756299 26279 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:05:54.760831 26279 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:42229
I20260806 01:05:54.760865 26348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:42229 every 8 connection(s)
I20260806 01:05:54.761268 26279 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:05:54.761737 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 26279
I20260806 01:05:54.762145 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:43119
--local_ip_for_outbound_sockets=127.11.88.65
--tserver_master_addrs=127.11.88.126:42229
--webserver_port=32969
--webserver_interface=127.11.88.65
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:40623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 01:05:54.763768 26349 sys_catalog.cc:263] Verifying existing consensus state
I20260806 01:05:54.764484 26349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b: Bootstrap starting.
I20260806 01:05:54.773983 26349 log.cc:824] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b: Log is configured to *not* fsync() on all Append() calls
I20260806 01:05:54.776228 26349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 01:05:54.776582 26349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b: Bootstrap complete.
I20260806 01:05:54.779119 26349 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0338673d295e4fa2a4b7c938441dfb0b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42229 } }
I20260806 01:05:54.779356 26349 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0338673d295e4fa2a4b7c938441dfb0b, State: Initialized, Role: FOLLOWER
I20260806 01:05:54.779525 26349 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0338673d295e4fa2a4b7c938441dfb0b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42229 } }
I20260806 01:05:54.779594 26349 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:05:54.779629 26349 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:05:54.779699 26349 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [term 1 FOLLOWER]: Advancing to term 2
I20260806 01:05:54.780730 26349 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0338673d295e4fa2a4b7c938441dfb0b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42229 } }
I20260806 01:05:54.780844 26349 leader_election.cc:302] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0338673d295e4fa2a4b7c938441dfb0b; no voters:
I20260806 01:05:54.781056 26349 leader_election.cc:288] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 01:05:54.781095 26353 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [term 2 FOLLOWER]: Leader election won for term 2
I20260806 01:05:54.781270 26353 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [term 2 LEADER]: Becoming Leader. State: Replica: 0338673d295e4fa2a4b7c938441dfb0b, State: Running, Role: LEADER
I20260806 01:05:54.781365 26349 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:05:54.781457 26353 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0338673d295e4fa2a4b7c938441dfb0b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42229 } }
I20260806 01:05:54.781879 26355 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "0338673d295e4fa2a4b7c938441dfb0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0338673d295e4fa2a4b7c938441dfb0b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42229 } } }
I20260806 01:05:54.781992 26355 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [sys.catalog]: This master's current role is: LEADER
I20260806 01:05:54.781877 26353 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0338673d295e4fa2a4b7c938441dfb0b. Latest consensus state: current_term: 2 leader_uuid: "0338673d295e4fa2a4b7c938441dfb0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0338673d295e4fa2a4b7c938441dfb0b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42229 } } }
I20260806 01:05:54.782302 26353 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [sys.catalog]: This master's current role is: LEADER
I20260806 01:05:54.782519 26362 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:05:54.783458 26362 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:05:54.783631 26362 catalog_manager.cc:1259] Loaded cluster ID: a2df001b86784077826b493ae46d554e
I20260806 01:05:54.783845 26362 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:05:54.784087 26362 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260806 01:05:54.786831 26362 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260806 01:05:54.788803 26362 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:05:54.789011 26362 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b: Loaded TSK: 0
I20260806 01:05:54.789224 26362 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 01:05:54.870067 26351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:05:54.870322 26351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:05:54.870368 26351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:05:54.871565 26351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:05:54.871645 26351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:05:54.871692 26351 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:05:54.873314 26351 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:43119
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=32969
--tserver_master_addrs=127.11.88.126:42229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26351
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:05:54.873576 26351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:05:54.873837 26351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:05:54.879106 26376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:54.879192 26379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:54.879106 26377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:54.879599 26351 server_base.cc:1034] running on GCE node
I20260806 01:05:54.879827 26351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:05:54.880120 26351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:05:54.881307 26351 hybrid_clock.cc:648] HybridClock initialized: now 1785978354881292 us; error 28 us; skew 500 ppm
Aug 06 01:05:54 dist-test-slave-69rg krb5kdc[25712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978354, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:05:54.884830 26351 init.cc:377] Logged in from keytab as kudu/127.11.88.65@KRBTEST.COM (short username kudu)
I20260806 01:05:54.885429 26351 webserver.cc:460] Webserver started at http://127.11.88.65:32969/ using document root <none> and password file <none>
I20260806 01:05:54.885721 26351 fs_manager.cc:359] Metadata directory not provided
I20260806 01:05:54.885838 26351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:05:54.887729 26351 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:05:54.888597 26386 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:54.888850 26351 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:05:54.888969 26351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "135f875c21224ad2afd55b3d38ed6421"
format_stamp: "Formatted at 2026-08-06 01:05:53 on dist-test-slave-69rg"
server_key: "b5952fbe24952a48d674f884e1da7cf9"
server_key_iv: "ced809bf255401fa4a34a5706adf814b"
server_key_version: "encryptionkey@0"
I20260806 01:05:54.889351 26351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:05:54.903425 26351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:05:54.905959 26351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:05:54.906116 26351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:05:54.906397 26351 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:05:54.906883 26393 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 01:05:54.908836 26351 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 01:05:54.908908 26351 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260806 01:05:54.908946 26351 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 01:05:54.909611 26351 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 01:05:54.909670 26351 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260806 01:05:54.909761 26393 tablet_bootstrap.cc:492] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421: Bootstrap starting.
I20260806 01:05:54.917228 26351 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:43119
I20260806 01:05:54.917631 26351 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
I20260806 01:05:54.922040 26502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:43119 every 8 connection(s)
I20260806 01:05:54.921782 26393 log.cc:824] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421: Log is configured to *not* fsync() on all Append() calls
I20260806 01:05:54.924129 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 26351
I20260806 01:05:54.924420 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:36765
--local_ip_for_outbound_sockets=127.11.88.66
--tserver_master_addrs=127.11.88.126:42229
--webserver_port=34581
--webserver_interface=127.11.88.66
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:40623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 01:05:54.925251 26393 tablet_bootstrap.cc:492] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 01:05:54.925532 26393 tablet_bootstrap.cc:492] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421: Bootstrap complete.
I20260806 01:05:54.926888 26393 ts_tablet_manager.cc:1397] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.013s
I20260806 01:05:54.928226 26393 raft_consensus.cc:348] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } } peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } }
I20260806 01:05:54.928521 26393 raft_consensus.cc:729] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 135f875c21224ad2afd55b3d38ed6421, State: Initialized, Role: FOLLOWER
Aug 06 01:05:54 dist-test-slave-69rg krb5kdc[25712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978354, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:05:54.929332 26393 consensus_queue.cc:260] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } } peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } }
I20260806 01:05:54.930060 26393 ts_tablet_manager.cc:1428] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260806 01:05:54.933184 26505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:54.918496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.65:57169)
0806 01:05:54.918704 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:54.918748 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:54.919202 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:54.922418 (+ 3216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:54.922422 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:54.922858 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:05:54.923109 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:54.923115 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.924510 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.924511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:54.925837 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:54.925840 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.926734 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.926735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:54.926892 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:54.927514 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:05:54.927526 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:05:54.929179 (+ 1653us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:05:54.931382 (+ 2203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:54.931390 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:54.931392 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:54.931732 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:54.932035 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:54.932036 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:54.932036 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:54.932147 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:54.932535 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:05:54.932542 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:05:54.932681 (+ 139us) client_negotiation.cc:769] Sending connection context
0806 01:05:54.932810 (+ 129us) client_negotiation.cc:240] Negotiation successful
0806 01:05:54.932992 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":126,"threads_started":1}
I20260806 01:05:54.933197 26506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:54.918581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:57169 (local address 127.11.88.126:42229)
0806 01:05:54.921945 (+ 3364us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:54.921956 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:54.922003 (+ 47us) server_negotiation.cc:407] Connection header received
0806 01:05:54.922145 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:54.922152 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:54.922214 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:54.922373 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:54.923245 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.924357 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.925969 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.926614 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.927206 (+ 592us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:54.929354 (+ 2148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:54.929359 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:54.929359 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:54.929371 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:54.931265 (+ 1894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:54.931851 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:54.931854 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:54.931855 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:54.931952 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:54.932226 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:54.932227 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:54.932227 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:54.932456 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:54.932554 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:54.932871 (+ 317us) server_negotiation.cc:299] Negotiation successful
0806 01:05:54.932992 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3293,"thread_start_us":119,"threads_started":1}
I20260806 01:05:54.934377 26503 heartbeater.cc:347] Connected to a master server at 127.11.88.126:42229
I20260806 01:05:54.934473 26503 heartbeater.cc:464] Registering TS with master...
I20260806 01:05:54.934660 26503 heartbeater.cc:511] Master 127.11.88.126:42229 requested a full tablet report, sending...
I20260806 01:05:54.935427 26313 ts_manager.cc:194] Registered new tserver with Master: 135f875c21224ad2afd55b3d38ed6421 (127.11.88.65:43119)
I20260806 01:05:54.936607 26313 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.65@KRBTEST.COM'} at 127.11.88.65:57169
I20260806 01:05:54.937479 26503 heartbeater.cc:503] Master 127.11.88.126:42229 was elected leader, sending a full tablet report...
I20260806 01:05:54.945520 26510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:54.936051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:43119 (local address 127.0.0.1:55596)
0806 01:05:54.941996 (+ 5945us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:54.942037 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:54.942180 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:54.942455 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:54.942458 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:54.942461 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:05:54.942544 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:54.942546 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.943477 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.943478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:54.944398 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:54.944400 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.945140 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.945141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:54.945235 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:54.945249 (+ 14us) client_negotiation.cc:769] Sending connection context
0806 01:05:54.945366 (+ 117us) client_negotiation.cc:240] Negotiation successful
0806 01:05:54.945432 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5909,"thread_start_us":97,"threads_started":1}
I20260806 01:05:54.945520 26511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:54.936324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55596 (local address 127.11.88.65:43119)
0806 01:05:54.936502 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:54.936506 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:54.942164 (+ 5658us) server_negotiation.cc:407] Connection header received
0806 01:05:54.942311 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:54.942314 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:54.942332 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:54.942431 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:05:54.942642 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.943377 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.944509 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:54.945035 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:54.945139 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:54.945207 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:54.945387 (+ 180us) server_negotiation.cc:299] Negotiation successful
0806 01:05:54.945433 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":95,"threads_started":1}
I20260806 01:05:54.946393 26435 tablet_service.cc:1514] Processing DeleteTablet for tablet 7875ec46e3c640a2b6313e38dfc61c8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:05:54 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:55596
I20260806 01:05:54.947001 26512 tablet_replica.cc:330] stopping tablet replica
I20260806 01:05:54.947134 26512 raft_consensus.cc:2229] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:05:54.947216 26512 raft_consensus.cc:2258] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:05:54.947592 26512 ts_tablet_manager.cc:1905] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:05:54.950181 26512 ts_tablet_manager.cc:1918] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:05:54.950418 26512 log.cc:1196] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/wal/wals/7875ec46e3c640a2b6313e38dfc61c8b
I20260806 01:05:54.950954 26512 ts_tablet_manager.cc:1939] T 7875ec46e3c640a2b6313e38dfc61c8b P 135f875c21224ad2afd55b3d38ed6421: Deleting consensus metadata
I20260806 01:05:54.951700 26296 catalog_manager.cc:4841] TS 135f875c21224ad2afd55b3d38ed6421 (127.11.88.65:43119): tablet 7875ec46e3c640a2b6313e38dfc61c8b (table test-table [id=abf2fdaa8a99433b8275126a463939d5]) successfully deleted
W20260806 01:05:55.018275 26508 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:05:55.018500 26508 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:05:55.018527 26508 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:05:55.019791 26508 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:05:55.019843 26508 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:05:55.019871 26508 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:05:55.021421 26508 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:36765
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=34581
--tserver_master_addrs=127.11.88.126:42229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26508
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:05:55.021730 26508 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:05:55.022027 26508 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:05:55.028076 26520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:55.028139 26518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:55.028079 26517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:55.028324 26508 server_base.cc:1034] running on GCE node
I20260806 01:05:55.028539 26508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:05:55.028757 26508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:05:55.029912 26508 hybrid_clock.cc:648] HybridClock initialized: now 1785978355029894 us; error 33 us; skew 500 ppm
Aug 06 01:05:55 dist-test-slave-69rg krb5kdc[25712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978355, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:05:55.032569 26508 init.cc:377] Logged in from keytab as kudu/127.11.88.66@KRBTEST.COM (short username kudu)
I20260806 01:05:55.032971 26508 webserver.cc:460] Webserver started at http://127.11.88.66:34581/ using document root <none> and password file <none>
I20260806 01:05:55.033179 26508 fs_manager.cc:359] Metadata directory not provided
I20260806 01:05:55.033231 26508 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:05:55.034651 26508 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:05:55.035245 26527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:55.035429 26508 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 01:05:55.035542 26508 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "6b8932de895a4214b5d81b61483465a5"
format_stamp: "Formatted at 2026-08-06 01:05:54 on dist-test-slave-69rg"
server_key: "83541741b813cff1b788a92cec709dba"
server_key_iv: "b3adcc80e46a59f8c281e1ba2dee40da"
server_key_version: "encryptionkey@0"
I20260806 01:05:55.035913 26508 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:05:55.051841 26508 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:05:55.054304 26508 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:05:55.054483 26508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:05:55.054734 26508 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:05:55.055065 26508 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:05:55.055123 26508 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:55.055166 26508 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:05:55.055197 26508 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:55.061203 26508 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:36765
I20260806 01:05:55.061291 26642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:36765 every 8 connection(s)
I20260806 01:05:55.061648 26508 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
I20260806 01:05:55.063093 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 26508
I20260806 01:05:55.063431 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:43461
--local_ip_for_outbound_sockets=127.11.88.67
--tserver_master_addrs=127.11.88.126:42229
--webserver_port=37933
--webserver_interface=127.11.88.67
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:40623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 01:05:55 dist-test-slave-69rg krb5kdc[25712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978355, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:05:55.073613 26506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:55.062486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:59389 (local address 127.11.88.126:42229)
0806 01:05:55.062581 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:55.062584 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:55.062730 (+ 146us) server_negotiation.cc:407] Connection header received
0806 01:05:55.063640 (+ 910us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:55.063641 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:55.063661 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:55.063740 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:55.065446 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.066313 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.067437 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.067698 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.067781 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:55.070588 (+ 2807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:55.070590 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:55.070591 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:55.070598 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:55.072165 (+ 1567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:55.072595 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:55.072596 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:55.072597 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:55.072660 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:55.072925 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:55.072926 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:55.072926 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:55.073049 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:55.073125 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:55.073417 (+ 292us) server_negotiation.cc:299] Negotiation successful
0806 01:05:55.073514 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 01:05:55.073873 26645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:55.062390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.66:59389)
0806 01:05:55.062570 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:55.062622 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:55.063476 (+ 854us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:55.063961 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:55.063965 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:55.064942 (+ 977us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:05:55.065289 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:55.065298 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.066419 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.066420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:55.067332 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:55.067335 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.067820 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.067821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:55.068007 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:55.068648 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:05:55.068660 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:05:55.070461 (+ 1801us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:05:55.072265 (+ 1804us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:55.072273 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:55.072275 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:55.072510 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:55.072740 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:55.072741 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:55.072742 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:55.072854 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:55.073128 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:05:55.073137 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:05:55.073284 (+ 147us) client_negotiation.cc:769] Sending connection context
0806 01:05:55.073397 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 01:05:55.073561 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":71,"threads_started":1}
I20260806 01:05:55.074425 26643 heartbeater.cc:347] Connected to a master server at 127.11.88.126:42229
I20260806 01:05:55.074563 26643 heartbeater.cc:464] Registering TS with master...
I20260806 01:05:55.074822 26643 heartbeater.cc:511] Master 127.11.88.126:42229 requested a full tablet report, sending...
I20260806 01:05:55.075287 26313 ts_manager.cc:194] Registered new tserver with Master: 6b8932de895a4214b5d81b61483465a5 (127.11.88.66:36765)
I20260806 01:05:55.075686 26313 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.66@KRBTEST.COM'} at 127.11.88.66:59389
W20260806 01:05:55.156222 26646 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:05:55.156489 26646 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:05:55.156529 26646 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:05:55.157745 26646 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:05:55.157822 26646 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:05:55.157895 26646 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:05:55.159515 26646 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:43461
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=37933
--tserver_master_addrs=127.11.88.126:42229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26646
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:05:55.159811 26646 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:05:55.160068 26646 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:05:55.165421 26654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:55.165421 26652 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:55.165422 26651 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:55.165768 26646 server_base.cc:1034] running on GCE node
I20260806 01:05:55.166045 26646 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:05:55.166320 26646 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:05:55.167510 26646 hybrid_clock.cc:648] HybridClock initialized: now 1785978355167508 us; error 39 us; skew 500 ppm
Aug 06 01:05:55 dist-test-slave-69rg krb5kdc[25712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978355, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:05:55.170217 26646 init.cc:377] Logged in from keytab as kudu/127.11.88.67@KRBTEST.COM (short username kudu)
I20260806 01:05:55.170718 26646 webserver.cc:460] Webserver started at http://127.11.88.67:37933/ using document root <none> and password file <none>
I20260806 01:05:55.170979 26646 fs_manager.cc:359] Metadata directory not provided
I20260806 01:05:55.171036 26646 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:05:55.172452 26646 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260806 01:05:55.173098 26661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:55.173352 26646 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:05:55.173470 26646 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "3d2d8e61aa62403995a43776d3bc778a"
format_stamp: "Formatted at 2026-08-06 01:05:54 on dist-test-slave-69rg"
server_key: "0fac01d94a30a7c5e862a8a442eb1879"
server_key_iv: "78eea951f3fea773818b2c489568811e"
server_key_version: "encryptionkey@0"
I20260806 01:05:55.173898 26646 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:05:55.183053 26646 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:05:55.184949 26646 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:05:55.185123 26646 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:05:55.185369 26646 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:05:55.185710 26646 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:05:55.185771 26646 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:55.185838 26646 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:05:55.185869 26646 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:55.192353 26646 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:43461
I20260806 01:05:55.192399 26775 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:43461 every 8 connection(s)
I20260806 01:05:55.192803 26646 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
Aug 06 01:05:55 dist-test-slave-69rg krb5kdc[25712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978355, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:05:55.201511 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 26646
I20260806 01:05:55.203313 26506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:55.193542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:57997 (local address 127.11.88.126:42229)
0806 01:05:55.193612 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:55.193615 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:55.193877 (+ 262us) server_negotiation.cc:407] Connection header received
0806 01:05:55.194451 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:55.194452 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:55.194465 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:55.194541 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:55.195685 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.196193 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.197373 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.197567 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.197626 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:55.200206 (+ 2580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:55.200208 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:55.200208 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:55.200215 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:55.201744 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:55.202286 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:55.202287 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:55.202288 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:55.202352 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:55.202630 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:55.202631 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:55.202631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:55.202752 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:55.202831 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:55.203124 (+ 293us) server_negotiation.cc:299] Negotiation successful
0806 01:05:55.203209 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 01:05:55.203567 26778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:55.193537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.67:57997)
0806 01:05:55.193716 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:55.193759 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:55.194306 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:55.194653 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:55.194657 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:55.195347 (+ 690us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:05:55.195556 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:55.195561 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.196306 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.196308 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:55.197270 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:55.197273 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.197683 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.197684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:55.197935 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:55.198557 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:05:55.198567 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:05:55.200111 (+ 1544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:05:55.201860 (+ 1749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:55.201868 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:55.201870 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:55.202194 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:55.202429 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:55.202430 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:55.202431 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:55.202551 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:55.202823 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:05:55.202830 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:05:55.202980 (+ 150us) client_negotiation.cc:769] Sending connection context
0806 01:05:55.203090 (+ 110us) client_negotiation.cc:240] Negotiation successful
0806 01:05:55.203262 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":92,"threads_started":1}
I20260806 01:05:55.204061 26776 heartbeater.cc:347] Connected to a master server at 127.11.88.126:42229
I20260806 01:05:55.204193 26776 heartbeater.cc:464] Registering TS with master...
I20260806 01:05:55.204466 26776 heartbeater.cc:511] Master 127.11.88.126:42229 requested a full tablet report, sending...
I20260806 01:05:55.204900 26313 ts_manager.cc:194] Registered new tserver with Master: 3d2d8e61aa62403995a43776d3bc778a (127.11.88.67:43461)
I20260806 01:05:55.205277 26313 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.67@KRBTEST.COM'} at 127.11.88.67:57997
I20260806 01:05:55.209158 26781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:55.202051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59088 (local address 127.11.88.126:42229)
0806 01:05:55.202209 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:55.202211 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:55.202250 (+ 39us) server_negotiation.cc:407] Connection header received
0806 01:05:55.202359 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:55.202360 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:55.202374 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:55.202433 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:55.203073 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.203950 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.204961 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.205233 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.205339 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:55.206584 (+ 1245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:55.206585 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:55.206586 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:55.206594 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:55.207926 (+ 1332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:55.208275 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:55.208276 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:55.208276 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:55.208346 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:55.208533 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:55.208534 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:55.208534 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:55.208653 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:55.208797 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:55.208827 (+ 30us) server_negotiation.cc:299] Negotiation successful
0806 01:05:55.208901 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":68,"threads_started":1}
I20260806 01:05:55.210000 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 01:05:55.213215 26781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:55.210342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59090 (local address 127.11.88.126:42229)
0806 01:05:55.210425 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:55.210428 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:55.210579 (+ 151us) server_negotiation.cc:407] Connection header received
0806 01:05:55.210679 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:55.210680 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:55.210720 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:55.210810 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:05:55.210955 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.211481 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.212322 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.212570 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.212662 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:55.212847 (+ 185us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:05:55.212964 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:05:55.213077 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:55.213103 (+ 26us) server_negotiation.cc:299] Negotiation successful
0806 01:05:55.213131 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 01:05:55.213528 26313 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:59090:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 01:05:55.215279 26313 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:05:55.217646 26435 tablet_service.cc:1467] Processing CreateTablet for tablet 881efdc97c004361a8a96bf29611ec4f (DEFAULT_TABLE table=test-table [id=ea0531d2e0be4894afe55541bae61619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:05:55.217890 26435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 881efdc97c004361a8a96bf29611ec4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:05:55.219499 26393 tablet_bootstrap.cc:492] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421: Bootstrap starting.
I20260806 01:05:55.219837 26393 tablet_bootstrap.cc:654] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421: Neither blocks nor log segments found. Creating new log.
I20260806 01:05:55.220588 26393 tablet_bootstrap.cc:492] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421: No bootstrap required, opened a new log
I20260806 01:05:55.220659 26393 ts_tablet_manager.cc:1397] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260806 01:05:55.220777 26393 raft_consensus.cc:348] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } } peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } }
I20260806 01:05:55.220870 26393 raft_consensus.cc:374] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:05:55.220927 26393 raft_consensus.cc:729] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 135f875c21224ad2afd55b3d38ed6421, State: Initialized, Role: FOLLOWER
I20260806 01:05:55.220975 26393 consensus_queue.cc:260] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } } peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } }
I20260806 01:05:55.221071 26393 ts_tablet_manager.cc:1428] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:55.221535 26510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:55.217316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:43461 (local address 127.0.0.1:54598)
0806 01:05:55.217356 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:55.217367 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:55.217405 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:55.217873 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:55.217874 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:55.217876 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:05:55.217920 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:55.217922 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.219248 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.219249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:55.220297 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:55.220299 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.221278 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.221279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:55.221356 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:55.221361 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 01:05:55.221421 (+ 60us) client_negotiation.cc:240] Negotiation successful
0806 01:05:55.221472 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260806 01:05:55.221583 26784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:55.217428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54598 (local address 127.11.88.67:43461)
0806 01:05:55.217675 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:55.217680 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:55.217689 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:05:55.217732 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:55.217734 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:55.217753 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:55.217867 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:05:55.218090 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.219139 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.220384 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.221180 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.221263 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:55.221325 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:55.221452 (+ 127us) server_negotiation.cc:299] Negotiation successful
0806 01:05:55.221497 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":160,"threads_started":1}
I20260806 01:05:55.221925 26783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:55.217327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:36765 (local address 127.0.0.1:54370)
0806 01:05:55.217520 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:55.217531 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:55.217567 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:55.217978 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:55.217979 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:55.217981 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:05:55.218027 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:55.218029 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.219038 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.219039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:55.220221 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:55.220224 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.221644 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.221645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:55.221725 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:55.221729 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:05:55.221786 (+ 57us) client_negotiation.cc:240] Negotiation successful
0806 01:05:55.221851 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"mutex_wait_us":36,"thread_start_us":114,"threads_started":1}
I20260806 01:05:55.222215 26785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:55.217596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54370 (local address 127.11.88.66:36765)
0806 01:05:55.217838 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:55.217842 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:55.217851 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:05:55.217889 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:55.217891 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:55.217906 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:55.217978 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:05:55.218170 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.218924 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.220407 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.221189 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.221263 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:55.221325 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:55.222092 (+ 767us) server_negotiation.cc:299] Negotiation successful
0806 01:05:55.222142 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":104,"threads_started":1}
I20260806 01:05:55.222398 26709 tablet_service.cc:1467] Processing CreateTablet for tablet 881efdc97c004361a8a96bf29611ec4f (DEFAULT_TABLE table=test-table [id=ea0531d2e0be4894afe55541bae61619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:05:55.222671 26709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 881efdc97c004361a8a96bf29611ec4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:05:55.225462 26787 tablet_bootstrap.cc:492] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a: Bootstrap starting.
I20260806 01:05:55.226110 26576 tablet_service.cc:1467] Processing CreateTablet for tablet 881efdc97c004361a8a96bf29611ec4f (DEFAULT_TABLE table=test-table [id=ea0531d2e0be4894afe55541bae61619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:05:55.226256 26787 tablet_bootstrap.cc:654] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a: Neither blocks nor log segments found. Creating new log.
I20260806 01:05:55.226441 26576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 881efdc97c004361a8a96bf29611ec4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:05:55.226832 26787 log.cc:824] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a: Log is configured to *not* fsync() on all Append() calls
I20260806 01:05:55.227588 26787 tablet_bootstrap.cc:492] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a: No bootstrap required, opened a new log
I20260806 01:05:55.227645 26787 ts_tablet_manager.cc:1397] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260806 01:05:55.229286 26787 raft_consensus.cc:348] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } } peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } }
I20260806 01:05:55.229434 26787 raft_consensus.cc:374] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:05:55.229457 26787 raft_consensus.cc:729] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d2d8e61aa62403995a43776d3bc778a, State: Initialized, Role: FOLLOWER
I20260806 01:05:55.229591 26787 consensus_queue.cc:260] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } } peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } }
I20260806 01:05:55.229884 26789 tablet_bootstrap.cc:492] T 881efdc97c004361a8a96bf29611ec4f P 6b8932de895a4214b5d81b61483465a5: Bootstrap starting.
I20260806 01:05:55.229923 26776 heartbeater.cc:503] Master 127.11.88.126:42229 was elected leader, sending a full tablet report...
I20260806 01:05:55.229926 26787 ts_tablet_manager.cc:1428] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260806 01:05:55.230636 26789 tablet_bootstrap.cc:654] T 881efdc97c004361a8a96bf29611ec4f P 6b8932de895a4214b5d81b61483465a5: Neither blocks nor log segments found. Creating new log.
I20260806 01:05:55.231390 26789 log.cc:824] T 881efdc97c004361a8a96bf29611ec4f P 6b8932de895a4214b5d81b61483465a5: Log is configured to *not* fsync() on all Append() calls
I20260806 01:05:55.232226 26789 tablet_bootstrap.cc:492] T 881efdc97c004361a8a96bf29611ec4f P 6b8932de895a4214b5d81b61483465a5: No bootstrap required, opened a new log
I20260806 01:05:55.232321 26789 ts_tablet_manager.cc:1397] T 881efdc97c004361a8a96bf29611ec4f P 6b8932de895a4214b5d81b61483465a5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 01:05:55.233961 26789 raft_consensus.cc:348] T 881efdc97c004361a8a96bf29611ec4f P 6b8932de895a4214b5d81b61483465a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } } peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } }
I20260806 01:05:55.234107 26789 raft_consensus.cc:374] T 881efdc97c004361a8a96bf29611ec4f P 6b8932de895a4214b5d81b61483465a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:05:55.234130 26789 raft_consensus.cc:729] T 881efdc97c004361a8a96bf29611ec4f P 6b8932de895a4214b5d81b61483465a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b8932de895a4214b5d81b61483465a5, State: Initialized, Role: FOLLOWER
I20260806 01:05:55.234277 26789 consensus_queue.cc:260] T 881efdc97c004361a8a96bf29611ec4f P 6b8932de895a4214b5d81b61483465a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } } peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } }
I20260806 01:05:55.234594 26789 ts_tablet_manager.cc:1428] T 881efdc97c004361a8a96bf29611ec4f P 6b8932de895a4214b5d81b61483465a5: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260806 01:05:55.234623 26643 heartbeater.cc:503] Master 127.11.88.126:42229 was elected leader, sending a full tablet report...
W20260806 01:05:55.312294 26644 tablet.cc:2369] T 881efdc97c004361a8a96bf29611ec4f P 6b8932de895a4214b5d81b61483465a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 01:05:55.349184 26790 raft_consensus.cc:482] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:05:55.349330 26790 raft_consensus.cc:504] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } } peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } }
I20260806 01:05:55.349726 26790 leader_election.cc:288] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b8932de895a4214b5d81b61483465a5 (127.11.88.66:36765), 135f875c21224ad2afd55b3d38ed6421 (127.11.88.65:43119)
I20260806 01:05:55.354288 26785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:55.350061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:37307 (local address 127.11.88.66:36765)
0806 01:05:55.350116 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:55.350119 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:55.350260 (+ 141us) server_negotiation.cc:407] Connection header received
0806 01:05:55.350292 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:55.350293 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:55.350303 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:55.350359 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:05:55.350567 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.351413 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.353082 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.353756 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.353878 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:55.353888 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:55.354165 (+ 277us) server_negotiation.cc:299] Negotiation successful
0806 01:05:55.354213 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 01:05:55.354285 26511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:55.350032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:35503 (local address 127.11.88.65:43119)
0806 01:05:55.350129 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:55.350131 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:55.350141 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:05:55.350180 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:55.350181 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:55.350189 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:55.350293 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:05:55.350567 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.351414 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.353086 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.353733 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.353863 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:55.353876 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:55.354160 (+ 284us) server_negotiation.cc:299] Negotiation successful
0806 01:05:55.354222 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 01:05:55.354288 26793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:55.349942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:36765 (local address 127.11.88.67:37307)
0806 01:05:55.350159 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:55.350171 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:55.350217 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:55.350374 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:55.350375 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:55.350377 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:05:55.350433 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:55.350434 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.351523 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.351524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:55.352961 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:55.352965 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.353929 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.353930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:55.354012 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:55.354018 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 01:05:55.354080 (+ 62us) client_negotiation.cc:240] Negotiation successful
0806 01:05:55.354150 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"mutex_wait_us":104,"thread_start_us":115,"threads_started":1}
I20260806 01:05:55.354288 26778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:55.349942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:43119 (local address 127.11.88.67:35503)
0806 01:05:55.350017 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:55.350031 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:55.350076 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:55.350309 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:55.350310 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:55.350316 (+ 6us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:05:55.350417 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:55.350419 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.351523 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.351524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:55.352961 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:55.352965 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.353950 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.353952 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:55.354027 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:55.354030 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:05:55.354118 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 01:05:55.354178 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":93}
I20260806 01:05:55.354743 26596 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "881efdc97c004361a8a96bf29611ec4f" candidate_uuid: "3d2d8e61aa62403995a43776d3bc778a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b8932de895a4214b5d81b61483465a5" is_pre_election: true
I20260806 01:05:55.354925 26596 raft_consensus.cc:2454] T 881efdc97c004361a8a96bf29611ec4f P 6b8932de895a4214b5d81b61483465a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d2d8e61aa62403995a43776d3bc778a in term 0.
I20260806 01:05:55.355218 26665 leader_election.cc:302] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d2d8e61aa62403995a43776d3bc778a, 6b8932de895a4214b5d81b61483465a5; no voters:
I20260806 01:05:55.355218 26449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "881efdc97c004361a8a96bf29611ec4f" candidate_uuid: "3d2d8e61aa62403995a43776d3bc778a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "135f875c21224ad2afd55b3d38ed6421" is_pre_election: true
I20260806 01:05:55.355391 26449 raft_consensus.cc:2454] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d2d8e61aa62403995a43776d3bc778a in term 0.
I20260806 01:05:55.355370 26790 raft_consensus.cc:2781] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:05:55.355448 26790 raft_consensus.cc:482] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:05:55.355485 26790 raft_consensus.cc:3037] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:05:55.356350 26790 raft_consensus.cc:504] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } } peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } }
I20260806 01:05:55.356516 26790 leader_election.cc:288] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a [CANDIDATE]: Term 1 election: Requested vote from peers 6b8932de895a4214b5d81b61483465a5 (127.11.88.66:36765), 135f875c21224ad2afd55b3d38ed6421 (127.11.88.65:43119)
I20260806 01:05:55.356676 26449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "881efdc97c004361a8a96bf29611ec4f" candidate_uuid: "3d2d8e61aa62403995a43776d3bc778a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "135f875c21224ad2afd55b3d38ed6421"
I20260806 01:05:55.356704 26596 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "881efdc97c004361a8a96bf29611ec4f" candidate_uuid: "3d2d8e61aa62403995a43776d3bc778a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b8932de895a4214b5d81b61483465a5"
I20260806 01:05:55.356781 26596 raft_consensus.cc:3037] T 881efdc97c004361a8a96bf29611ec4f P 6b8932de895a4214b5d81b61483465a5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:05:55.356782 26449 raft_consensus.cc:3037] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:05:55.357491 26596 raft_consensus.cc:2454] T 881efdc97c004361a8a96bf29611ec4f P 6b8932de895a4214b5d81b61483465a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d2d8e61aa62403995a43776d3bc778a in term 1.
I20260806 01:05:55.357492 26449 raft_consensus.cc:2454] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d2d8e61aa62403995a43776d3bc778a in term 1.
I20260806 01:05:55.357661 26665 leader_election.cc:302] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d2d8e61aa62403995a43776d3bc778a, 6b8932de895a4214b5d81b61483465a5; no voters:
I20260806 01:05:55.357774 26790 raft_consensus.cc:2781] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:05:55.357992 26790 raft_consensus.cc:686] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a [term 1 LEADER]: Becoming Leader. State: Replica: 3d2d8e61aa62403995a43776d3bc778a, State: Running, Role: LEADER
I20260806 01:05:55.358156 26790 consensus_queue.cc:237] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } } peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } }
I20260806 01:05:55.359097 26313 catalog_manager.cc:5495] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d2d8e61aa62403995a43776d3bc778a (127.11.88.67). New cstate: current_term: 1 leader_uuid: "3d2d8e61aa62403995a43776d3bc778a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } health_report { overall_health: UNKNOWN } } }
I20260806 01:05:55.373790 26784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:55.370983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54614 (local address 127.11.88.67:43461)
0806 01:05:55.371058 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:55.371060 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:55.371068 (+ 8us) server_negotiation.cc:407] Connection header received
0806 01:05:55.371124 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:55.371125 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:55.371142 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:55.371223 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:05:55.371406 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.372260 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.372988 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:55.373241 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:55.373305 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:55.373447 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:05:55.373546 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:05:55.373613 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:55.373632 (+ 19us) server_negotiation.cc:299] Negotiation successful
0806 01:05:55.373652 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 01:05:55.375720 26596 raft_consensus.cc:1261] T 881efdc97c004361a8a96bf29611ec4f P 6b8932de895a4214b5d81b61483465a5 [term 1 FOLLOWER]: Refusing update from remote peer 3d2d8e61aa62403995a43776d3bc778a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:05:55.375728 26449 raft_consensus.cc:1261] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Refusing update from remote peer 3d2d8e61aa62403995a43776d3bc778a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:05:55.376106 26794 consensus_queue.cc:1035] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:05:55.376231 26790 consensus_queue.cc:1035] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a [LEADER]: Connected to new peer: Peer: permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:05:55.379204 26797 mvcc.cc:205] Tried to move back new op lower bound from 7315367343616212992 to 7315367343547916288. Current Snapshot: MvccSnapshot[applied={T|T < 7315367343616212992}]
I20260806 01:05:55.381675 26310 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:59090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:05:55.381862 26310 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:59090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:05:55.382740 26310 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b: Sending DeleteTablet for 3 replicas of tablet 881efdc97c004361a8a96bf29611ec4f
I20260806 01:05:55.383172 26435 tablet_service.cc:1514] Processing DeleteTablet for tablet 881efdc97c004361a8a96bf29611ec4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:05:55 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:55596
I20260806 01:05:55.383174 26709 tablet_service.cc:1514] Processing DeleteTablet for tablet 881efdc97c004361a8a96bf29611ec4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:05:55 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:54598
I20260806 01:05:55.383194 26576 tablet_service.cc:1514] Processing DeleteTablet for tablet 881efdc97c004361a8a96bf29611ec4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:05:55 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:54370
I20260806 01:05:55.383278 26512 tablet_replica.cc:330] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421: stopping tablet replica
I20260806 01:05:55.383265 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 26351
I20260806 01:05:55.383332 26512 raft_consensus.cc:2229] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:05:55.383394 26512 raft_consensus.cc:2258] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:05:55.384248 26808 tablet_replica.cc:330] T 881efdc97c004361a8a96bf29611ec4f P 6b8932de895a4214b5d81b61483465a5: stopping tablet replica
I20260806 01:05:55.384495 26808 raft_consensus.cc:2229] T 881efdc97c004361a8a96bf29611ec4f P 6b8932de895a4214b5d81b61483465a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:05:55.384653 26808 raft_consensus.cc:2258] T 881efdc97c004361a8a96bf29611ec4f P 6b8932de895a4214b5d81b61483465a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:05:55.384883 26807 tablet_replica.cc:330] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a: stopping tablet replica
I20260806 01:05:55.384984 26807 raft_consensus.cc:2229] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a [term 1 LEADER]: Raft consensus shutting down.
I20260806 01:05:55.385111 26807 raft_consensus.cc:2258] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:05:55.385464 26808 ts_tablet_manager.cc:1905] T 881efdc97c004361a8a96bf29611ec4f P 6b8932de895a4214b5d81b61483465a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:05:55.385638 26807 ts_tablet_manager.cc:1905] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:05:55.387679 26807 ts_tablet_manager.cc:1918] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:05:55.387774 26807 log.cc:1196] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/wal/wals/881efdc97c004361a8a96bf29611ec4f
I20260806 01:05:55.387969 26808 ts_tablet_manager.cc:1918] T 881efdc97c004361a8a96bf29611ec4f P 6b8932de895a4214b5d81b61483465a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:05:55.388115 26808 log.cc:1196] T 881efdc97c004361a8a96bf29611ec4f P 6b8932de895a4214b5d81b61483465a5: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/wal/wals/881efdc97c004361a8a96bf29611ec4f
I20260806 01:05:55.388119 26807 ts_tablet_manager.cc:1939] T 881efdc97c004361a8a96bf29611ec4f P 3d2d8e61aa62403995a43776d3bc778a: Deleting consensus metadata
I20260806 01:05:55.388499 26808 ts_tablet_manager.cc:1939] T 881efdc97c004361a8a96bf29611ec4f P 6b8932de895a4214b5d81b61483465a5: Deleting consensus metadata
I20260806 01:05:55.388624 26297 catalog_manager.cc:4841] TS 3d2d8e61aa62403995a43776d3bc778a (127.11.88.67:43461): tablet 881efdc97c004361a8a96bf29611ec4f (table test-table [id=ea0531d2e0be4894afe55541bae61619]) successfully deleted
I20260806 01:05:55.389187 26299 catalog_manager.cc:4841] TS 6b8932de895a4214b5d81b61483465a5 (127.11.88.66:36765): tablet 881efdc97c004361a8a96bf29611ec4f (table test-table [id=ea0531d2e0be4894afe55541bae61619]) successfully deleted
W20260806 01:05:55.392488 26296 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.88.65:43119 (error 108)
I20260806 01:05:55.392997 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 26508
I20260806 01:05:55.393102 26783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:55.392928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:43119 (local address 127.0.0.1:55610)
0806 01:05:55.393008 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:55.393056 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.65:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 01:05:55.394308 26296 catalog_manager.cc:4584] TS 135f875c21224ad2afd55b3d38ed6421 (127.11.88.65:43119): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 881efdc97c004361a8a96bf29611ec4f: Network error: Client connection negotiation failed: client connection to 127.11.88.65:43119: connect: Connection refused (error 111)
I20260806 01:05:55.401197 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 26646
I20260806 01:05:55.408003 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 26279
I20260806 01:05:55.414956 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:42229
--webserver_interface=127.11.88.126
--webserver_port=35867
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:40623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:42229
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:05:55.504372 26810 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:05:55.504658 26810 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:05:55.504703 26810 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:05:55.506052 26810 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:05:55.506138 26810 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:05:55.506163 26810 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:05:55.506193 26810 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:05:55.506224 26810 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:05:55.507790 26810 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:42229
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:42229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=35867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26810
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:05:55.508085 26810 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:05:55.508325 26810 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:05:55.513612 26815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:55.513612 26819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:55.513640 26817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:55.514544 26810 server_base.cc:1034] running on GCE node
I20260806 01:05:55.514802 26810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:05:55.515106 26810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:05:55.516306 26810 hybrid_clock.cc:648] HybridClock initialized: now 1785978355516293 us; error 29 us; skew 500 ppm
Aug 06 01:05:55 dist-test-slave-69rg krb5kdc[25712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978355, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:05:55.519038 26810 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:05:55.519500 26810 webserver.cc:460] Webserver started at http://127.11.88.126:35867/ using document root <none> and password file <none>
I20260806 01:05:55.519752 26810 fs_manager.cc:359] Metadata directory not provided
I20260806 01:05:55.519804 26810 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:05:55.521274 26810 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:05:55.522245 26826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:55.522571 26810 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:05:55.522666 26810 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "0338673d295e4fa2a4b7c938441dfb0b"
format_stamp: "Formatted at 2026-08-06 01:05:53 on dist-test-slave-69rg"
server_key: "6d358b7212a97664e23a5a678ef2d0ed"
server_key_iv: "06c0aa044843510cf92bf6cf441bb9de"
server_key_version: "encryptionkey@0"
I20260806 01:05:55.523023 26810 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:05:55.549705 26810 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:05:55.551949 26810 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:05:55.552078 26810 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:05:55.556394 26810 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:42229
I20260806 01:05:55.556469 26878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:42229 every 8 connection(s)
I20260806 01:05:55.556878 26810 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:05:55.558506 26879 sys_catalog.cc:263] Verifying existing consensus state
I20260806 01:05:55.559137 26879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b: Bootstrap starting.
I20260806 01:05:55.560921 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 26810
I20260806 01:05:55.561337 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:43119
--local_ip_for_outbound_sockets=127.11.88.65
--tserver_master_addrs=127.11.88.126:42229
--webserver_port=32969
--webserver_interface=127.11.88.65
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:40623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 01:05:55.569412 26879 log.cc:824] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b: Log is configured to *not* fsync() on all Append() calls
I20260806 01:05:55.571798 26879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 01:05:55.572124 26879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b: Bootstrap complete.
I20260806 01:05:55.574566 26879 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0338673d295e4fa2a4b7c938441dfb0b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42229 } }
I20260806 01:05:55.574815 26879 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0338673d295e4fa2a4b7c938441dfb0b, State: Initialized, Role: FOLLOWER
I20260806 01:05:55.575021 26879 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0338673d295e4fa2a4b7c938441dfb0b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42229 } }
I20260806 01:05:55.575129 26879 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:05:55.575181 26879 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:05:55.575229 26879 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [term 2 FOLLOWER]: Advancing to term 3
I20260806 01:05:55.576301 26879 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0338673d295e4fa2a4b7c938441dfb0b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42229 } }
I20260806 01:05:55.576428 26879 leader_election.cc:302] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0338673d295e4fa2a4b7c938441dfb0b; no voters:
I20260806 01:05:55.576617 26879 leader_election.cc:288] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 01:05:55.576694 26883 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [term 3 FOLLOWER]: Leader election won for term 3
I20260806 01:05:55.576915 26883 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [term 3 LEADER]: Becoming Leader. State: Replica: 0338673d295e4fa2a4b7c938441dfb0b, State: Running, Role: LEADER
I20260806 01:05:55.576900 26879 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:05:55.577071 26883 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0338673d295e4fa2a4b7c938441dfb0b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42229 } }
I20260806 01:05:55.577418 26885 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0338673d295e4fa2a4b7c938441dfb0b. Latest consensus state: current_term: 3 leader_uuid: "0338673d295e4fa2a4b7c938441dfb0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0338673d295e4fa2a4b7c938441dfb0b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42229 } } }
I20260806 01:05:55.577489 26885 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [sys.catalog]: This master's current role is: LEADER
I20260806 01:05:55.577634 26884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "0338673d295e4fa2a4b7c938441dfb0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0338673d295e4fa2a4b7c938441dfb0b" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42229 } } }
I20260806 01:05:55.577687 26884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0338673d295e4fa2a4b7c938441dfb0b [sys.catalog]: This master's current role is: LEADER
I20260806 01:05:55.578013 26887 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:05:55.578872 26887 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:05:55.578999 26887 catalog_manager.cc:1259] Loaded cluster ID: a2df001b86784077826b493ae46d554e
I20260806 01:05:55.579248 26887 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260806 01:05:55.579748 26887 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fbe35bfa9ad google::LogMessage::Fail() at ??:0
@ 0x7fbe35bfd88a google::LogMessage::SendToLog() at ??:0
@ 0x7fbe35bfa4de google::LogMessage::Flush() at ??:0
@ 0x7fbe35bfba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fbe3db1b0f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fbe3db248b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fbe37ac80d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fbe37abd954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fbe389216db start_thread at ??:0
@ 0x7fbe346f861f clone at ??:0
W20260806 01:05:55.668267 26881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:05:55.668473 26881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:05:55.668498 26881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:05:55.669739 26881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:05:55.669786 26881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:05:55.669857 26881 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:05:55.671402 26881 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:43119
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=32969
--tserver_master_addrs=127.11.88.126:42229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26881
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:05:55.671676 26881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:05:55.671949 26881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:05:55.678238 26917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:55.678270 26916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:55.678493 26881 server_base.cc:1034] running on GCE node
W20260806 01:05:55.678247 26919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:55.678879 26881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:05:55.679178 26881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:05:55.680364 26881 hybrid_clock.cc:648] HybridClock initialized: now 1785978355680346 us; error 34 us; skew 500 ppm
Aug 06 01:05:55 dist-test-slave-69rg krb5kdc[25712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978355, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:05:55.683591 26881 init.cc:377] Logged in from keytab as kudu/127.11.88.65@KRBTEST.COM (short username kudu)
I20260806 01:05:55.684095 26881 webserver.cc:460] Webserver started at http://127.11.88.65:32969/ using document root <none> and password file <none>
I20260806 01:05:55.684333 26881 fs_manager.cc:359] Metadata directory not provided
I20260806 01:05:55.684406 26881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:05:55.685956 26881 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:05:55.686866 26926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:55.687141 26881 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:05:55.687261 26881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "135f875c21224ad2afd55b3d38ed6421"
format_stamp: "Formatted at 2026-08-06 01:05:53 on dist-test-slave-69rg"
server_key: "b5952fbe24952a48d674f884e1da7cf9"
server_key_iv: "ced809bf255401fa4a34a5706adf814b"
server_key_version: "encryptionkey@0"
I20260806 01:05:55.687697 26881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:05:55.696775 26881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:05:55.699405 26881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:05:55.699561 26881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:05:55.699846 26881 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:05:55.700384 26933 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 01:05:55.702493 26881 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 01:05:55.702586 26881 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260806 01:05:55.702633 26881 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 01:05:55.703404 26881 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 01:05:55.703467 26881 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260806 01:05:55.703526 26933 tablet_bootstrap.cc:492] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421: Bootstrap starting.
I20260806 01:05:55.712031 26881 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:43119
I20260806 01:05:55.712211 27041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:43119 every 8 connection(s)
I20260806 01:05:55.712543 26881 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
I20260806 01:05:55.715807 26933 log.cc:824] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421: Log is configured to *not* fsync() on all Append() calls
I20260806 01:05:55.717907 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 26881
I20260806 01:05:55.718236 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:36765
--local_ip_for_outbound_sockets=127.11.88.66
--tserver_master_addrs=127.11.88.126:42229
--webserver_port=34581
--webserver_interface=127.11.88.66
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:40623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 01:05:55.718737 26933 tablet_bootstrap.cc:492] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 01:05:55.719060 26933 tablet_bootstrap.cc:492] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421: Bootstrap complete.
I20260806 01:05:55.720475 26933 ts_tablet_manager.cc:1397] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.007s
I20260806 01:05:55.722000 26933 raft_consensus.cc:348] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } } peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } }
I20260806 01:05:55.722352 26933 raft_consensus.cc:729] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 135f875c21224ad2afd55b3d38ed6421, State: Initialized, Role: FOLLOWER
I20260806 01:05:55.722522 26933 consensus_queue.cc:260] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } } peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } }
I20260806 01:05:55.722807 26933 ts_tablet_manager.cc:1428] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
W20260806 01:05:55.775784 27044 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:05:55.713334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.65:44157)
0806 01:05:55.713544 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:55.713593 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:55.714239 (+ 646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:55.775560 (+ 61321us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":126,"threads_started":1}
W20260806 01:05:55.776037 27042 heartbeater.cc:644] Failed to heartbeat to 127.11.88.126:42229 (0 consecutive failures): Network error: Failed to ping master at 127.11.88.126:42229: Client connection negotiation failed: client connection to 127.11.88.126:42229: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 01:05:55.776505 27044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:55.776343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.65:54287)
0806 01:05:55.776425 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:55.776478 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260806 01:05:55.776921 27044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:55.776818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.65:34017)
0806 01:05:55.776869 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:55.776894 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260806 01:05:55.777032 27042 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 01:05:55.807331 27046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:05:55.807577 27046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:05:55.807621 27046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:05:55.808861 27046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:05:55.808933 27046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:05:55.808980 27046 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:05:55.810588 27046 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:36765
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=34581
--tserver_master_addrs=127.11.88.126:42229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27046
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:05:55.810861 27046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:05:55.811116 27046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:05:55.816357 27052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:55.816381 27055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:55.816381 27053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:55.816488 27046 server_base.cc:1034] running on GCE node
I20260806 01:05:55.816869 27046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:05:55.817137 27046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:05:55.818279 27046 hybrid_clock.cc:648] HybridClock initialized: now 1785978355818260 us; error 40 us; skew 500 ppm
Aug 06 01:05:55 dist-test-slave-69rg krb5kdc[25712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978355, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:05:55.820830 27046 init.cc:377] Logged in from keytab as kudu/127.11.88.66@KRBTEST.COM (short username kudu)
I20260806 01:05:55.821270 27046 webserver.cc:460] Webserver started at http://127.11.88.66:34581/ using document root <none> and password file <none>
I20260806 01:05:55.821528 27046 fs_manager.cc:359] Metadata directory not provided
I20260806 01:05:55.821604 27046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:05:55.823042 27046 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:05:55.823702 27062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:55.823892 27046 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:05:55.824002 27046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "6b8932de895a4214b5d81b61483465a5"
format_stamp: "Formatted at 2026-08-06 01:05:54 on dist-test-slave-69rg"
server_key: "83541741b813cff1b788a92cec709dba"
server_key_iv: "b3adcc80e46a59f8c281e1ba2dee40da"
server_key_version: "encryptionkey@0"
I20260806 01:05:55.824378 27046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:05:55.841192 27046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:05:55.843747 27046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:05:55.843928 27046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:05:55.844205 27046 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:05:55.844535 27046 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:05:55.844594 27046 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:55.844637 27046 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:05:55.844661 27046 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:55.851131 27046 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:36765
I20260806 01:05:55.851218 27176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:36765 every 8 connection(s)
I20260806 01:05:55.851585 27046 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
I20260806 01:05:55.852849 27179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:55.852411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.66:59063)
0806 01:05:55.852590 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:55.852702 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":84,"threads_started":1}
W20260806 01:05:55.853338 27177 heartbeater.cc:644] Failed to heartbeat to 127.11.88.126:42229 (0 consecutive failures): Network error: Failed to ping master at 127.11.88.126:42229: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
I20260806 01:05:55.853698 27179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:55.853581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.66:32977)
0806 01:05:55.853630 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:55.853677 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260806 01:05:55.854121 27179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:55.853981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.66:34675)
0806 01:05:55.854068 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:55.854100 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260806 01:05:55.854285 27177 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 01:05:55.855671 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 27046
I20260806 01:05:55.855975 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:43461
--local_ip_for_outbound_sockets=127.11.88.67
--tserver_master_addrs=127.11.88.126:42229
--webserver_port=37933
--webserver_interface=127.11.88.67
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:40623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:05:55.943856 27180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:05:55.944080 27180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:05:55.944106 27180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:05:55.945318 27180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:05:55.945364 27180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:05:55.945391 27180 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:05:55.946997 27180 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:43461
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=37933
--tserver_master_addrs=127.11.88.126:42229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27180
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:05:55.947263 27180 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:05:55.947512 27180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:05:55.952768 27186 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:55.952855 27185 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:05:55.952751 27188 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:05:55.952956 27180 server_base.cc:1034] running on GCE node
I20260806 01:05:55.953208 27180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:05:55.953415 27180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:05:55.954598 27180 hybrid_clock.cc:648] HybridClock initialized: now 1785978355954583 us; error 39 us; skew 500 ppm
Aug 06 01:05:55 dist-test-slave-69rg krb5kdc[25712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978355, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:05:55.957317 27180 init.cc:377] Logged in from keytab as kudu/127.11.88.67@KRBTEST.COM (short username kudu)
I20260806 01:05:55.957912 27180 webserver.cc:460] Webserver started at http://127.11.88.67:37933/ using document root <none> and password file <none>
I20260806 01:05:55.958206 27180 fs_manager.cc:359] Metadata directory not provided
I20260806 01:05:55.958298 27180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:05:55.959872 27180 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 01:05:55.960673 27195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:55.960968 27180 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:05:55.961133 27180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "3d2d8e61aa62403995a43776d3bc778a"
format_stamp: "Formatted at 2026-08-06 01:05:54 on dist-test-slave-69rg"
server_key: "0fac01d94a30a7c5e862a8a442eb1879"
server_key_iv: "78eea951f3fea773818b2c489568811e"
server_key_version: "encryptionkey@0"
I20260806 01:05:55.961539 27180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:05:55.977489 27180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:05:55.979645 27180 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:05:55.979821 27180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:05:55.980072 27180 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:05:55.980425 27180 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:05:55.980490 27180 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:55.980541 27180 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:05:55.980588 27180 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:05:55.986802 27180 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:43461
I20260806 01:05:55.986850 27309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:43461 every 8 connection(s)
I20260806 01:05:55.987210 27180 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
I20260806 01:05:55.988328 27312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:55.987870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.67:58481)
0806 01:05:55.988076 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:55.988173 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":81,"threads_started":1}
W20260806 01:05:55.988806 27310 heartbeater.cc:644] Failed to heartbeat to 127.11.88.126:42229 (0 consecutive failures): Network error: Failed to ping master at 127.11.88.126:42229: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
I20260806 01:05:55.989130 27312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:55.989018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.67:37297)
0806 01:05:55.989081 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:55.989110 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260806 01:05:55.989401 27312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:55.989343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.67:47043)
0806 01:05:55.989367 (+ 24us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:55.989388 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260806 01:05:55.989527 27310 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 01:05:55.992046 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 27180
I20260806 01:05:56.777969 27314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:56.777502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.65:52609)
0806 01:05:56.777730 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:56.777782 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":105,"threads_started":1}
I20260806 01:05:56.854877 27315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:56.854632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.66:36741)
0806 01:05:56.854784 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:56.854821 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":60,"threads_started":1}
I20260806 01:05:56.961027 27316 raft_consensus.cc:482] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:05:56.961176 27316 raft_consensus.cc:504] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } } peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } }
I20260806 01:05:56.961524 27316 leader_election.cc:288] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d2d8e61aa62403995a43776d3bc778a (127.11.88.67:43461), 6b8932de895a4214b5d81b61483465a5 (127.11.88.66:36765)
Aug 06 01:05:56 dist-test-slave-69rg krb5kdc[25712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978355, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for kudu/127.11.88.67@KRBTEST.COM
Aug 06 01:05:56 dist-test-slave-69rg krb5kdc[25712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978355, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for kudu/127.11.88.66@KRBTEST.COM
I20260806 01:05:56.974538 27314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:56.961711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:43461 (local address 127.11.88.65:58409)
0806 01:05:56.961769 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:56.961781 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:56.961858 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:56.962978 (+ 1120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:56.962980 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:56.963503 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:05:56.963782 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:56.963790 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:56.965592 (+ 1802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:56.965593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:56.966994 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:56.966997 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:56.967884 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:56.967885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:56.968026 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:56.968713 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:05:56.968724 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:05:56.970622 (+ 1898us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:05:56.972894 (+ 2272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:56.972902 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:56.972904 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:56.973121 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:56.973422 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:56.973423 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:56.973423 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:56.973529 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:56.974007 (+ 478us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:05:56.974015 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:05:56.974148 (+ 133us) client_negotiation.cc:769] Sending connection context
0806 01:05:56.974248 (+ 100us) client_negotiation.cc:240] Negotiation successful
0806 01:05:56.974425 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":125}
I20260806 01:05:56.974867 27317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:56.961720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:36765 (local address 127.11.88.65:45389)
0806 01:05:56.961935 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:56.961945 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 01:05:56.962006 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:05:56.962977 (+ 971us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:05:56.962980 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:05:56.963502 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:05:56.963782 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:56.963790 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:56.965605 (+ 1815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:56.965606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:56.966994 (+ 1388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:05:56.966997 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:05:56.967884 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:05:56.967885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:05:56.968026 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:56.968755 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:05:56.968759 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:05:56.971055 (+ 2296us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:05:56.973164 (+ 2109us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:56.973165 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:56.973166 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:56.973345 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:56.973848 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:05:56.973849 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:05:56.973850 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:05:56.973950 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:05:56.974461 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:05:56.974462 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:05:56.974516 (+ 54us) client_negotiation.cc:769] Sending connection context
0806 01:05:56.974607 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 01:05:56.974730 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"mutex_wait_us":84,"thread_start_us":134,"threads_started":1}
I20260806 01:05:56.974565 27318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:56.961856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:58409 (local address 127.11.88.67:43461)
0806 01:05:56.962058 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:56.962072 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:56.962098 (+ 26us) server_negotiation.cc:407] Connection header received
0806 01:05:56.962663 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:56.962667 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:56.962744 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:56.962904 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:56.963950 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:56.965469 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:56.967144 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:56.967769 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:56.967890 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:56.970746 (+ 2856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:56.970751 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:56.970751 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:56.970764 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:56.972803 (+ 2039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:56.973227 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:56.973230 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:56.973231 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:56.973342 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:56.973605 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:56.973606 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:56.973607 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:56.973933 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:56.974029 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:56.974344 (+ 315us) server_negotiation.cc:299] Negotiation successful
0806 01:05:56.974475 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":65,"threads_started":1}
I20260806 01:05:56.974993 27319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:56.961869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:45389 (local address 127.11.88.66:36765)
0806 01:05:56.962068 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0806 01:05:56.962075 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 01:05:56.962120 (+ 45us) server_negotiation.cc:407] Connection header received
0806 01:05:56.962688 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:05:56.962691 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:05:56.962744 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:05:56.962904 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:05:56.963950 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:56.965464 (+ 1514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:56.967105 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:05:56.967763 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:05:56.967890 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:05:56.971163 (+ 3273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:05:56.971167 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:05:56.971167 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:05:56.971177 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:05:56.973041 (+ 1864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:56.973432 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:56.973435 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:56.973436 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:56.973723 (+ 287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:05:56.974099 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:05:56.974100 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:05:56.974100 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:05:56.974346 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:05:56.974465 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 01:05:56.974694 (+ 229us) server_negotiation.cc:299] Negotiation successful
0806 01:05:56.974855 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":60,"threads_started":1}
W20260806 01:05:56.975739 26928 leader_election.cc:341] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3d2d8e61aa62403995a43776d3bc778a (127.11.88.67:43461): Not found: Tablet not found: 881efdc97c004361a8a96bf29611ec4f
W20260806 01:05:56.975847 26930 leader_election.cc:341] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b8932de895a4214b5d81b61483465a5 (127.11.88.66:36765): Not found: Tablet not found: 881efdc97c004361a8a96bf29611ec4f
I20260806 01:05:56.975901 26930 leader_election.cc:302] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 135f875c21224ad2afd55b3d38ed6421; no voters: 3d2d8e61aa62403995a43776d3bc778a, 6b8932de895a4214b5d81b61483465a5
I20260806 01:05:56.976007 27316 raft_consensus.cc:2726] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 01:05:56.990206 27320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:56.989962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.67:56465)
0806 01:05:56.990097 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:56.990147 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":74,"threads_started":1}
I20260806 01:05:57.778766 27321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:57.778510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.65:51119)
0806 01:05:57.778678 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:57.778718 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":74,"threads_started":1}
I20260806 01:05:57.855705 27323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:57.855421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.66:40499)
0806 01:05:57.855603 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:57.855656 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":68,"threads_started":1}
I20260806 01:05:57.990969 27324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:57.990714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.67:38351)
0806 01:05:57.990888 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:57.990924 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":60,"threads_started":1}
I20260806 01:05:58.779623 27325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:58.779339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.65:33671)
0806 01:05:58.779523 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:58.779562 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":86,"threads_started":1}
I20260806 01:05:58.856578 27326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:58.856273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.66:36915)
0806 01:05:58.856473 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:58.856522 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":89,"threads_started":1}
I20260806 01:05:58.876341 27327 raft_consensus.cc:482] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:05:58.876475 27327 raft_consensus.cc:504] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } } peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } }
I20260806 01:05:58.876706 27327 leader_election.cc:288] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d2d8e61aa62403995a43776d3bc778a (127.11.88.67:43461), 6b8932de895a4214b5d81b61483465a5 (127.11.88.66:36765)
W20260806 01:05:58.877249 26930 leader_election.cc:341] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b8932de895a4214b5d81b61483465a5 (127.11.88.66:36765): Not found: Tablet not found: 881efdc97c004361a8a96bf29611ec4f
W20260806 01:05:58.877336 26928 leader_election.cc:341] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3d2d8e61aa62403995a43776d3bc778a (127.11.88.67:43461): Not found: Tablet not found: 881efdc97c004361a8a96bf29611ec4f
I20260806 01:05:58.877444 26928 leader_election.cc:302] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 135f875c21224ad2afd55b3d38ed6421; no voters: 3d2d8e61aa62403995a43776d3bc778a, 6b8932de895a4214b5d81b61483465a5
I20260806 01:05:58.877564 27327 raft_consensus.cc:2726] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 01:05:58.991815 27328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:58.991564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.67:45507)
0806 01:05:58.991729 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:58.991767 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":81,"threads_started":1}
I20260806 01:05:59.780429 27329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:59.780182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.65:45151)
0806 01:05:59.780330 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:59.780381 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":68,"threads_started":1}
I20260806 01:05:59.857411 27330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:59.857157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.66:39739)
0806 01:05:59.857318 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:59.857361 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":82,"threads_started":1}
I20260806 01:05:59.992595 27331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:05:59.992332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.67:53105)
0806 01:05:59.992497 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0806 01:05:59.992544 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":65,"threads_started":1}
I20260806 01:06:00.781598 27332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:00.781150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.65:43791)
0806 01:06:00.781460 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:00.781538 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":165,"threads_started":1}
I20260806 01:06:00.858501 27333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:00.858203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.66:49971)
0806 01:06:00.858395 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:00.858447 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":96,"threads_started":1}
I20260806 01:06:00.993526 27334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:00.993220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.67:56849)
0806 01:06:00.993424 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:00.993473 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":93,"threads_started":1}
I20260806 01:06:01.782436 27335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:01.782168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.65:49419)
0806 01:06:01.782336 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:01.782387 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":77,"threads_started":1}
I20260806 01:06:01.859478 27336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:01.859137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.66:41449)
0806 01:06:01.859367 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:01.859415 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":82,"threads_started":1}
I20260806 01:06:01.994578 27337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:01.994252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.67:57309)
0806 01:06:01.994462 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:01.994526 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":113,"threads_started":1}
I20260806 01:06:02.083840 27338 raft_consensus.cc:482] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:06:02.083953 27338 raft_consensus.cc:504] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } } peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } }
I20260806 01:06:02.084160 27338 leader_election.cc:288] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d2d8e61aa62403995a43776d3bc778a (127.11.88.67:43461), 6b8932de895a4214b5d81b61483465a5 (127.11.88.66:36765)
W20260806 01:06:02.084609 26930 leader_election.cc:341] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b8932de895a4214b5d81b61483465a5 (127.11.88.66:36765): Not found: Tablet not found: 881efdc97c004361a8a96bf29611ec4f
W20260806 01:06:02.084730 26928 leader_election.cc:341] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3d2d8e61aa62403995a43776d3bc778a (127.11.88.67:43461): Not found: Tablet not found: 881efdc97c004361a8a96bf29611ec4f
I20260806 01:06:02.084771 26928 leader_election.cc:302] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 135f875c21224ad2afd55b3d38ed6421; no voters: 3d2d8e61aa62403995a43776d3bc778a, 6b8932de895a4214b5d81b61483465a5
I20260806 01:06:02.084858 27338 raft_consensus.cc:2726] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 01:06:02.783370 27339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:02.783104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.65:44731)
0806 01:06:02.783281 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:02.783323 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":69,"threads_started":1}
I20260806 01:06:02.860340 27340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:02.860059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.66:42449)
0806 01:06:02.860238 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:02.860288 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":78,"threads_started":1}
I20260806 01:06:02.995433 27341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:02.995163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.67:53377)
0806 01:06:02.995334 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:02.995382 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":70,"threads_started":1}
I20260806 01:06:03.784403 27342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:03.784053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.65:42341)
0806 01:06:03.784312 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:03.784353 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":183,"threads_started":1}
I20260806 01:06:03.861307 27343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:03.861014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.66:54717)
0806 01:06:03.861200 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:03.861245 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":74,"threads_started":1}
I20260806 01:06:03.996387 27344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:03.996115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.67:37577)
0806 01:06:03.996285 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:03.996332 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":89,"threads_started":1}
I20260806 01:06:04.785482 27345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:04.785121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.65:40271)
0806 01:06:04.785361 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:04.785428 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":135,"threads_started":1}
I20260806 01:06:04.864044 27346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:04.862965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.66:37139)
0806 01:06:04.863867 (+ 902us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:04.863976 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":874,"thread_start_us":90,"threads_started":1}
I20260806 01:06:04.997704 27347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:04.997042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.67:46561)
0806 01:06:04.997382 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:04.997468 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":155,"threads_started":1}
I20260806 01:06:05.786516 27348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:05.786217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.65:37225)
0806 01:06:05.786421 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:05.786467 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":131,"threads_started":1}
I20260806 01:06:05.837282 27349 raft_consensus.cc:482] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:06:05.837458 27349 raft_consensus.cc:504] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } } peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } }
I20260806 01:06:05.837692 27349 leader_election.cc:288] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d2d8e61aa62403995a43776d3bc778a (127.11.88.67:43461), 6b8932de895a4214b5d81b61483465a5 (127.11.88.66:36765)
W20260806 01:06:05.838172 26930 leader_election.cc:341] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b8932de895a4214b5d81b61483465a5 (127.11.88.66:36765): Not found: Tablet not found: 881efdc97c004361a8a96bf29611ec4f
W20260806 01:06:05.838286 26928 leader_election.cc:341] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3d2d8e61aa62403995a43776d3bc778a (127.11.88.67:43461): Not found: Tablet not found: 881efdc97c004361a8a96bf29611ec4f
I20260806 01:06:05.838364 26928 leader_election.cc:302] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 135f875c21224ad2afd55b3d38ed6421; no voters: 3d2d8e61aa62403995a43776d3bc778a, 6b8932de895a4214b5d81b61483465a5
I20260806 01:06:05.838443 27349 raft_consensus.cc:2726] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 01:06:05.865361 27350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:05.865081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.66:56007)
0806 01:06:05.865258 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:05.865309 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":76,"threads_started":1}
I20260806 01:06:05.999235 27351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:05.998891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.67:49785)
0806 01:06:05.999104 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:05.999157 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":89,"threads_started":1}
I20260806 01:06:06.787534 27352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:06.787241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.65:50139)
0806 01:06:06.787431 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:06.787481 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":79,"threads_started":1}
I20260806 01:06:06.866470 27353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:06.866159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.66:51219)
0806 01:06:06.866367 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:06.866417 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":93,"threads_started":1}
I20260806 01:06:07.000285 27354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:06.999953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.67:44073)
0806 01:06:07.000184 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:07.000230 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":107,"threads_started":1}
I20260806 01:06:07.788461 27355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:07.788214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.65:47817)
0806 01:06:07.788358 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:07.788397 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":79,"threads_started":1}
I20260806 01:06:07.867415 27356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:07.867116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.66:41011)
0806 01:06:07.867312 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:07.867362 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":69,"threads_started":1}
I20260806 01:06:08.001672 27357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:08.001241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.67:39927)
0806 01:06:08.001510 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:08.001618 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":73,"threads_started":1}
I20260806 01:06:08.789532 27358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:08.789252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.65:34861)
0806 01:06:08.789429 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:08.789481 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":87,"threads_started":1}
I20260806 01:06:08.868520 27359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:08.868165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.66:48967)
0806 01:06:08.868416 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:08.868466 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":83,"threads_started":1}
I20260806 01:06:09.003001 27360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:09.002373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.67:45565)
0806 01:06:09.002557 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:09.002687 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":72,"threads_started":1}
I20260806 01:06:09.197443 27361 raft_consensus.cc:482] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:06:09.197569 27361 raft_consensus.cc:504] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d2d8e61aa62403995a43776d3bc778a" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 43461 } } peers { permanent_uuid: "6b8932de895a4214b5d81b61483465a5" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36765 } } peers { permanent_uuid: "135f875c21224ad2afd55b3d38ed6421" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 43119 } }
I20260806 01:06:09.197781 27361 leader_election.cc:288] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3d2d8e61aa62403995a43776d3bc778a (127.11.88.67:43461), 6b8932de895a4214b5d81b61483465a5 (127.11.88.66:36765)
W20260806 01:06:09.198436 26928 leader_election.cc:341] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3d2d8e61aa62403995a43776d3bc778a (127.11.88.67:43461): Not found: Tablet not found: 881efdc97c004361a8a96bf29611ec4f
W20260806 01:06:09.198536 26930 leader_election.cc:341] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6b8932de895a4214b5d81b61483465a5 (127.11.88.66:36765): Not found: Tablet not found: 881efdc97c004361a8a96bf29611ec4f
I20260806 01:06:09.198668 26930 leader_election.cc:302] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 135f875c21224ad2afd55b3d38ed6421; no voters: 3d2d8e61aa62403995a43776d3bc778a, 6b8932de895a4214b5d81b61483465a5
I20260806 01:06:09.198770 27361 raft_consensus.cc:2726] T 881efdc97c004361a8a96bf29611ec4f P 135f875c21224ad2afd55b3d38ed6421 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 01:06:09.790506 27362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:09.790209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.65:41251)
0806 01:06:09.790373 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:09.790452 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":93,"threads_started":1}
I20260806 01:06:09.869455 27363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:09.869182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.66:51901)
0806 01:06:09.869346 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:09.869402 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":86,"threads_started":1}
I20260806 01:06:10.004217 27364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:10.003890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.67:53719)
0806 01:06:10.004110 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:10.004160 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":103,"threads_started":1}
I20260806 01:06:10.791599 27365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:10.791274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.65:57675)
0806 01:06:10.791495 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:10.791544 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":96,"threads_started":1}
I20260806 01:06:10.870571 27366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:10.870181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.66:34747)
0806 01:06:10.870437 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:10.870488 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":87,"threads_started":1}
I20260806 01:06:10.997054 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 26881
I20260806 01:06:11.005221 27367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:11.004985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42229 (local address 127.11.88.67:52015)
0806 01:06:11.005130 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:11.005162 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":72,"threads_started":1}
I20260806 01:06:11.005297 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 27046
I20260806 01:06:11.011921 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 27180
2026-08-06T01:06:11Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18649 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:06:11 dist-test-slave-69rg krb5kdc[27370](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:06:11 dist-test-slave-69rg krb5kdc[27370](info): set up 2 sockets
Aug 06 01:06:11 dist-test-slave-69rg krb5kdc[27370](info): commencing operation
krb5kdc: starting...
W20260806 01:06:12.167944 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:06:12 dist-test-slave-69rg krb5kdc[27370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978372, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:06:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:06:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:06:12.315757 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:44403
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:39067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:44403
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:06:12.424357 27383 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:06:12.424656 27383 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:06:12.424701 27383 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:06:12.426174 27383 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 01:06:12.426288 27383 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 01:06:12.426317 27383 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 01:06:12.426338 27383 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:06:12.426369 27383 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:06:12.426403 27383 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:06:12.426429 27383 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:06:12.426460 27383 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:06:12.428427 27383 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:39067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:44403
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:44403
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27383
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:06:12.428745 27383 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:06:12.429030 27383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:06:12.434602 27391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:06:12.434609 27389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:06:12.434907 27383 server_base.cc:1034] running on GCE node
W20260806 01:06:12.435120 27388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:06:12.435415 27383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:06:12.435768 27383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:06:12.436985 27383 hybrid_clock.cc:648] HybridClock initialized: now 1785978372436950 us; error 58 us; skew 500 ppm
Aug 06 01:06:12 dist-test-slave-69rg krb5kdc[27370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978372, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:06:12.440008 27383 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:06:12.440524 27383 webserver.cc:460] Webserver started at http://127.11.88.126:39303/ using document root <none> and password file <none>
I20260806 01:06:12.440804 27383 fs_manager.cc:359] Metadata directory not provided
I20260806 01:06:12.440876 27383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:06:12.441092 27383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:06:12.442360 27383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "005365bd08744d00a8bec09d40ae33bd"
format_stamp: "Formatted at 2026-08-06 01:06:12 on dist-test-slave-69rg"
server_key: "54c16e2361a3891571080bc1851f1368"
server_key_iv: "49a759d304a229fa166f7c2e12860baa"
server_key_version: "encryptionkey@0"
I20260806 01:06:12.442786 27383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "005365bd08744d00a8bec09d40ae33bd"
format_stamp: "Formatted at 2026-08-06 01:06:12 on dist-test-slave-69rg"
server_key: "54c16e2361a3891571080bc1851f1368"
server_key_iv: "49a759d304a229fa166f7c2e12860baa"
server_key_version: "encryptionkey@0"
I20260806 01:06:12.444461 27383 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 01:06:12.445498 27398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:12.445955 27383 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:06:12.446158 27383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "005365bd08744d00a8bec09d40ae33bd"
format_stamp: "Formatted at 2026-08-06 01:06:12 on dist-test-slave-69rg"
server_key: "54c16e2361a3891571080bc1851f1368"
server_key_iv: "49a759d304a229fa166f7c2e12860baa"
server_key_version: "encryptionkey@0"
I20260806 01:06:12.446273 27383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:06:12.458765 27383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:06:12.461315 27383 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:06:12.461495 27383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:06:12.466100 27383 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:44403
I20260806 01:06:12.466168 27450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:44403 every 8 connection(s)
I20260806 01:06:12.466655 27383 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:06:12.467878 27451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:06:12.469235 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 27383
I20260806 01:06:12.469343 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:06:12.469564 11617 external_mini_cluster.cc:1428] Setting key 7eeb44094b89a33f5b2221ebaf353942
I20260806 01:06:12.471065 27451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd: Bootstrap starting.
I20260806 01:06:12.471925 27451 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd: Neither blocks nor log segments found. Creating new log.
I20260806 01:06:12.472297 27451 log.cc:824] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd: Log is configured to *not* fsync() on all Append() calls
I20260806 01:06:12.473081 27451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd: No bootstrap required, opened a new log
I20260806 01:06:12.475390 27451 raft_consensus.cc:348] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005365bd08744d00a8bec09d40ae33bd" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44403 } }
I20260806 01:06:12.475600 27451 raft_consensus.cc:374] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:06:12.475651 27451 raft_consensus.cc:729] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005365bd08744d00a8bec09d40ae33bd, State: Initialized, Role: FOLLOWER
I20260806 01:06:12.475792 27451 consensus_queue.cc:260] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005365bd08744d00a8bec09d40ae33bd" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44403 } }
I20260806 01:06:12.475888 27451 raft_consensus.cc:388] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:06:12.475934 27451 raft_consensus.cc:482] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:06:12.475981 27451 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:06:12.477654 27451 raft_consensus.cc:504] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005365bd08744d00a8bec09d40ae33bd" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44403 } }
I20260806 01:06:12.477909 27451 leader_election.cc:302] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 005365bd08744d00a8bec09d40ae33bd; no voters:
I20260806 01:06:12.478240 27451 leader_election.cc:288] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:06:12.478459 27456 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:06:12.478652 27456 raft_consensus.cc:686] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [term 1 LEADER]: Becoming Leader. State: Replica: 005365bd08744d00a8bec09d40ae33bd, State: Running, Role: LEADER
I20260806 01:06:12.478794 27456 consensus_queue.cc:237] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005365bd08744d00a8bec09d40ae33bd" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44403 } }
I20260806 01:06:12.479411 27457 sys_catalog.cc:455] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "005365bd08744d00a8bec09d40ae33bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005365bd08744d00a8bec09d40ae33bd" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44403 } } }
I20260806 01:06:12.479511 27457 sys_catalog.cc:458] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [sys.catalog]: This master's current role is: LEADER
I20260806 01:06:12.479405 27456 sys_catalog.cc:455] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 005365bd08744d00a8bec09d40ae33bd. Latest consensus state: current_term: 1 leader_uuid: "005365bd08744d00a8bec09d40ae33bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005365bd08744d00a8bec09d40ae33bd" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44403 } } }
I20260806 01:06:12.479636 27456 sys_catalog.cc:458] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [sys.catalog]: This master's current role is: LEADER
I20260806 01:06:12.479497 27451 sys_catalog.cc:564] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [sys.catalog]: configured and running, proceeding with master startup.
Aug 06 01:06:12 dist-test-slave-69rg krb5kdc[27370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978372, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:06:12.480919 27460 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:06:12.481925 27460 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:06:12.485953 27460 catalog_manager.cc:1347] Generated new cluster ID: 11d8ae91cf714d4abe99ffd9dc0e7ed3
I20260806 01:06:12.486021 27460 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:06:12.486238 27454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:12.470267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42896 (local address 127.11.88.126:44403)
0806 01:06:12.470578 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0806 01:06:12.470590 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 01:06:12.470637 (+ 47us) server_negotiation.cc:407] Connection header received
0806 01:06:12.471099 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:06:12.471106 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:06:12.471157 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:06:12.471340 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:06:12.472197 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:12.474227 (+ 2030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:12.475455 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:12.476155 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:12.476273 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:12.481450 (+ 5177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:06:12.481455 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:06:12.481455 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:06:12.481470 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:06:12.484355 (+ 2885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:06:12.484775 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:06:12.484779 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:06:12.484779 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:06:12.484892 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:06:12.485137 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:06:12.485138 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:06:12.485138 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:06:12.485515 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:06:12.485696 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0806 01:06:12.485807 (+ 111us) server_negotiation.cc:299] Negotiation successful
0806 01:06:12.485980 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":105,"threads_started":1}
I20260806 01:06:12.500097 27460 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:06:12.500831 27460 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:06:12.511885 27460 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd: Generated new TSK 0
I20260806 01:06:12.512133 27460 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.88.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
I20260806 01:06:12.554477 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:0
--local_ip_for_outbound_sockets=127.11.88.65
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:44403
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:39067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:06:12.651662 27478 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:06:12.651909 27478 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:06:12.651938 27478 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:06:12.653275 27478 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:06:12.653331 27478 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:06:12.653363 27478 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:06:12.655103 27478 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:39067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:44403
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27478
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:06:12.655442 27478 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:06:12.655885 27478 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:06:12.661778 27483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:06:12.661780 27486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:06:12.661954 27484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:06:12.662781 27478 server_base.cc:1034] running on GCE node
I20260806 01:06:12.663060 27478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:06:12.663345 27478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:06:12.664537 27478 hybrid_clock.cc:648] HybridClock initialized: now 1785978372664518 us; error 38 us; skew 500 ppm
Aug 06 01:06:12 dist-test-slave-69rg krb5kdc[27370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978372, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:06:12.667418 27478 init.cc:377] Logged in from keytab as kudu/127.11.88.65@KRBTEST.COM (short username kudu)
I20260806 01:06:12.667923 27478 webserver.cc:460] Webserver started at http://127.11.88.65:42269/ using document root <none> and password file <none>
I20260806 01:06:12.668165 27478 fs_manager.cc:359] Metadata directory not provided
I20260806 01:06:12.668232 27478 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:06:12.668382 27478 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:06:12.669504 27478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/data/instance:
uuid: "58a33330643446c5b5c29d0c3cab109e"
format_stamp: "Formatted at 2026-08-06 01:06:12 on dist-test-slave-69rg"
server_key: "5e9466f745e4e850cb57e3f065dd8a74"
server_key_iv: "e822da461050a9c55984d2d3ad8bbdff"
server_key_version: "encryptionkey@0"
I20260806 01:06:12.669965 27478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance:
uuid: "58a33330643446c5b5c29d0c3cab109e"
format_stamp: "Formatted at 2026-08-06 01:06:12 on dist-test-slave-69rg"
server_key: "5e9466f745e4e850cb57e3f065dd8a74"
server_key_iv: "e822da461050a9c55984d2d3ad8bbdff"
server_key_version: "encryptionkey@0"
I20260806 01:06:12.671531 27478 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:06:12.672525 27493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:12.672791 27478 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:06:12.673014 27478 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "58a33330643446c5b5c29d0c3cab109e"
format_stamp: "Formatted at 2026-08-06 01:06:12 on dist-test-slave-69rg"
server_key: "5e9466f745e4e850cb57e3f065dd8a74"
server_key_iv: "e822da461050a9c55984d2d3ad8bbdff"
server_key_version: "encryptionkey@0"
I20260806 01:06:12.673111 27478 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:06:12.704144 27478 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:06:12.706786 27478 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:06:12.706979 27478 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:06:12.707278 27478 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:06:12.707715 27478 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:06:12.707801 27478 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:12.707849 27478 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:06:12.707878 27478 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:12.714579 27478 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:41569
I20260806 01:06:12.714627 27608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:41569 every 8 connection(s)
I20260806 01:06:12.714982 27478 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
I20260806 01:06:12.722477 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 27478
Aug 06 01:06:12 dist-test-slave-69rg krb5kdc[27370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978372, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:06:12.722790 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance
I20260806 01:06:12.723042 11617 external_mini_cluster.cc:1428] Setting key 74be4cdd6fcec27ae17dc9da4ff7a05e
I20260806 01:06:12.727240 27454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:12.715884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:56847 (local address 127.11.88.126:44403)
0806 01:06:12.715948 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0806 01:06:12.715951 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:06:12.716167 (+ 216us) server_negotiation.cc:407] Connection header received
0806 01:06:12.716732 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:06:12.716733 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:06:12.716745 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:06:12.716801 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:06:12.717966 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:12.718656 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:12.719907 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:12.720237 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:12.720560 (+ 323us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:12.723272 (+ 2712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:06:12.723274 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:06:12.723274 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:06:12.723284 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:06:12.725297 (+ 2013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:06:12.725769 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:06:12.725771 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:06:12.725771 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:06:12.725866 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:06:12.726139 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:06:12.726140 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:06:12.726140 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:06:12.726278 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:06:12.726350 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 01:06:12.727010 (+ 660us) server_negotiation.cc:299] Negotiation successful
0806 01:06:12.727128 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 01:06:12.727524 27612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:12.715779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.65:56847)
0806 01:06:12.715959 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:12.716004 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 01:06:12.716594 (+ 590us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:06:12.716864 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:06:12.716867 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:06:12.717483 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:06:12.717702 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:12.717708 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:12.718849 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:12.718850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:12.719765 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:12.719769 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:12.720600 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:12.720601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:12.720768 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:12.721483 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:06:12.721493 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:06:12.723154 (+ 1661us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:06:12.725400 (+ 2246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:06:12.725412 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:06:12.725415 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:06:12.725680 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:06:12.725937 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:06:12.725939 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:06:12.725939 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:06:12.726065 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:06:12.726352 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:06:12.726362 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:06:12.726736 (+ 374us) client_negotiation.cc:769] Sending connection context
0806 01:06:12.726986 (+ 250us) client_negotiation.cc:240] Negotiation successful
0806 01:06:12.727261 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":94,"threads_started":1}
I20260806 01:06:12.728228 27609 heartbeater.cc:347] Connected to a master server at 127.11.88.126:44403
I20260806 01:06:12.728364 27609 heartbeater.cc:464] Registering TS with master...
I20260806 01:06:12.728677 27609 heartbeater.cc:511] Master 127.11.88.126:44403 requested a full tablet report, sending...
I20260806 01:06:12.729470 27415 ts_manager.cc:194] Registered new tserver with Master: 58a33330643446c5b5c29d0c3cab109e (127.11.88.65:41569)
I20260806 01:06:12.730536 27415 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.65@KRBTEST.COM'} at 127.11.88.65:56847
WARNING: no policy specified for kudu/127.11.88.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
I20260806 01:06:12.764329 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:0
--local_ip_for_outbound_sockets=127.11.88.66
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:44403
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:39067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:06:12.854776 27615 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:06:12.855024 27615 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:06:12.855051 27615 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:06:12.856508 27615 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:06:12.856568 27615 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:06:12.856599 27615 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:06:12.858640 27615 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:39067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:44403
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27615
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:06:12.858937 27615 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:06:12.859200 27615 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:06:12.865476 27621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:06:12.865473 27623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:06:12.865708 27615 server_base.cc:1034] running on GCE node
W20260806 01:06:12.865500 27620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:06:12.866139 27615 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:06:12.866436 27615 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:06:12.867751 27615 hybrid_clock.cc:648] HybridClock initialized: now 1785978372867738 us; error 30 us; skew 500 ppm
Aug 06 01:06:12 dist-test-slave-69rg krb5kdc[27370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978372, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:06:12.870734 27615 init.cc:377] Logged in from keytab as kudu/127.11.88.66@KRBTEST.COM (short username kudu)
I20260806 01:06:12.871193 27615 webserver.cc:460] Webserver started at http://127.11.88.66:42187/ using document root <none> and password file <none>
I20260806 01:06:12.871480 27615 fs_manager.cc:359] Metadata directory not provided
I20260806 01:06:12.871554 27615 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:06:12.871712 27615 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:06:12.873049 27615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/data/instance:
uuid: "16238c4dfd83438ba8e70ae4ff7dd58f"
format_stamp: "Formatted at 2026-08-06 01:06:12 on dist-test-slave-69rg"
server_key: "b5476da6aa0708649b731162ca693e12"
server_key_iv: "4b58abef480d0bc7a8102423fe2e5225"
server_key_version: "encryptionkey@0"
I20260806 01:06:12.873628 27615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance:
uuid: "16238c4dfd83438ba8e70ae4ff7dd58f"
format_stamp: "Formatted at 2026-08-06 01:06:12 on dist-test-slave-69rg"
server_key: "b5476da6aa0708649b731162ca693e12"
server_key_iv: "4b58abef480d0bc7a8102423fe2e5225"
server_key_version: "encryptionkey@0"
I20260806 01:06:12.875553 27615 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260806 01:06:12.876801 27630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:12.877022 27615 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:06:12.877137 27615 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "16238c4dfd83438ba8e70ae4ff7dd58f"
format_stamp: "Formatted at 2026-08-06 01:06:12 on dist-test-slave-69rg"
server_key: "b5476da6aa0708649b731162ca693e12"
server_key_iv: "4b58abef480d0bc7a8102423fe2e5225"
server_key_version: "encryptionkey@0"
I20260806 01:06:12.877242 27615 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:06:12.886849 27615 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:06:12.889650 27615 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:06:12.889900 27615 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:06:12.890182 27615 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:06:12.890522 27615 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:06:12.890576 27615 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:12.890710 27615 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:06:12.890763 27615 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:12.897403 27615 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:40157
I20260806 01:06:12.897455 27744 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:40157 every 8 connection(s)
I20260806 01:06:12.897856 27615 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
I20260806 01:06:12.901181 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 27615
I20260806 01:06:12.901399 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance
I20260806 01:06:12.901646 11617 external_mini_cluster.cc:1428] Setting key 9f6d478c802d224eb1593b48e0431438
Aug 06 01:06:12 dist-test-slave-69rg krb5kdc[27370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978372, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.88.67@KRBTEST.COM; defaulting to no policy
I20260806 01:06:12.913887 27454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:12.899097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:37467 (local address 127.11.88.126:44403)
0806 01:06:12.899173 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0806 01:06:12.899175 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:06:12.899192 (+ 17us) server_negotiation.cc:407] Connection header received
0806 01:06:12.899693 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:06:12.899695 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:06:12.899706 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:06:12.899779 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:06:12.901278 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:12.902111 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:12.904812 (+ 2701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:12.905027 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:12.905188 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:12.908513 (+ 3325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:06:12.908515 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:06:12.908516 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:06:12.908528 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:06:12.910863 (+ 2335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:06:12.911819 (+ 956us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:06:12.911821 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:06:12.911822 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:06:12.911900 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:06:12.912672 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:06:12.912674 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:06:12.912674 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:06:12.912826 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:06:12.912912 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 01:06:12.913630 (+ 718us) server_negotiation.cc:299] Negotiation successful
0806 01:06:12.913751 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 01:06:12.914094 27747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:12.898584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.66:37467)
0806 01:06:12.899018 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:12.899071 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 01:06:12.899551 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:06:12.899891 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:06:12.899895 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:06:12.900870 (+ 975us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:06:12.901111 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:12.901117 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:12.902236 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:12.902237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:12.904610 (+ 2373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:12.904614 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:12.905195 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:12.905196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:12.905339 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:12.906180 (+ 841us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:06:12.906190 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:06:12.907955 (+ 1765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:06:12.911016 (+ 3061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:06:12.911029 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:06:12.911031 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:06:12.911706 (+ 675us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:06:12.912006 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:06:12.912007 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:06:12.912007 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:06:12.912378 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:06:12.913146 (+ 768us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:06:12.913154 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:06:12.913377 (+ 223us) client_negotiation.cc:769] Sending connection context
0806 01:06:12.913595 (+ 218us) client_negotiation.cc:240] Negotiation successful
0806 01:06:12.913806 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":90,"threads_started":1}
I20260806 01:06:12.914825 27745 heartbeater.cc:347] Connected to a master server at 127.11.88.126:44403
I20260806 01:06:12.914973 27745 heartbeater.cc:464] Registering TS with master...
I20260806 01:06:12.915354 27745 heartbeater.cc:511] Master 127.11.88.126:44403 requested a full tablet report, sending...
I20260806 01:06:12.915940 27415 ts_manager.cc:194] Registered new tserver with Master: 16238c4dfd83438ba8e70ae4ff7dd58f (127.11.88.66:40157)
I20260806 01:06:12.916501 27415 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.66@KRBTEST.COM'} at 127.11.88.66:37467
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
I20260806 01:06:12.939002 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:0
--local_ip_for_outbound_sockets=127.11.88.67
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:44403
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:39067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:06:13.031404 27750 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:06:13.031631 27750 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:06:13.031659 27750 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:06:13.032886 27750 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:06:13.032940 27750 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:06:13.032969 27750 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:06:13.034538 27750 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:39067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:44403
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27750
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:06:13.034824 27750 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:06:13.035106 27750 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:06:13.040858 27755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:06:13.040995 27750 server_base.cc:1034] running on GCE node
W20260806 01:06:13.041189 27756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:06:13.040874 27758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:06:13.041503 27750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:06:13.041863 27750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:06:13.043064 27750 hybrid_clock.cc:648] HybridClock initialized: now 1785978373043046 us; error 37 us; skew 500 ppm
Aug 06 01:06:13 dist-test-slave-69rg krb5kdc[27370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978373, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:06:13.046136 27750 init.cc:377] Logged in from keytab as kudu/127.11.88.67@KRBTEST.COM (short username kudu)
I20260806 01:06:13.046685 27750 webserver.cc:460] Webserver started at http://127.11.88.67:38985/ using document root <none> and password file <none>
I20260806 01:06:13.046937 27750 fs_manager.cc:359] Metadata directory not provided
I20260806 01:06:13.046985 27750 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:06:13.047188 27750 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:06:13.048341 27750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/data/instance:
uuid: "f3ea836aee754d70909b1f7419609a35"
format_stamp: "Formatted at 2026-08-06 01:06:13 on dist-test-slave-69rg"
server_key: "f9a8463bc153e42ec96fee2c2ea281ba"
server_key_iv: "be31faa2d5255941ea757f35436bba00"
server_key_version: "encryptionkey@0"
I20260806 01:06:13.048722 27750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance:
uuid: "f3ea836aee754d70909b1f7419609a35"
format_stamp: "Formatted at 2026-08-06 01:06:13 on dist-test-slave-69rg"
server_key: "f9a8463bc153e42ec96fee2c2ea281ba"
server_key_iv: "be31faa2d5255941ea757f35436bba00"
server_key_version: "encryptionkey@0"
I20260806 01:06:13.050222 27750 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 01:06:13.051141 27765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:13.051533 27750 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:06:13.051641 27750 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "f3ea836aee754d70909b1f7419609a35"
format_stamp: "Formatted at 2026-08-06 01:06:13 on dist-test-slave-69rg"
server_key: "f9a8463bc153e42ec96fee2c2ea281ba"
server_key_iv: "be31faa2d5255941ea757f35436bba00"
server_key_version: "encryptionkey@0"
I20260806 01:06:13.051750 27750 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:06:13.062543 27750 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:06:13.064976 27750 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:06:13.065194 27750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:06:13.065456 27750 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:06:13.065798 27750 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:06:13.065922 27750 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:13.065948 27750 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:06:13.066051 27750 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:13.074100 27750 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:34375
I20260806 01:06:13.074138 27879 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:34375 every 8 connection(s)
I20260806 01:06:13.074671 27750 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
I20260806 01:06:13.075474 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 27750
I20260806 01:06:13.075659 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance
I20260806 01:06:13.075975 11617 external_mini_cluster.cc:1428] Setting key d3826c11eb79ce04e345c4060488ab90
Aug 06 01:06:13 dist-test-slave-69rg krb5kdc[27370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978373, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:06:13.086773 27454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:13.076200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:54643 (local address 127.11.88.126:44403)
0806 01:06:13.076272 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0806 01:06:13.076275 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:06:13.076324 (+ 49us) server_negotiation.cc:407] Connection header received
0806 01:06:13.077024 (+ 700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:06:13.077024 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:06:13.077035 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:06:13.077075 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:06:13.078288 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.078824 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.079991 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.080186 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.080264 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:13.083076 (+ 2812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:06:13.083078 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:06:13.083078 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:06:13.083086 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:06:13.084666 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:06:13.085146 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:06:13.085147 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:06:13.085147 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:06:13.085216 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:06:13.085578 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:06:13.085579 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:06:13.085579 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:06:13.086044 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:06:13.086113 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 01:06:13.086610 (+ 497us) server_negotiation.cc:299] Negotiation successful
0806 01:06:13.086697 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 01:06:13.087209 27882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:13.075869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.67:54643)
0806 01:06:13.076075 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:13.076226 (+ 151us) client_negotiation.cc:174] Beginning negotiation
0806 01:06:13.076793 (+ 567us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:06:13.077145 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:06:13.077149 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:06:13.077890 (+ 741us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:06:13.078158 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:13.078163 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.078934 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.078935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:13.079882 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:13.079885 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.080368 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.080370 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:13.080516 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:13.081141 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:06:13.081189 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:06:13.082946 (+ 1757us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:06:13.084775 (+ 1829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:06:13.084783 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:06:13.084785 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:06:13.085043 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:06:13.085323 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:06:13.085324 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:06:13.085324 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:06:13.085445 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:06:13.086209 (+ 764us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:06:13.086217 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:06:13.086361 (+ 144us) client_negotiation.cc:769] Sending connection context
0806 01:06:13.086560 (+ 199us) client_negotiation.cc:240] Negotiation successful
0806 01:06:13.086737 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":89,"threads_started":1}
I20260806 01:06:13.087996 27880 heartbeater.cc:347] Connected to a master server at 127.11.88.126:44403
I20260806 01:06:13.088137 27880 heartbeater.cc:464] Registering TS with master...
I20260806 01:06:13.088384 27880 heartbeater.cc:511] Master 127.11.88.126:44403 requested a full tablet report, sending...
I20260806 01:06:13.088951 27415 ts_manager.cc:194] Registered new tserver with Master: f3ea836aee754d70909b1f7419609a35 (127.11.88.67:34375)
I20260806 01:06:13.089367 27415 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.67@KRBTEST.COM'} at 127.11.88.67:54643
I20260806 01:06:13.099515 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 01:06:13.108386 27454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:13.100991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42904 (local address 127.11.88.126:44403)
0806 01:06:13.101054 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0806 01:06:13.101055 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 01:06:13.101133 (+ 78us) server_negotiation.cc:407] Connection header received
0806 01:06:13.101204 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:06:13.101205 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:06:13.101220 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:06:13.101289 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:06:13.101993 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.102500 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.103451 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.103645 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.103707 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:13.105001 (+ 1294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:06:13.105002 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:06:13.105002 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:06:13.105009 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:06:13.106670 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:06:13.107225 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:06:13.107226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:06:13.107227 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:06:13.107295 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:06:13.107606 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:06:13.107608 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:06:13.107608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:06:13.107798 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:06:13.107900 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 01:06:13.108232 (+ 332us) server_negotiation.cc:299] Negotiation successful
0806 01:06:13.108312 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260806 01:06:13.110776 27415 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42904:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 01:06:13.112453 27415 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:06:13.120008 27892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:13.115387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:40157 (local address 127.0.0.1:52228)
0806 01:06:13.115603 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:13.115648 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 01:06:13.115728 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:06:13.116094 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:06:13.116097 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:06:13.116100 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:06:13.116189 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:13.116191 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.117614 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.117615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:13.118829 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:13.118831 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.119754 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.119755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:13.119811 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:13.119814 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:06:13.119868 (+ 54us) client_negotiation.cc:240] Negotiation successful
0806 01:06:13.119902 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":34,"thread_start_us":97,"threads_started":1}
I20260806 01:06:13.120013 27893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:13.115508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52228 (local address 127.11.88.66:40157)
0806 01:06:13.115872 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0806 01:06:13.115883 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 01:06:13.115925 (+ 42us) server_negotiation.cc:407] Connection header received
0806 01:06:13.115969 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:06:13.115971 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:06:13.115988 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:06:13.116285 (+ 297us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:06:13.116358 (+ 73us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.117502 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.118935 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.119661 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.119751 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:13.119798 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0806 01:06:13.119881 (+ 83us) server_negotiation.cc:299] Negotiation successful
0806 01:06:13.119926 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":97,"threads_started":1}
I20260806 01:06:13.120097 27896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:13.115972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47562 (local address 127.11.88.67:34375)
0806 01:06:13.116362 (+ 390us) server_negotiation.cc:206] Beginning negotiation
0806 01:06:13.116366 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 01:06:13.116376 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:06:13.116418 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:06:13.116420 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:06:13.116437 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:06:13.116513 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:06:13.116701 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.117748 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.118926 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.119447 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.119538 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:13.119615 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 01:06:13.119966 (+ 351us) server_negotiation.cc:299] Negotiation successful
0806 01:06:13.120015 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":96,"threads_started":1}
I20260806 01:06:13.120183 27894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:13.115525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46958 (local address 127.11.88.65:41569)
0806 01:06:13.116036 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0806 01:06:13.116042 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 01:06:13.116055 (+ 13us) server_negotiation.cc:407] Connection header received
0806 01:06:13.116099 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:06:13.116101 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:06:13.116117 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:06:13.116210 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:06:13.116515 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.117289 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.118937 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.119677 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.119741 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:13.119798 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 01:06:13.120054 (+ 256us) server_negotiation.cc:299] Negotiation successful
0806 01:06:13.120106 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":214,"threads_started":1}
I20260806 01:06:13.120474 27891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:13.115388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:41569 (local address 127.0.0.1:46958)
0806 01:06:13.115682 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:13.115691 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 01:06:13.115746 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:06:13.116297 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:06:13.116297 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:06:13.116299 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:06:13.116360 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:13.116361 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.117390 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.117391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:13.118828 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:13.118831 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.119836 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.119837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:13.119902 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:13.119906 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:06:13.119956 (+ 50us) client_negotiation.cc:240] Negotiation successful
0806 01:06:13.119999 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"mutex_wait_us":5,"thread_start_us":82,"threads_started":1}
I20260806 01:06:13.119915 27895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:13.115832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:34375 (local address 127.0.0.1:47562)
0806 01:06:13.116188 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:13.116198 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 01:06:13.116246 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:06:13.116544 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:06:13.116545 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:06:13.116548 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:06:13.116610 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:13.116612 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.117962 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.117963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:13.118826 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:13.118828 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.119537 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.119538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:13.119631 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:13.119648 (+ 17us) client_negotiation.cc:769] Sending connection context
0806 01:06:13.119749 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 01:06:13.119808 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":82,"threads_started":1}
I20260806 01:06:13.121124 27678 tablet_service.cc:1467] Processing CreateTablet for tablet 318a185fdba142408e4c0503057b44ae (DEFAULT_TABLE table=test-table [id=31370f75bcab4462b72e3c23e9011760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:06:13.121302 27541 tablet_service.cc:1467] Processing CreateTablet for tablet 318a185fdba142408e4c0503057b44ae (DEFAULT_TABLE table=test-table [id=31370f75bcab4462b72e3c23e9011760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:06:13.121546 27678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 318a185fdba142408e4c0503057b44ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:06:13.121613 27541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 318a185fdba142408e4c0503057b44ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:06:13.122098 27813 tablet_service.cc:1467] Processing CreateTablet for tablet 318a185fdba142408e4c0503057b44ae (DEFAULT_TABLE table=test-table [id=31370f75bcab4462b72e3c23e9011760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:06:13.122538 27813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 318a185fdba142408e4c0503057b44ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:06:13.125881 27898 tablet_bootstrap.cc:492] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f: Bootstrap starting.
I20260806 01:06:13.126138 27897 tablet_bootstrap.cc:492] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e: Bootstrap starting.
I20260806 01:06:13.126163 27899 tablet_bootstrap.cc:492] T 318a185fdba142408e4c0503057b44ae P f3ea836aee754d70909b1f7419609a35: Bootstrap starting.
I20260806 01:06:13.126777 27897 tablet_bootstrap.cc:654] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e: Neither blocks nor log segments found. Creating new log.
I20260806 01:06:13.126904 27899 tablet_bootstrap.cc:654] T 318a185fdba142408e4c0503057b44ae P f3ea836aee754d70909b1f7419609a35: Neither blocks nor log segments found. Creating new log.
I20260806 01:06:13.127559 27899 log.cc:824] T 318a185fdba142408e4c0503057b44ae P f3ea836aee754d70909b1f7419609a35: Log is configured to *not* fsync() on all Append() calls
I20260806 01:06:13.127839 27897 log.cc:824] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e: Log is configured to *not* fsync() on all Append() calls
I20260806 01:06:13.128583 27899 tablet_bootstrap.cc:492] T 318a185fdba142408e4c0503057b44ae P f3ea836aee754d70909b1f7419609a35: No bootstrap required, opened a new log
I20260806 01:06:13.128674 27899 ts_tablet_manager.cc:1397] T 318a185fdba142408e4c0503057b44ae P f3ea836aee754d70909b1f7419609a35: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 01:06:13.128737 27897 tablet_bootstrap.cc:492] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e: No bootstrap required, opened a new log
I20260806 01:06:13.128753 27898 tablet_bootstrap.cc:654] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f: Neither blocks nor log segments found. Creating new log.
I20260806 01:06:13.128820 27897 ts_tablet_manager.cc:1397] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 01:06:13.129360 27898 log.cc:824] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f: Log is configured to *not* fsync() on all Append() calls
I20260806 01:06:13.130239 27898 tablet_bootstrap.cc:492] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f: No bootstrap required, opened a new log
I20260806 01:06:13.130316 27898 ts_tablet_manager.cc:1397] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260806 01:06:13.130626 27899 raft_consensus.cc:348] T 318a185fdba142408e4c0503057b44ae P f3ea836aee754d70909b1f7419609a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } } peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } }
I20260806 01:06:13.130995 27899 raft_consensus.cc:374] T 318a185fdba142408e4c0503057b44ae P f3ea836aee754d70909b1f7419609a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:06:13.131067 27899 raft_consensus.cc:729] T 318a185fdba142408e4c0503057b44ae P f3ea836aee754d70909b1f7419609a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ea836aee754d70909b1f7419609a35, State: Initialized, Role: FOLLOWER
I20260806 01:06:13.131134 27897 raft_consensus.cc:348] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } } peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } }
I20260806 01:06:13.131333 27897 raft_consensus.cc:374] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:06:13.131371 27897 raft_consensus.cc:729] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58a33330643446c5b5c29d0c3cab109e, State: Initialized, Role: FOLLOWER
I20260806 01:06:13.131330 27899 consensus_queue.cc:260] T 318a185fdba142408e4c0503057b44ae P f3ea836aee754d70909b1f7419609a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } } peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } }
I20260806 01:06:13.131481 27897 consensus_queue.cc:260] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } } peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } }
I20260806 01:06:13.131675 27880 heartbeater.cc:503] Master 127.11.88.126:44403 was elected leader, sending a full tablet report...
I20260806 01:06:13.131682 27899 ts_tablet_manager.cc:1428] T 318a185fdba142408e4c0503057b44ae P f3ea836aee754d70909b1f7419609a35: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 01:06:13.131769 27897 ts_tablet_manager.cc:1428] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 01:06:13.131997 27609 heartbeater.cc:503] Master 127.11.88.126:44403 was elected leader, sending a full tablet report...
I20260806 01:06:13.132558 27898 raft_consensus.cc:348] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } } peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } }
I20260806 01:06:13.132688 27898 raft_consensus.cc:374] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:06:13.132709 27898 raft_consensus.cc:729] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16238c4dfd83438ba8e70ae4ff7dd58f, State: Initialized, Role: FOLLOWER
I20260806 01:06:13.132835 27898 consensus_queue.cc:260] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } } peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } }
I20260806 01:06:13.133145 27898 ts_tablet_manager.cc:1428] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260806 01:06:13.133174 27745 heartbeater.cc:503] Master 127.11.88.126:44403 was elected leader, sending a full tablet report...
W20260806 01:06:13.148608 27746 tablet.cc:2369] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 01:06:13.215889 27611 tablet.cc:2369] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 01:06:13.325750 27881 tablet.cc:2369] T 318a185fdba142408e4c0503057b44ae P f3ea836aee754d70909b1f7419609a35: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 01:06:13.358018 27905 raft_consensus.cc:482] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:06:13.358250 27905 raft_consensus.cc:504] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } } peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } }
I20260806 01:06:13.358848 27905 leader_election.cc:288] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58a33330643446c5b5c29d0c3cab109e (127.11.88.65:41569), f3ea836aee754d70909b1f7419609a35 (127.11.88.67:34375)
I20260806 01:06:13.362085 27894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:13.359291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:55183 (local address 127.11.88.65:41569)
0806 01:06:13.359342 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 01:06:13.359344 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:06:13.359392 (+ 48us) server_negotiation.cc:407] Connection header received
0806 01:06:13.359486 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:06:13.359487 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:06:13.359498 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:06:13.359628 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:06:13.359800 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.360275 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.361315 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.361692 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.361777 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:13.361788 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0806 01:06:13.361960 (+ 172us) server_negotiation.cc:299] Negotiation successful
0806 01:06:13.362005 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 01:06:13.362111 27747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:13.359086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:34375 (local address 127.11.88.66:60629)
0806 01:06:13.359180 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:13.359190 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 01:06:13.359264 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:06:13.359620 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:06:13.359621 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:06:13.359623 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:06:13.359704 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:13.359707 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.360392 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.360393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:13.361212 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:13.361213 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.361788 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.361789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:13.361903 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:13.361906 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:06:13.361970 (+ 64us) client_negotiation.cc:240] Negotiation successful
0806 01:06:13.362014 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65,"mutex_wait_us":23}
I20260806 01:06:13.362152 27896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:13.359185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:60629 (local address 127.11.88.67:34375)
0806 01:06:13.359270 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0806 01:06:13.359273 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:06:13.359308 (+ 35us) server_negotiation.cc:407] Connection header received
0806 01:06:13.359349 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:06:13.359351 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:06:13.359360 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:06:13.359573 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:06:13.359786 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.360286 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.361311 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.361702 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.361789 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:13.361798 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 01:06:13.361976 (+ 178us) server_negotiation.cc:299] Negotiation successful
0806 01:06:13.362020 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 01:06:13.362120 27906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:13.359100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:41569 (local address 127.11.88.66:55183)
0806 01:06:13.359325 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:13.359337 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:06:13.359408 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:06:13.359642 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:06:13.359643 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:06:13.359645 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:06:13.359726 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:13.359728 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.360358 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.360360 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:13.361218 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:13.361220 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.361777 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.361778 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:13.361885 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:13.361888 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:06:13.361954 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 01:06:13.362005 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"mutex_wait_us":46,"thread_start_us":146,"threads_started":1}
I20260806 01:06:13.362568 27834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "318a185fdba142408e4c0503057b44ae" candidate_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ea836aee754d70909b1f7419609a35" is_pre_election: true
I20260806 01:06:13.362774 27834 raft_consensus.cc:2454] T 318a185fdba142408e4c0503057b44ae P f3ea836aee754d70909b1f7419609a35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16238c4dfd83438ba8e70ae4ff7dd58f in term 0.
I20260806 01:06:13.362784 27562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "318a185fdba142408e4c0503057b44ae" candidate_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a33330643446c5b5c29d0c3cab109e" is_pre_election: true
I20260806 01:06:13.362914 27562 raft_consensus.cc:2454] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16238c4dfd83438ba8e70ae4ff7dd58f in term 0.
I20260806 01:06:13.363059 27631 leader_election.cc:302] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16238c4dfd83438ba8e70ae4ff7dd58f, f3ea836aee754d70909b1f7419609a35; no voters:
I20260806 01:06:13.363235 27905 raft_consensus.cc:2781] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:06:13.363281 27905 raft_consensus.cc:482] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:06:13.363296 27905 raft_consensus.cc:3037] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:06:13.363991 27905 raft_consensus.cc:504] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } } peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } }
I20260806 01:06:13.364203 27905 leader_election.cc:288] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f [CANDIDATE]: Term 1 election: Requested vote from peers 58a33330643446c5b5c29d0c3cab109e (127.11.88.65:41569), f3ea836aee754d70909b1f7419609a35 (127.11.88.67:34375)
I20260806 01:06:13.364296 27834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "318a185fdba142408e4c0503057b44ae" candidate_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ea836aee754d70909b1f7419609a35"
I20260806 01:06:13.364395 27834 raft_consensus.cc:3037] T 318a185fdba142408e4c0503057b44ae P f3ea836aee754d70909b1f7419609a35 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:06:13.364405 27562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "318a185fdba142408e4c0503057b44ae" candidate_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a33330643446c5b5c29d0c3cab109e"
I20260806 01:06:13.364490 27562 raft_consensus.cc:3037] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:06:13.365183 27562 raft_consensus.cc:2454] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16238c4dfd83438ba8e70ae4ff7dd58f in term 1.
I20260806 01:06:13.365176 27834 raft_consensus.cc:2454] T 318a185fdba142408e4c0503057b44ae P f3ea836aee754d70909b1f7419609a35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16238c4dfd83438ba8e70ae4ff7dd58f in term 1.
I20260806 01:06:13.365378 27633 leader_election.cc:302] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 16238c4dfd83438ba8e70ae4ff7dd58f, 58a33330643446c5b5c29d0c3cab109e, f3ea836aee754d70909b1f7419609a35; no voters:
I20260806 01:06:13.365473 27905 raft_consensus.cc:2781] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:06:13.365661 27905 raft_consensus.cc:686] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f [term 1 LEADER]: Becoming Leader. State: Replica: 16238c4dfd83438ba8e70ae4ff7dd58f, State: Running, Role: LEADER
I20260806 01:06:13.365772 27905 consensus_queue.cc:237] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } } peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } }
I20260806 01:06:13.366847 27413 catalog_manager.cc:5495] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f reported cstate change: term changed from 0 to 1, leader changed from <none> to 16238c4dfd83438ba8e70ae4ff7dd58f (127.11.88.66). New cstate: current_term: 1 leader_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } health_report { overall_health: UNKNOWN } } }
I20260806 01:06:13.406850 27893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:13.404365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52238 (local address 127.11.88.66:40157)
0806 01:06:13.404442 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0806 01:06:13.404444 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:06:13.404454 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:06:13.404499 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:06:13.404500 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:06:13.404519 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:06:13.404592 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:06:13.404747 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.405229 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.406041 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:13.406247 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:13.406323 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:13.406491 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:06:13.406602 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:06:13.406697 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 01:06:13.406716 (+ 19us) server_negotiation.cc:299] Negotiation successful
0806 01:06:13.406738 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 01:06:13.409080 27834 raft_consensus.cc:1261] T 318a185fdba142408e4c0503057b44ae P f3ea836aee754d70909b1f7419609a35 [term 1 FOLLOWER]: Refusing update from remote peer 16238c4dfd83438ba8e70ae4ff7dd58f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:06:13.409080 27562 raft_consensus.cc:1261] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e [term 1 FOLLOWER]: Refusing update from remote peer 16238c4dfd83438ba8e70ae4ff7dd58f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:06:13.409644 27907 consensus_queue.cc:1035] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:06:13.409859 27905 consensus_queue.cc:1035] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:06:13.412860 27910 mvcc.cc:205] Tried to move back new op lower bound from 7315367417479680000 to 7315367417306959872. Current Snapshot: MvccSnapshot[applied={T|T < 7315367417479680000}]
I20260806 01:06:13.413142 27911 mvcc.cc:205] Tried to move back new op lower bound from 7315367417479680000 to 7315367417306959872. Current Snapshot: MvccSnapshot[applied={T|T < 7315367417479680000}]
I20260806 01:06:13.414137 27912 mvcc.cc:205] Tried to move back new op lower bound from 7315367417479680000 to 7315367417306959872. Current Snapshot: MvccSnapshot[applied={T|T < 7315367417479680000}]
I20260806 01:06:13.415832 27413 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42904:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:06:13.415944 27413 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42904:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:06:13.416828 27413 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd: Sending DeleteTablet for 3 replicas of tablet 318a185fdba142408e4c0503057b44ae
I20260806 01:06:13.417238 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 27478
I20260806 01:06:13.417212 27541 tablet_service.cc:1514] Processing DeleteTablet for tablet 318a185fdba142408e4c0503057b44ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:06:13 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:46958
I20260806 01:06:13.417279 27813 tablet_service.cc:1514] Processing DeleteTablet for tablet 318a185fdba142408e4c0503057b44ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:06:13 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:47562
I20260806 01:06:13.417899 27920 tablet_replica.cc:330] T 318a185fdba142408e4c0503057b44ae P f3ea836aee754d70909b1f7419609a35: stopping tablet replica
I20260806 01:06:13.417886 27678 tablet_service.cc:1514] Processing DeleteTablet for tablet 318a185fdba142408e4c0503057b44ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:06:13 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:52228
I20260806 01:06:13.418124 27920 raft_consensus.cc:2229] T 318a185fdba142408e4c0503057b44ae P f3ea836aee754d70909b1f7419609a35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:06:13.418300 27920 raft_consensus.cc:2258] T 318a185fdba142408e4c0503057b44ae P f3ea836aee754d70909b1f7419609a35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:06:13.418910 27920 ts_tablet_manager.cc:1905] T 318a185fdba142408e4c0503057b44ae P f3ea836aee754d70909b1f7419609a35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:06:13.421882 27920 ts_tablet_manager.cc:1918] T 318a185fdba142408e4c0503057b44ae P f3ea836aee754d70909b1f7419609a35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:06:13.422012 27920 log.cc:1196] T 318a185fdba142408e4c0503057b44ae P f3ea836aee754d70909b1f7419609a35: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/wal/wals/318a185fdba142408e4c0503057b44ae
I20260806 01:06:13.422169 27921 tablet_replica.cc:330] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f: stopping tablet replica
I20260806 01:06:13.422366 27921 raft_consensus.cc:2229] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f [term 1 LEADER]: Raft consensus shutting down.
I20260806 01:06:13.422601 27921 raft_consensus.cc:2258] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:06:13.423171 27921 ts_tablet_manager.cc:1905] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:06:13.423236 27920 ts_tablet_manager.cc:1939] T 318a185fdba142408e4c0503057b44ae P f3ea836aee754d70909b1f7419609a35: Deleting consensus metadata
I20260806 01:06:13.423866 27399 catalog_manager.cc:4841] TS f3ea836aee754d70909b1f7419609a35 (127.11.88.67:34375): tablet 318a185fdba142408e4c0503057b44ae (table test-table [id=31370f75bcab4462b72e3c23e9011760]) successfully deleted
I20260806 01:06:13.425431 27921 ts_tablet_manager.cc:1918] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:06:13.425527 27921 log.cc:1196] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/wal/wals/318a185fdba142408e4c0503057b44ae
I20260806 01:06:13.425889 27921 ts_tablet_manager.cc:1939] T 318a185fdba142408e4c0503057b44ae P 16238c4dfd83438ba8e70ae4ff7dd58f: Deleting consensus metadata
W20260806 01:06:13.425908 27401 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.88.65:41569 (error 108)
I20260806 01:06:13.426512 27892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:13.426371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:41569 (local address 127.0.0.1:46964)
0806 01:06:13.426431 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:13.426470 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.65:41569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260806 01:06:13.426615 27399 catalog_manager.cc:4841] TS 16238c4dfd83438ba8e70ae4ff7dd58f (127.11.88.66:40157): tablet 318a185fdba142408e4c0503057b44ae (table test-table [id=31370f75bcab4462b72e3c23e9011760]) successfully deleted
I20260806 01:06:13.426644 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 27615
W20260806 01:06:13.426717 27401 catalog_manager.cc:4584] TS 58a33330643446c5b5c29d0c3cab109e (127.11.88.65:41569): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 318a185fdba142408e4c0503057b44ae: Network error: Client connection negotiation failed: client connection to 127.11.88.65:41569: connect: Connection refused (error 111)
I20260806 01:06:13.433972 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 27750
I20260806 01:06:13.440258 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 27383
I20260806 01:06:33.447795 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:44403
--webserver_interface=127.11.88.126
--webserver_port=39303
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:39067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:44403
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:06:33.534687 27923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:06:33.534893 27923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:06:33.534917 27923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:06:33.536010 27923 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 01:06:33.536048 27923 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 01:06:33.536062 27923 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 01:06:33.536073 27923 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:06:33.536087 27923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:06:33.536099 27923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:06:33.536111 27923 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:06:33.536129 27923 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:06:33.537565 27923 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:39067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:44403
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:44403
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=39303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:06:33.537756 27923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:06:33.537949 27923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:06:33.547078 27932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:06:33.547102 27929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:06:33.547338 27923 server_base.cc:1034] running on GCE node
W20260806 01:06:33.547124 27930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:06:33.547788 27923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:06:33.548180 27923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:06:33.549386 27923 hybrid_clock.cc:648] HybridClock initialized: now 1785978393549378 us; error 39 us; skew 500 ppm
Aug 06 01:06:33 dist-test-slave-69rg krb5kdc[27370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978393, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:06:33.552218 27923 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:06:33.552762 27923 webserver.cc:460] Webserver started at http://127.11.88.126:39303/ using document root <none> and password file <none>
I20260806 01:06:33.553063 27923 fs_manager.cc:359] Metadata directory not provided
I20260806 01:06:33.553158 27923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:06:33.554814 27923 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:06:33.555749 27939 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:33.555970 27923 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:06:33.556083 27923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "005365bd08744d00a8bec09d40ae33bd"
format_stamp: "Formatted at 2026-08-06 01:06:12 on dist-test-slave-69rg"
server_key: "54c16e2361a3891571080bc1851f1368"
server_key_iv: "49a759d304a229fa166f7c2e12860baa"
server_key_version: "encryptionkey@0"
I20260806 01:06:33.556577 27923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:06:33.572930 27923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:06:33.575752 27923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:06:33.575948 27923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:06:33.580715 27923 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:44403
I20260806 01:06:33.580785 27992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:44403 every 8 connection(s)
I20260806 01:06:33.581276 27923 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:06:33.583004 27993 sys_catalog.cc:263] Verifying existing consensus state
I20260806 01:06:33.583642 27993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd: Bootstrap starting.
I20260806 01:06:33.584100 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 27923
I20260806 01:06:33.584429 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:41569
--local_ip_for_outbound_sockets=127.11.88.65
--tserver_master_addrs=127.11.88.126:44403
--webserver_port=42269
--webserver_interface=127.11.88.65
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:39067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 01:06:33.594069 27993 log.cc:824] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd: Log is configured to *not* fsync() on all Append() calls
I20260806 01:06:33.596091 27993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 01:06:33.596459 27993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd: Bootstrap complete.
I20260806 01:06:33.599136 27993 raft_consensus.cc:348] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005365bd08744d00a8bec09d40ae33bd" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44403 } }
I20260806 01:06:33.599385 27993 raft_consensus.cc:729] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005365bd08744d00a8bec09d40ae33bd, State: Initialized, Role: FOLLOWER
I20260806 01:06:33.599556 27993 consensus_queue.cc:260] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005365bd08744d00a8bec09d40ae33bd" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44403 } }
I20260806 01:06:33.599628 27993 raft_consensus.cc:388] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:06:33.599682 27993 raft_consensus.cc:482] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:06:33.599735 27993 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [term 1 FOLLOWER]: Advancing to term 2
I20260806 01:06:33.600865 27993 raft_consensus.cc:504] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005365bd08744d00a8bec09d40ae33bd" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44403 } }
I20260806 01:06:33.600957 27993 leader_election.cc:302] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 005365bd08744d00a8bec09d40ae33bd; no voters:
I20260806 01:06:33.601197 27993 leader_election.cc:288] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 01:06:33.601305 27997 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [term 2 FOLLOWER]: Leader election won for term 2
I20260806 01:06:33.601496 27997 raft_consensus.cc:686] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [term 2 LEADER]: Becoming Leader. State: Replica: 005365bd08744d00a8bec09d40ae33bd, State: Running, Role: LEADER
I20260806 01:06:33.601503 27993 sys_catalog.cc:564] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:06:33.601671 27997 consensus_queue.cc:237] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005365bd08744d00a8bec09d40ae33bd" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44403 } }
I20260806 01:06:33.602129 27999 sys_catalog.cc:455] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 005365bd08744d00a8bec09d40ae33bd. Latest consensus state: current_term: 2 leader_uuid: "005365bd08744d00a8bec09d40ae33bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005365bd08744d00a8bec09d40ae33bd" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44403 } } }
I20260806 01:06:33.602205 27999 sys_catalog.cc:458] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [sys.catalog]: This master's current role is: LEADER
I20260806 01:06:33.602533 28004 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:06:33.602525 27998 sys_catalog.cc:455] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "005365bd08744d00a8bec09d40ae33bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005365bd08744d00a8bec09d40ae33bd" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44403 } } }
I20260806 01:06:33.602911 27998 sys_catalog.cc:458] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [sys.catalog]: This master's current role is: LEADER
I20260806 01:06:33.603713 28004 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:06:33.603822 28004 catalog_manager.cc:1259] Loaded cluster ID: 11d8ae91cf714d4abe99ffd9dc0e7ed3
I20260806 01:06:33.603863 28004 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:06:33.604758 28004 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:06:33.604895 28004 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd: Loaded TSK: 0
I20260806 01:06:33.619225 28004 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd: Generated new TSK 1
I20260806 01:06:33.619372 28004 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 01:06:33.683182 27995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:06:33.683436 27995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:06:33.683481 27995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:06:33.684701 27995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:06:33.684774 27995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:06:33.684823 27995 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:06:33.686422 27995 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:39067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:41569
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=42269
--tserver_master_addrs=127.11.88.126:44403
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27995
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:06:33.686695 27995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:06:33.686937 27995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:06:33.693204 28023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:06:33.693219 28020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:06:33.693266 28021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:06:33.693559 27995 server_base.cc:1034] running on GCE node
I20260806 01:06:33.693760 27995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:06:33.694038 27995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:06:33.695215 27995 hybrid_clock.cc:648] HybridClock initialized: now 1785978393695201 us; error 31 us; skew 500 ppm
Aug 06 01:06:33 dist-test-slave-69rg krb5kdc[27370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978393, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:06:33.697751 27995 init.cc:377] Logged in from keytab as kudu/127.11.88.65@KRBTEST.COM (short username kudu)
I20260806 01:06:33.698333 27995 webserver.cc:460] Webserver started at http://127.11.88.65:42269/ using document root <none> and password file <none>
I20260806 01:06:33.698583 27995 fs_manager.cc:359] Metadata directory not provided
I20260806 01:06:33.698647 27995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:06:33.700218 27995 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 01:06:33.701015 28030 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:33.701223 27995 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:06:33.701339 27995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "58a33330643446c5b5c29d0c3cab109e"
format_stamp: "Formatted at 2026-08-06 01:06:12 on dist-test-slave-69rg"
server_key: "5e9466f745e4e850cb57e3f065dd8a74"
server_key_iv: "e822da461050a9c55984d2d3ad8bbdff"
server_key_version: "encryptionkey@0"
I20260806 01:06:33.701849 27995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:06:33.714525 27995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:06:33.717115 27995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:06:33.717289 27995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:06:33.717584 27995 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:06:33.718170 28037 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 01:06:33.719735 27995 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 01:06:33.719797 27995 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260806 01:06:33.719837 27995 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 01:06:33.720801 27995 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 01:06:33.720850 27995 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260806 01:06:33.720925 28037 tablet_bootstrap.cc:492] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e: Bootstrap starting.
I20260806 01:06:33.728757 27995 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:41569
I20260806 01:06:33.728874 28145 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:41569 every 8 connection(s)
I20260806 01:06:33.729305 27995 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
I20260806 01:06:33.730830 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 27995
I20260806 01:06:33.731191 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:40157
--local_ip_for_outbound_sockets=127.11.88.66
--tserver_master_addrs=127.11.88.126:44403
--webserver_port=42187
--webserver_interface=127.11.88.66
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:39067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 01:06:33.732940 28037 log.cc:824] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e: Log is configured to *not* fsync() on all Append() calls
I20260806 01:06:33.735993 28037 tablet_bootstrap.cc:492] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 01:06:33.736382 28037 tablet_bootstrap.cc:492] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e: Bootstrap complete.
I20260806 01:06:33.737876 28037 ts_tablet_manager.cc:1397] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.012s
I20260806 01:06:33.739802 28037 raft_consensus.cc:348] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } } peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } }
I20260806 01:06:33.740218 28037 raft_consensus.cc:729] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58a33330643446c5b5c29d0c3cab109e, State: Initialized, Role: FOLLOWER
I20260806 01:06:33.740594 28037 consensus_queue.cc:260] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } } peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } }
I20260806 01:06:33.741017 28037 ts_tablet_manager.cc:1428] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
Aug 06 01:06:33 dist-test-slave-69rg krb5kdc[27370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978393, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:06:33.749234 28148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:33.730176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.65:60943)
0806 01:06:33.733312 (+ 3136us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:33.733361 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 01:06:33.736761 (+ 3400us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:06:33.737470 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:06:33.737474 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:06:33.737920 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:06:33.738231 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:33.738239 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:33.739965 (+ 1726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:33.739966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:33.741234 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:33.741238 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:33.742209 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:33.742210 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:33.742354 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:33.743060 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:06:33.743071 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:06:33.745038 (+ 1967us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:06:33.747376 (+ 2338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:06:33.747384 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:06:33.747387 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:06:33.747698 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:06:33.747988 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:06:33.747989 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:06:33.747990 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:06:33.748131 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:06:33.748565 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:06:33.748571 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:06:33.748728 (+ 157us) client_negotiation.cc:769] Sending connection context
0806 01:06:33.748841 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 01:06:33.749012 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3090,"thread_start_us":97,"threads_started":1}
I20260806 01:06:33.749256 28149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:33.730324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:60943 (local address 127.11.88.126:44403)
0806 01:06:33.730527 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 01:06:33.730537 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 01:06:33.733937 (+ 3400us) server_negotiation.cc:407] Connection header received
0806 01:06:33.737089 (+ 3152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:06:33.737096 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:06:33.737160 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:06:33.737299 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:06:33.738383 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:33.739821 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:33.741324 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:33.742091 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:33.742225 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:33.745174 (+ 2949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:06:33.745178 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:06:33.745179 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:06:33.745194 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:06:33.747279 (+ 2085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:06:33.747789 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:06:33.747793 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:06:33.747793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:06:33.747913 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:06:33.748201 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:06:33.748202 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:06:33.748203 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:06:33.748489 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:06:33.748571 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 01:06:33.748912 (+ 341us) server_negotiation.cc:299] Negotiation successful
0806 01:06:33.749050 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":102,"threads_started":1}
I20260806 01:06:33.750583 28146 heartbeater.cc:347] Connected to a master server at 127.11.88.126:44403
I20260806 01:06:33.750699 28146 heartbeater.cc:464] Registering TS with master...
I20260806 01:06:33.750914 28146 heartbeater.cc:511] Master 127.11.88.126:44403 requested a full tablet report, sending...
I20260806 01:06:33.751777 27956 ts_manager.cc:194] Registered new tserver with Master: 58a33330643446c5b5c29d0c3cab109e (127.11.88.65:41569)
I20260806 01:06:33.752993 27956 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.65@KRBTEST.COM'} at 127.11.88.65:60943
I20260806 01:06:33.754007 28146 heartbeater.cc:503] Master 127.11.88.126:44403 was elected leader, sending a full tablet report...
I20260806 01:06:33.758364 28153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:33.752473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:41569 (local address 127.0.0.1:51776)
0806 01:06:33.752922 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:33.752960 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 01:06:33.753225 (+ 265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:06:33.754379 (+ 1154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:06:33.754383 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:06:33.754389 (+ 6us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:06:33.754473 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:33.754475 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:33.755792 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:33.755793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:33.757043 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:33.757046 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:33.758059 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:33.758060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:33.758141 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:33.758155 (+ 14us) client_negotiation.cc:769] Sending connection context
0806 01:06:33.758218 (+ 63us) client_negotiation.cc:240] Negotiation successful
0806 01:06:33.758282 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":112,"threads_started":1}
I20260806 01:06:33.758906 28154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:33.752750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51776 (local address 127.11.88.65:41569)
0806 01:06:33.753168 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0806 01:06:33.753173 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:06:33.753184 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:06:33.754189 (+ 1005us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:06:33.754192 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:06:33.754210 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:06:33.754306 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:06:33.754616 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:33.755690 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:33.757143 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:33.757883 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:33.757951 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:33.758005 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 01:06:33.758792 (+ 787us) server_negotiation.cc:299] Negotiation successful
0806 01:06:33.758839 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":81,"threads_started":1}
I20260806 01:06:33.759433 28079 tablet_service.cc:1514] Processing DeleteTablet for tablet 318a185fdba142408e4c0503057b44ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:06:13 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:51776
I20260806 01:06:33.760104 28155 tablet_replica.cc:330] stopping tablet replica
I20260806 01:06:33.760215 28155 raft_consensus.cc:2229] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:06:33.760282 28155 raft_consensus.cc:2258] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:06:33.760661 28155 ts_tablet_manager.cc:1905] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:06:33.763485 28155 ts_tablet_manager.cc:1918] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:06:33.763569 28155 log.cc:1196] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/wal/wals/318a185fdba142408e4c0503057b44ae
I20260806 01:06:33.763813 28155 ts_tablet_manager.cc:1939] T 318a185fdba142408e4c0503057b44ae P 58a33330643446c5b5c29d0c3cab109e: Deleting consensus metadata
I20260806 01:06:33.764385 27942 catalog_manager.cc:4841] TS 58a33330643446c5b5c29d0c3cab109e (127.11.88.65:41569): tablet 318a185fdba142408e4c0503057b44ae (table test-table [id=31370f75bcab4462b72e3c23e9011760]) successfully deleted
W20260806 01:06:33.824337 28150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:06:33.824666 28150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:06:33.824707 28150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:06:33.825984 28150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:06:33.826026 28150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:06:33.826054 28150 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:06:33.827637 28150 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:39067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:40157
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=42187
--tserver_master_addrs=127.11.88.126:44403
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28150
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:06:33.827903 28150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:06:33.828145 28150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:06:33.833696 28160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:06:33.833710 28161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:06:33.833884 28150 server_base.cc:1034] running on GCE node
W20260806 01:06:33.833696 28163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:06:33.834161 28150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:06:33.834395 28150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:06:33.835567 28150 hybrid_clock.cc:648] HybridClock initialized: now 1785978393835561 us; error 45 us; skew 500 ppm
Aug 06 01:06:33 dist-test-slave-69rg krb5kdc[27370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978393, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:06:33.838330 28150 init.cc:377] Logged in from keytab as kudu/127.11.88.66@KRBTEST.COM (short username kudu)
I20260806 01:06:33.838845 28150 webserver.cc:460] Webserver started at http://127.11.88.66:42187/ using document root <none> and password file <none>
I20260806 01:06:33.839048 28150 fs_manager.cc:359] Metadata directory not provided
I20260806 01:06:33.839102 28150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:06:33.840462 28150 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:06:33.841378 28170 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:33.841609 28150 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:06:33.841707 28150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "16238c4dfd83438ba8e70ae4ff7dd58f"
format_stamp: "Formatted at 2026-08-06 01:06:12 on dist-test-slave-69rg"
server_key: "b5476da6aa0708649b731162ca693e12"
server_key_iv: "4b58abef480d0bc7a8102423fe2e5225"
server_key_version: "encryptionkey@0"
I20260806 01:06:33.842125 28150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:06:33.861498 28150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:06:33.863646 28150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:06:33.863778 28150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:06:33.863981 28150 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:06:33.864369 28150 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:06:33.864447 28150 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:33.864490 28150 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:06:33.864531 28150 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:33.870867 28150 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:40157
I20260806 01:06:33.870980 28285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:40157 every 8 connection(s)
I20260806 01:06:33.871337 28150 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
Aug 06 01:06:33 dist-test-slave-69rg krb5kdc[27370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978393, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:06:33.878568 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 28150
I20260806 01:06:33.878959 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:34375
--local_ip_for_outbound_sockets=127.11.88.67
--tserver_master_addrs=127.11.88.126:44403
--webserver_port=38985
--webserver_interface=127.11.88.67
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:39067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 01:06:33.882205 28149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:33.872206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:33335 (local address 127.11.88.126:44403)
0806 01:06:33.872273 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0806 01:06:33.872276 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:06:33.872489 (+ 213us) server_negotiation.cc:407] Connection header received
0806 01:06:33.872967 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:06:33.872969 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:06:33.872981 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:06:33.873044 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:06:33.874005 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:33.874841 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:33.876066 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:33.876279 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:33.876342 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:33.878872 (+ 2530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:06:33.878873 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:06:33.878874 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:06:33.878880 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:06:33.880436 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:06:33.881005 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:06:33.881007 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:06:33.881007 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:06:33.881080 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:06:33.881384 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:06:33.881385 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:06:33.881386 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:06:33.881545 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:06:33.881621 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 01:06:33.882016 (+ 395us) server_negotiation.cc:299] Negotiation successful
0806 01:06:33.882136 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 01:06:33.882516 28288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:33.872153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.66:33335)
0806 01:06:33.872350 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:33.872395 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 01:06:33.872885 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:06:33.873096 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:06:33.873099 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:06:33.873696 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:06:33.873916 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:33.873921 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:33.874961 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:33.874962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:33.875976 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:33.875978 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:33.876366 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:33.876367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:33.876472 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:33.877051 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:06:33.877060 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:06:33.878763 (+ 1703us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:06:33.880526 (+ 1763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:06:33.880536 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:06:33.880539 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:06:33.880925 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:06:33.881194 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:06:33.881195 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:06:33.881195 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:06:33.881312 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:06:33.881646 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:06:33.881653 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:06:33.881785 (+ 132us) client_negotiation.cc:769] Sending connection context
0806 01:06:33.881998 (+ 213us) client_negotiation.cc:240] Negotiation successful
0806 01:06:33.882211 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":111,"threads_started":1}
I20260806 01:06:33.883066 28286 heartbeater.cc:347] Connected to a master server at 127.11.88.126:44403
I20260806 01:06:33.883172 28286 heartbeater.cc:464] Registering TS with master...
I20260806 01:06:33.883400 28286 heartbeater.cc:511] Master 127.11.88.126:44403 requested a full tablet report, sending...
I20260806 01:06:33.883826 27956 ts_manager.cc:194] Registered new tserver with Master: 16238c4dfd83438ba8e70ae4ff7dd58f (127.11.88.66:40157)
I20260806 01:06:33.884238 27956 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.66@KRBTEST.COM'} at 127.11.88.66:33335
W20260806 01:06:33.964638 28289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:06:33.964973 28289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:06:33.965018 28289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:06:33.966352 28289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:06:33.966425 28289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:06:33.966475 28289 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:06:33.968078 28289 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:39067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:34375
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=38985
--tserver_master_addrs=127.11.88.126:44403
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28289
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:06:33.968371 28289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:06:33.968627 28289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:06:33.974390 28297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:06:33.974534 28295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:06:33.974435 28294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:06:33.974598 28289 server_base.cc:1034] running on GCE node
I20260806 01:06:33.974895 28289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:06:33.975174 28289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:06:33.976373 28289 hybrid_clock.cc:648] HybridClock initialized: now 1785978393976346 us; error 47 us; skew 500 ppm
Aug 06 01:06:33 dist-test-slave-69rg krb5kdc[27370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978393, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:06:33.979070 28289 init.cc:377] Logged in from keytab as kudu/127.11.88.67@KRBTEST.COM (short username kudu)
I20260806 01:06:33.979478 28289 webserver.cc:460] Webserver started at http://127.11.88.67:38985/ using document root <none> and password file <none>
I20260806 01:06:33.979691 28289 fs_manager.cc:359] Metadata directory not provided
I20260806 01:06:33.979743 28289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:06:33.981122 28289 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:06:33.981730 28304 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:33.981943 28289 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:06:33.982012 28289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "f3ea836aee754d70909b1f7419609a35"
format_stamp: "Formatted at 2026-08-06 01:06:13 on dist-test-slave-69rg"
server_key: "f9a8463bc153e42ec96fee2c2ea281ba"
server_key_iv: "be31faa2d5255941ea757f35436bba00"
server_key_version: "encryptionkey@0"
I20260806 01:06:33.982378 28289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:06:33.999150 28289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:06:34.001547 28289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:06:34.001677 28289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:06:34.002022 28289 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:06:34.002424 28289 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:06:34.002460 28289 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:34.002485 28289 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:06:34.002497 28289 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:34.009327 28289 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:34375
I20260806 01:06:34.009430 28418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:34375 every 8 connection(s)
I20260806 01:06:34.009845 28289 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
I20260806 01:06:34.016052 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 28289
Aug 06 01:06:34 dist-test-slave-69rg krb5kdc[27370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978393, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:06:34.020741 28149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:34.010771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:43215 (local address 127.11.88.126:44403)
0806 01:06:34.010851 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0806 01:06:34.010853 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:06:34.011072 (+ 219us) server_negotiation.cc:407] Connection header received
0806 01:06:34.011559 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:06:34.011568 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:06:34.011582 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:06:34.011665 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:06:34.012711 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.013231 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.014384 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.014582 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.014688 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:34.017403 (+ 2715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:06:34.017405 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:06:34.017405 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:06:34.017414 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:06:34.018998 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:06:34.019470 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:06:34.019471 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:06:34.019472 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:06:34.019563 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:06:34.019920 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:06:34.019920 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:06:34.019921 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:06:34.020033 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:06:34.020087 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 01:06:34.020501 (+ 414us) server_negotiation.cc:299] Negotiation successful
0806 01:06:34.020575 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 01:06:34.020908 28421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:34.010682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.67:43215)
0806 01:06:34.010876 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:34.010919 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 01:06:34.011426 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:06:34.011744 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:06:34.011748 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:06:34.012372 (+ 624us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:06:34.012583 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:34.012587 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.013334 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.013335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:34.014286 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:34.014288 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.014723 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.014724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:34.014854 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:34.015423 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:06:34.015431 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:06:34.017295 (+ 1864us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:06:34.019115 (+ 1820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:06:34.019123 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:06:34.019126 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:06:34.019379 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:06:34.019643 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:06:34.019643 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:06:34.019644 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:06:34.019840 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:06:34.020104 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:06:34.020112 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:06:34.020343 (+ 231us) client_negotiation.cc:769] Sending connection context
0806 01:06:34.020479 (+ 136us) client_negotiation.cc:240] Negotiation successful
0806 01:06:34.020665 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":94,"threads_started":1}
I20260806 01:06:34.021497 28419 heartbeater.cc:347] Connected to a master server at 127.11.88.126:44403
I20260806 01:06:34.021639 28419 heartbeater.cc:464] Registering TS with master...
I20260806 01:06:34.021888 28419 heartbeater.cc:511] Master 127.11.88.126:44403 requested a full tablet report, sending...
I20260806 01:06:34.022337 27956 ts_manager.cc:194] Registered new tserver with Master: f3ea836aee754d70909b1f7419609a35 (127.11.88.67:34375)
I20260806 01:06:34.022840 27956 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.67@KRBTEST.COM'} at 127.11.88.67:43215
I20260806 01:06:34.024031 28423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:34.016563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39964 (local address 127.11.88.126:44403)
0806 01:06:34.016710 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0806 01:06:34.016713 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:06:34.016854 (+ 141us) server_negotiation.cc:407] Connection header received
0806 01:06:34.016932 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:06:34.016934 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:06:34.016948 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:06:34.017008 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:06:34.017624 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.018208 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.019011 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.019214 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.019292 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:34.020636 (+ 1344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:06:34.020637 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:06:34.020637 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:06:34.020644 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:06:34.022513 (+ 1869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:06:34.022922 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:06:34.022923 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:06:34.022923 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:06:34.022989 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:06:34.023365 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:06:34.023366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:06:34.023367 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:06:34.023509 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:06:34.023777 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0806 01:06:34.023820 (+ 43us) server_negotiation.cc:299] Negotiation successful
0806 01:06:34.023917 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":95,"threads_started":1}
I20260806 01:06:34.024894 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 01:06:34.027763 28423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:34.025293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39978 (local address 127.11.88.126:44403)
0806 01:06:34.025331 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0806 01:06:34.025333 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:06:34.025463 (+ 130us) server_negotiation.cc:407] Connection header received
0806 01:06:34.025514 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:06:34.025515 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:06:34.025546 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:06:34.025598 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:06:34.025770 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.026295 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.027143 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.027344 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.027409 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:34.027542 (+ 133us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:06:34.027596 (+ 54us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0806 01:06:34.027718 (+ 122us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39978: token expired
Metrics: {"server-negotiator.queue_time_us":17}
W20260806 01:06:34.027844 28423 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39978: token expired
W20260806 01:06:34.028877 27886 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.11.88.126:44403)
I20260806 01:06:34.035943 28423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:34.029189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39994 (local address 127.11.88.126:44403)
0806 01:06:34.029226 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0806 01:06:34.029228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:06:34.029236 (+ 8us) server_negotiation.cc:407] Connection header received
0806 01:06:34.029287 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:06:34.029287 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:06:34.029295 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:06:34.029341 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:06:34.030026 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.030562 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.031324 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.031528 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.031604 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:34.033026 (+ 1422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:06:34.033027 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:06:34.033027 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:06:34.033034 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:06:34.034640 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:06:34.035161 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:06:34.035162 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:06:34.035162 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:06:34.035220 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:06:34.035415 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:06:34.035415 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:06:34.035415 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:06:34.035566 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:06:34.035656 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0806 01:06:34.035804 (+ 148us) server_negotiation.cc:299] Negotiation successful
0806 01:06:34.035871 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260806 01:06:34.037387 27956 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39994:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 01:06:34.039322 27956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:06:34.041818 28079 tablet_service.cc:1467] Processing CreateTablet for tablet bf48caa367554bbdbb2f1eae40624bad (DEFAULT_TABLE table=test-table [id=524682a752c649d2b412b05ee18898b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:06:34.042081 28079 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf48caa367554bbdbb2f1eae40624bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:06:34.043605 28037 tablet_bootstrap.cc:492] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e: Bootstrap starting.
I20260806 01:06:34.043993 28037 tablet_bootstrap.cc:654] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e: Neither blocks nor log segments found. Creating new log.
I20260806 01:06:34.044601 28037 tablet_bootstrap.cc:492] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e: No bootstrap required, opened a new log
I20260806 01:06:34.044679 28037 ts_tablet_manager.cc:1397] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260806 01:06:34.044819 28037 raft_consensus.cc:348] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } } peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } }
I20260806 01:06:34.044920 28037 raft_consensus.cc:374] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:06:34.044996 28037 raft_consensus.cc:729] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58a33330643446c5b5c29d0c3cab109e, State: Initialized, Role: FOLLOWER
I20260806 01:06:34.045050 28037 consensus_queue.cc:260] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } } peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } }
I20260806 01:06:34.045149 28037 ts_tablet_manager.cc:1428] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:34.046393 28426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:34.041718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60946 (local address 127.11.88.67:34375)
0806 01:06:34.042341 (+ 623us) server_negotiation.cc:206] Beginning negotiation
0806 01:06:34.042345 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 01:06:34.042354 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:06:34.042392 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:06:34.042394 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:06:34.042408 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:06:34.042483 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:06:34.042613 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.043794 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.045208 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.045997 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.046114 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:34.046183 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 01:06:34.046278 (+ 95us) server_negotiation.cc:299] Negotiation successful
0806 01:06:34.046318 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":582,"thread_start_us":166,"threads_started":1}
I20260806 01:06:34.046416 28153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:34.041563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:34375 (local address 127.0.0.1:60946)
0806 01:06:34.041599 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:34.041611 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:06:34.041648 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:06:34.042500 (+ 852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:06:34.042502 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:06:34.042504 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:06:34.042551 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:34.042553 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.043894 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.043896 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:34.045111 (+ 1215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:34.045113 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.046116 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.046117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:34.046211 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:34.046215 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:06:34.046262 (+ 47us) client_negotiation.cc:240] Negotiation successful
0806 01:06:34.046301 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17,"mutex_wait_us":147}
I20260806 01:06:34.046418 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:34.041666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:40157 (local address 127.0.0.1:56802)
0806 01:06:34.041883 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:34.041895 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:06:34.041945 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:06:34.042511 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:06:34.042512 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:06:34.042515 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:06:34.042564 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:34.042566 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.043894 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.043896 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:34.045109 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:34.045112 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.046116 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.046117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:34.046186 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:34.046191 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 01:06:34.046223 (+ 32us) client_negotiation.cc:240] Negotiation successful
0806 01:06:34.046272 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"mutex_wait_us":2,"thread_start_us":142,"threads_started":1}
I20260806 01:06:34.046597 28427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:34.041998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56802 (local address 127.11.88.66:40157)
0806 01:06:34.042228 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0806 01:06:34.042234 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 01:06:34.042308 (+ 74us) server_negotiation.cc:407] Connection header received
0806 01:06:34.042377 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:06:34.042379 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:06:34.042396 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:06:34.042647 (+ 251us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:06:34.042734 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.043788 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.045239 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.045997 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.046347 (+ 350us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:34.046414 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 01:06:34.046440 (+ 26us) server_negotiation.cc:299] Negotiation successful
0806 01:06:34.046497 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":95,"threads_started":1}
I20260806 01:06:34.047202 28353 tablet_service.cc:1467] Processing CreateTablet for tablet bf48caa367554bbdbb2f1eae40624bad (DEFAULT_TABLE table=test-table [id=524682a752c649d2b412b05ee18898b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:06:34.047375 28219 tablet_service.cc:1467] Processing CreateTablet for tablet bf48caa367554bbdbb2f1eae40624bad (DEFAULT_TABLE table=test-table [id=524682a752c649d2b412b05ee18898b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:06:34.047619 28353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf48caa367554bbdbb2f1eae40624bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:06:34.047787 28219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf48caa367554bbdbb2f1eae40624bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:06:34.050659 28429 tablet_bootstrap.cc:492] T bf48caa367554bbdbb2f1eae40624bad P f3ea836aee754d70909b1f7419609a35: Bootstrap starting.
I20260806 01:06:34.051065 28430 tablet_bootstrap.cc:492] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f: Bootstrap starting.
I20260806 01:06:34.051412 28429 tablet_bootstrap.cc:654] T bf48caa367554bbdbb2f1eae40624bad P f3ea836aee754d70909b1f7419609a35: Neither blocks nor log segments found. Creating new log.
I20260806 01:06:34.051815 28430 tablet_bootstrap.cc:654] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f: Neither blocks nor log segments found. Creating new log.
I20260806 01:06:34.051942 28429 log.cc:824] T bf48caa367554bbdbb2f1eae40624bad P f3ea836aee754d70909b1f7419609a35: Log is configured to *not* fsync() on all Append() calls
I20260806 01:06:34.052526 28430 log.cc:824] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f: Log is configured to *not* fsync() on all Append() calls
I20260806 01:06:34.052738 28429 tablet_bootstrap.cc:492] T bf48caa367554bbdbb2f1eae40624bad P f3ea836aee754d70909b1f7419609a35: No bootstrap required, opened a new log
I20260806 01:06:34.052845 28429 ts_tablet_manager.cc:1397] T bf48caa367554bbdbb2f1eae40624bad P f3ea836aee754d70909b1f7419609a35: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 01:06:34.053310 28430 tablet_bootstrap.cc:492] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f: No bootstrap required, opened a new log
I20260806 01:06:34.053399 28430 ts_tablet_manager.cc:1397] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 01:06:34.054461 28429 raft_consensus.cc:348] T bf48caa367554bbdbb2f1eae40624bad P f3ea836aee754d70909b1f7419609a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } } peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } }
I20260806 01:06:34.054602 28429 raft_consensus.cc:374] T bf48caa367554bbdbb2f1eae40624bad P f3ea836aee754d70909b1f7419609a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:06:34.054625 28429 raft_consensus.cc:729] T bf48caa367554bbdbb2f1eae40624bad P f3ea836aee754d70909b1f7419609a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3ea836aee754d70909b1f7419609a35, State: Initialized, Role: FOLLOWER
I20260806 01:06:34.054746 28429 consensus_queue.cc:260] T bf48caa367554bbdbb2f1eae40624bad P f3ea836aee754d70909b1f7419609a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } } peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } }
I20260806 01:06:34.055058 28429 ts_tablet_manager.cc:1428] T bf48caa367554bbdbb2f1eae40624bad P f3ea836aee754d70909b1f7419609a35: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 01:06:34.055209 28419 heartbeater.cc:503] Master 127.11.88.126:44403 was elected leader, sending a full tablet report...
I20260806 01:06:34.055498 28430 raft_consensus.cc:348] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } } peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } }
I20260806 01:06:34.055701 28430 raft_consensus.cc:374] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:06:34.055743 28430 raft_consensus.cc:729] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16238c4dfd83438ba8e70ae4ff7dd58f, State: Initialized, Role: FOLLOWER
I20260806 01:06:34.055863 28430 consensus_queue.cc:260] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } } peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } }
I20260806 01:06:34.056200 28430 ts_tablet_manager.cc:1428] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260806 01:06:34.056221 28286 heartbeater.cc:503] Master 127.11.88.126:44403 was elected leader, sending a full tablet report...
I20260806 01:06:34.075481 28434 raft_consensus.cc:482] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:06:34.075618 28434 raft_consensus.cc:504] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } } peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } }
I20260806 01:06:34.075997 28434 leader_election.cc:288] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3ea836aee754d70909b1f7419609a35 (127.11.88.67:34375), 58a33330643446c5b5c29d0c3cab109e (127.11.88.65:41569)
I20260806 01:06:34.080156 28426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:34.076300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:52427 (local address 127.11.88.67:34375)
0806 01:06:34.076366 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 01:06:34.076368 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:06:34.076375 (+ 7us) server_negotiation.cc:407] Connection header received
0806 01:06:34.076410 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:06:34.076410 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:06:34.076418 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:06:34.076458 (+ 40us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:06:34.076699 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.077494 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.079233 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.079775 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.079838 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:34.079846 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 01:06:34.080061 (+ 215us) server_negotiation.cc:299] Negotiation successful
0806 01:06:34.080095 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 01:06:34.080183 28288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:34.076152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:34375 (local address 127.11.88.66:52427)
0806 01:06:34.076220 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:34.076233 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:06:34.076280 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:06:34.076504 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:06:34.076505 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:06:34.076506 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:06:34.076617 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:34.076620 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.077619 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.077620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:34.079117 (+ 1497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:34.079121 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.079868 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.079870 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:34.079978 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:34.079982 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:06:34.080049 (+ 67us) client_negotiation.cc:240] Negotiation successful
0806 01:06:34.080095 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":146}
I20260806 01:06:34.080827 28435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:34.076197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:41569 (local address 127.11.88.66:38931)
0806 01:06:34.076388 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:34.076399 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:06:34.076496 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:06:34.076625 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:06:34.076627 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:06:34.076628 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:06:34.076689 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:34.076690 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.077619 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.077620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:34.079117 (+ 1497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:34.079121 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.080536 (+ 1415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.080537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:34.080627 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:34.080630 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:06:34.080698 (+ 68us) client_negotiation.cc:240] Negotiation successful
0806 01:06:34.080741 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":89,"thread_start_us":123,"threads_started":1}
I20260806 01:06:34.080821 28154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:34.076285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:38931 (local address 127.11.88.65:41569)
0806 01:06:34.076338 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0806 01:06:34.076341 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:06:34.076502 (+ 161us) server_negotiation.cc:407] Connection header received
0806 01:06:34.076542 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:06:34.076543 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:06:34.076558 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:06:34.076603 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:06:34.076759 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.077502 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.079261 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.080434 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.080522 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:34.080530 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 01:06:34.080707 (+ 177us) server_negotiation.cc:299] Negotiation successful
0806 01:06:34.080759 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260806 01:06:34.080852 28373 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf48caa367554bbdbb2f1eae40624bad" candidate_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ea836aee754d70909b1f7419609a35" is_pre_election: true
I20260806 01:06:34.081063 28373 raft_consensus.cc:2454] T bf48caa367554bbdbb2f1eae40624bad P f3ea836aee754d70909b1f7419609a35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16238c4dfd83438ba8e70ae4ff7dd58f in term 0.
I20260806 01:06:34.081305 28171 leader_election.cc:302] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16238c4dfd83438ba8e70ae4ff7dd58f, f3ea836aee754d70909b1f7419609a35; no voters:
I20260806 01:06:34.081283 28100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf48caa367554bbdbb2f1eae40624bad" candidate_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a33330643446c5b5c29d0c3cab109e" is_pre_election: true
I20260806 01:06:34.081446 28100 raft_consensus.cc:2454] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16238c4dfd83438ba8e70ae4ff7dd58f in term 0.
I20260806 01:06:34.081460 28434 raft_consensus.cc:2781] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:06:34.081539 28434 raft_consensus.cc:482] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:06:34.081574 28434 raft_consensus.cc:3037] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:06:34.082433 28434 raft_consensus.cc:504] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } } peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } }
I20260806 01:06:34.082602 28434 leader_election.cc:288] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f [CANDIDATE]: Term 1 election: Requested vote from peers f3ea836aee754d70909b1f7419609a35 (127.11.88.67:34375), 58a33330643446c5b5c29d0c3cab109e (127.11.88.65:41569)
I20260806 01:06:34.082767 28100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf48caa367554bbdbb2f1eae40624bad" candidate_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a33330643446c5b5c29d0c3cab109e"
I20260806 01:06:34.082856 28100 raft_consensus.cc:3037] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:06:34.082855 28373 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf48caa367554bbdbb2f1eae40624bad" candidate_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3ea836aee754d70909b1f7419609a35"
I20260806 01:06:34.082981 28373 raft_consensus.cc:3037] T bf48caa367554bbdbb2f1eae40624bad P f3ea836aee754d70909b1f7419609a35 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:06:34.083693 28100 raft_consensus.cc:2454] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16238c4dfd83438ba8e70ae4ff7dd58f in term 1.
I20260806 01:06:34.083876 28373 raft_consensus.cc:2454] T bf48caa367554bbdbb2f1eae40624bad P f3ea836aee754d70909b1f7419609a35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16238c4dfd83438ba8e70ae4ff7dd58f in term 1.
I20260806 01:06:34.083897 28173 leader_election.cc:302] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16238c4dfd83438ba8e70ae4ff7dd58f, 58a33330643446c5b5c29d0c3cab109e; no voters:
I20260806 01:06:34.084012 28434 raft_consensus.cc:2781] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:06:34.084177 28434 raft_consensus.cc:686] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f [term 1 LEADER]: Becoming Leader. State: Replica: 16238c4dfd83438ba8e70ae4ff7dd58f, State: Running, Role: LEADER
I20260806 01:06:34.084303 28434 consensus_queue.cc:237] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } } peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } }
I20260806 01:06:34.085331 27956 catalog_manager.cc:5495] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f reported cstate change: term changed from 0 to 1, leader changed from <none> to 16238c4dfd83438ba8e70ae4ff7dd58f (127.11.88.66). New cstate: current_term: 1 leader_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } health_report { overall_health: UNKNOWN } } }
I20260806 01:06:34.093672 28427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:34.091109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56806 (local address 127.11.88.66:40157)
0806 01:06:34.091242 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0806 01:06:34.091244 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:06:34.091254 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:06:34.091289 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:06:34.091290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:06:34.091314 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:06:34.091384 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:06:34.091544 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.092020 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.092854 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:34.093051 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:34.093112 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:34.093309 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:06:34.093412 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:06:34.093476 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 01:06:34.093526 (+ 50us) server_negotiation.cc:299] Negotiation successful
0806 01:06:34.093546 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260806 01:06:34.096107 28373 raft_consensus.cc:1261] T bf48caa367554bbdbb2f1eae40624bad P f3ea836aee754d70909b1f7419609a35 [term 1 FOLLOWER]: Refusing update from remote peer 16238c4dfd83438ba8e70ae4ff7dd58f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:06:34.096203 28100 raft_consensus.cc:1261] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [term 1 FOLLOWER]: Refusing update from remote peer 16238c4dfd83438ba8e70ae4ff7dd58f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:06:34.096630 28436 consensus_queue.cc:1035] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:06:34.096849 28434 consensus_queue.cc:1035] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:06:34.099417 28439 mvcc.cc:205] Tried to move back new op lower bound from 7315367502213763072 to 7315367502170124288. Current Snapshot: MvccSnapshot[applied={T|T < 7315367502213763072}]
I20260806 01:06:34.101557 28440 mvcc.cc:205] Tried to move back new op lower bound from 7315367502213763072 to 7315367502170124288. Current Snapshot: MvccSnapshot[applied={T|T < 7315367502213763072}]
I20260806 01:06:34.102121 27956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39994:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:06:34.102237 27956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39994:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:06:34.103116 27956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd: Sending DeleteTablet for 3 replicas of tablet bf48caa367554bbdbb2f1eae40624bad
I20260806 01:06:34.103459 28079 tablet_service.cc:1514] Processing DeleteTablet for tablet bf48caa367554bbdbb2f1eae40624bad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:06:34 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:51776
I20260806 01:06:34.103482 28353 tablet_service.cc:1514] Processing DeleteTablet for tablet bf48caa367554bbdbb2f1eae40624bad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:06:34 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:60946
I20260806 01:06:34.103582 28155 tablet_replica.cc:330] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e: stopping tablet replica
I20260806 01:06:34.103654 28155 raft_consensus.cc:2229] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:06:34.103725 28155 raft_consensus.cc:2258] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:06:34.103765 28219 tablet_service.cc:1514] Processing DeleteTablet for tablet bf48caa367554bbdbb2f1eae40624bad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:06:34 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:56802
I20260806 01:06:34.103950 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 27995
I20260806 01:06:34.104187 28448 tablet_replica.cc:330] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f: stopping tablet replica
I20260806 01:06:34.104297 28448 raft_consensus.cc:2229] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f [term 1 LEADER]: Raft consensus shutting down.
I20260806 01:06:34.104393 28448 raft_consensus.cc:2258] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:06:34.103998 28447 tablet_replica.cc:330] T bf48caa367554bbdbb2f1eae40624bad P f3ea836aee754d70909b1f7419609a35: stopping tablet replica
I20260806 01:06:34.105005 28448 ts_tablet_manager.cc:1905] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:06:34.105057 28447 raft_consensus.cc:2229] T bf48caa367554bbdbb2f1eae40624bad P f3ea836aee754d70909b1f7419609a35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:06:34.105189 28447 raft_consensus.cc:2258] T bf48caa367554bbdbb2f1eae40624bad P f3ea836aee754d70909b1f7419609a35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:06:34.105679 28447 ts_tablet_manager.cc:1905] T bf48caa367554bbdbb2f1eae40624bad P f3ea836aee754d70909b1f7419609a35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:06:34.107122 28448 ts_tablet_manager.cc:1918] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:06:34.107259 28448 log.cc:1196] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/wal/wals/bf48caa367554bbdbb2f1eae40624bad
I20260806 01:06:34.107613 28448 ts_tablet_manager.cc:1939] T bf48caa367554bbdbb2f1eae40624bad P 16238c4dfd83438ba8e70ae4ff7dd58f: Deleting consensus metadata
I20260806 01:06:34.107941 28447 ts_tablet_manager.cc:1918] T bf48caa367554bbdbb2f1eae40624bad P f3ea836aee754d70909b1f7419609a35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:06:34.108033 28447 log.cc:1196] T bf48caa367554bbdbb2f1eae40624bad P f3ea836aee754d70909b1f7419609a35: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/wal/wals/bf48caa367554bbdbb2f1eae40624bad
I20260806 01:06:34.108211 27940 catalog_manager.cc:4841] TS 16238c4dfd83438ba8e70ae4ff7dd58f (127.11.88.66:40157): tablet bf48caa367554bbdbb2f1eae40624bad (table test-table [id=524682a752c649d2b412b05ee18898b2]) successfully deleted
I20260806 01:06:34.108377 28447 ts_tablet_manager.cc:1939] T bf48caa367554bbdbb2f1eae40624bad P f3ea836aee754d70909b1f7419609a35: Deleting consensus metadata
I20260806 01:06:34.108928 27940 catalog_manager.cc:4841] TS f3ea836aee754d70909b1f7419609a35 (127.11.88.67:34375): tablet bf48caa367554bbdbb2f1eae40624bad (table test-table [id=524682a752c649d2b412b05ee18898b2]) successfully deleted
W20260806 01:06:34.113435 27942 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.88.65:41569 (error 108)
I20260806 01:06:34.113936 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 28150
I20260806 01:06:34.114137 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:34.113928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:41569 (local address 127.0.0.1:51780)
0806 01:06:34.114004 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:34.114058 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.65:41569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260806 01:06:34.115142 27942 catalog_manager.cc:4584] TS 58a33330643446c5b5c29d0c3cab109e (127.11.88.65:41569): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bf48caa367554bbdbb2f1eae40624bad: Network error: Client connection negotiation failed: client connection to 127.11.88.65:41569: connect: Connection refused (error 111)
I20260806 01:06:34.121492 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 28289
I20260806 01:06:34.127161 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 27923
I20260806 01:06:54.134318 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:44403
--webserver_interface=127.11.88.126
--webserver_port=39303
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:39067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:44403
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:06:54.219184 28450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:06:54.219478 28450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:06:54.219522 28450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:06:54.220829 28450 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 01:06:54.220920 28450 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 01:06:54.220942 28450 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 01:06:54.220961 28450 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:06:54.220993 28450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:06:54.221024 28450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:06:54.221045 28450 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:06:54.221073 28450 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:06:54.222800 28450 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:39067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:44403
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:44403
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=39303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:06:54.223126 28450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:06:54.223376 28450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 01:06:54.228876 28450 server_base.cc:1034] running on GCE node
W20260806 01:06:54.228956 28456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:06:54.228969 28455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:06:54.228979 28458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:06:54.229496 28450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:06:54.229782 28450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:06:54.230981 28450 hybrid_clock.cc:648] HybridClock initialized: now 1785978414230942 us; error 55 us; skew 500 ppm
Aug 06 01:06:54 dist-test-slave-69rg krb5kdc[27370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978414, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:06:54.233626 28450 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:06:54.234155 28450 webserver.cc:460] Webserver started at http://127.11.88.126:39303/ using document root <none> and password file <none>
I20260806 01:06:54.234416 28450 fs_manager.cc:359] Metadata directory not provided
I20260806 01:06:54.234467 28450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:06:54.236016 28450 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 01:06:54.236946 28465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:54.237175 28450 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:06:54.237320 28450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "005365bd08744d00a8bec09d40ae33bd"
format_stamp: "Formatted at 2026-08-06 01:06:12 on dist-test-slave-69rg"
server_key: "54c16e2361a3891571080bc1851f1368"
server_key_iv: "49a759d304a229fa166f7c2e12860baa"
server_key_version: "encryptionkey@0"
I20260806 01:06:54.237722 28450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:06:54.262668 28450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:06:54.265065 28450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:06:54.265309 28450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:06:54.269989 28450 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:44403
I20260806 01:06:54.270022 28517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:44403 every 8 connection(s)
I20260806 01:06:54.270448 28450 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:06:54.270671 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 28450
I20260806 01:06:54.270973 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:41569
--local_ip_for_outbound_sockets=127.11.88.65
--tserver_master_addrs=127.11.88.126:44403
--webserver_port=42269
--webserver_interface=127.11.88.65
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:39067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 01:06:54.272099 28518 sys_catalog.cc:263] Verifying existing consensus state
I20260806 01:06:54.272794 28518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd: Bootstrap starting.
I20260806 01:06:54.282637 28518 log.cc:824] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd: Log is configured to *not* fsync() on all Append() calls
I20260806 01:06:54.285691 28518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 01:06:54.286136 28518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd: Bootstrap complete.
I20260806 01:06:54.288796 28518 raft_consensus.cc:348] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005365bd08744d00a8bec09d40ae33bd" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44403 } }
I20260806 01:06:54.289076 28518 raft_consensus.cc:729] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005365bd08744d00a8bec09d40ae33bd, State: Initialized, Role: FOLLOWER
I20260806 01:06:54.289304 28518 consensus_queue.cc:260] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005365bd08744d00a8bec09d40ae33bd" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44403 } }
I20260806 01:06:54.289414 28518 raft_consensus.cc:388] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:06:54.289472 28518 raft_consensus.cc:482] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:06:54.289521 28518 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [term 2 FOLLOWER]: Advancing to term 3
I20260806 01:06:54.290702 28518 raft_consensus.cc:504] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005365bd08744d00a8bec09d40ae33bd" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44403 } }
I20260806 01:06:54.290830 28518 leader_election.cc:302] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 005365bd08744d00a8bec09d40ae33bd; no voters:
I20260806 01:06:54.291034 28518 leader_election.cc:288] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 01:06:54.291117 28522 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [term 3 FOLLOWER]: Leader election won for term 3
I20260806 01:06:54.291306 28522 raft_consensus.cc:686] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [term 3 LEADER]: Becoming Leader. State: Replica: 005365bd08744d00a8bec09d40ae33bd, State: Running, Role: LEADER
I20260806 01:06:54.291361 28518 sys_catalog.cc:564] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:06:54.291409 28522 consensus_queue.cc:237] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005365bd08744d00a8bec09d40ae33bd" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44403 } }
I20260806 01:06:54.291718 28523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "005365bd08744d00a8bec09d40ae33bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005365bd08744d00a8bec09d40ae33bd" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44403 } } }
I20260806 01:06:54.291815 28523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [sys.catalog]: This master's current role is: LEADER
I20260806 01:06:54.292064 28524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 005365bd08744d00a8bec09d40ae33bd. Latest consensus state: current_term: 3 leader_uuid: "005365bd08744d00a8bec09d40ae33bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005365bd08744d00a8bec09d40ae33bd" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 44403 } } }
I20260806 01:06:54.292210 28524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd [sys.catalog]: This master's current role is: LEADER
I20260806 01:06:54.292230 28528 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:06:54.293035 28528 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:06:54.293149 28528 catalog_manager.cc:1259] Loaded cluster ID: 11d8ae91cf714d4abe99ffd9dc0e7ed3
I20260806 01:06:54.293185 28528 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:06:54.294425 28528 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:06:54.294632 28528 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd: Loaded TSK: 0
I20260806 01:06:54.294678 28528 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 005365bd08744d00a8bec09d40ae33bd: Loaded TSK: 1
F20260806 01:06:54.294890 28528 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fb471b729ad google::LogMessage::Fail() at ??:0
@ 0x7fb471b7588a google::LogMessage::SendToLog() at ??:0
@ 0x7fb471b724de google::LogMessage::Flush() at ??:0
@ 0x7fb471b73a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fb4742df104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fb4742dcd41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fb479acc1cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fb479acc48e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fb479acc594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fb479a92c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fb479a9cad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fb473a400d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fb473a35954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fb4748996db start_thread at ??:0
@ 0x7fb47067061f clone at ??:0
W20260806 01:06:54.377796 28520 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:06:54.378157 28520 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:06:54.378208 28520 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:06:54.379647 28520 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:06:54.379727 28520 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:06:54.379856 28520 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:06:54.381666 28520 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:39067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:41569
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=42269
--tserver_master_addrs=127.11.88.126:44403
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28520
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:06:54.382052 28520 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:06:54.382351 28520 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 01:06:54.389114 28520 server_base.cc:1034] running on GCE node
W20260806 01:06:54.389087 28560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:06:54.389290 28562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:06:54.389122 28559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:06:54.389587 28520 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:06:54.389998 28520 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:06:54.391188 28520 hybrid_clock.cc:648] HybridClock initialized: now 1785978414391162 us; error 40 us; skew 500 ppm
Aug 06 01:06:54 dist-test-slave-69rg krb5kdc[27370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978414, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:06:54.394212 28520 init.cc:377] Logged in from keytab as kudu/127.11.88.65@KRBTEST.COM (short username kudu)
I20260806 01:06:54.394796 28520 webserver.cc:460] Webserver started at http://127.11.88.65:42269/ using document root <none> and password file <none>
I20260806 01:06:54.395066 28520 fs_manager.cc:359] Metadata directory not provided
I20260806 01:06:54.395143 28520 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:06:54.396668 28520 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260806 01:06:54.397666 28569 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:54.397917 28520 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:06:54.398100 28520 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "58a33330643446c5b5c29d0c3cab109e"
format_stamp: "Formatted at 2026-08-06 01:06:12 on dist-test-slave-69rg"
server_key: "5e9466f745e4e850cb57e3f065dd8a74"
server_key_iv: "e822da461050a9c55984d2d3ad8bbdff"
server_key_version: "encryptionkey@0"
I20260806 01:06:54.398512 28520 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:06:54.426584 28520 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:06:54.429389 28520 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:06:54.429593 28520 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:06:54.429934 28520 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:06:54.430464 28576 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 01:06:54.432516 28520 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 01:06:54.432598 28520 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260806 01:06:54.432648 28520 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 01:06:54.433363 28520 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 01:06:54.433426 28520 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260806 01:06:54.433493 28576 tablet_bootstrap.cc:492] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e: Bootstrap starting.
I20260806 01:06:54.441731 28520 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:41569
I20260806 01:06:54.441783 28683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:41569 every 8 connection(s)
I20260806 01:06:54.442253 28520 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
I20260806 01:06:54.445367 28576 log.cc:824] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e: Log is configured to *not* fsync() on all Append() calls
I20260806 01:06:54.447736 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 28520
I20260806 01:06:54.448050 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:40157
--local_ip_for_outbound_sockets=127.11.88.66
--tserver_master_addrs=127.11.88.126:44403
--webserver_port=42187
--webserver_interface=127.11.88.66
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:39067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 01:06:54.448237 28576 tablet_bootstrap.cc:492] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 01:06:54.448550 28576 tablet_bootstrap.cc:492] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e: Bootstrap complete.
I20260806 01:06:54.450003 28576 ts_tablet_manager.cc:1397] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.009s
I20260806 01:06:54.451524 28576 raft_consensus.cc:348] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } } peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } }
I20260806 01:06:54.451870 28576 raft_consensus.cc:729] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58a33330643446c5b5c29d0c3cab109e, State: Initialized, Role: FOLLOWER
I20260806 01:06:54.452041 28576 consensus_queue.cc:260] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } } peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } }
I20260806 01:06:54.452328 28576 ts_tablet_manager.cc:1428] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
W20260806 01:06:54.519268 28686 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:06:54.443051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.65:56525)
0806 01:06:54.443250 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:54.443298 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 01:06:54.443806 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:06:54.519053 (+ 75247us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":117,"threads_started":1}
W20260806 01:06:54.519587 28684 heartbeater.cc:644] Failed to heartbeat to 127.11.88.126:44403 (0 consecutive failures): Network error: Failed to ping master at 127.11.88.126:44403: Client connection negotiation failed: client connection to 127.11.88.126:44403: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 01:06:54.519975 28686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:54.519836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.65:46325)
0806 01:06:54.519894 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:54.519947 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260806 01:06:54.520347 28686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:54.520244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.65:57159)
0806 01:06:54.520297 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:54.520326 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260806 01:06:54.520484 28684 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 01:06:54.545722 28688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:06:54.546005 28688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:06:54.546034 28688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:06:54.547276 28688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:06:54.547324 28688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:06:54.547351 28688 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:06:54.548930 28688 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:39067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:40157
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=42187
--tserver_master_addrs=127.11.88.126:44403
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:06:54.549211 28688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:06:54.549474 28688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:06:54.554874 28695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:06:54.555009 28688 server_base.cc:1034] running on GCE node
W20260806 01:06:54.554883 28697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:06:54.555137 28694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:06:54.555351 28688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:06:54.555614 28688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:06:54.556797 28688 hybrid_clock.cc:648] HybridClock initialized: now 1785978414556796 us; error 43 us; skew 500 ppm
Aug 06 01:06:54 dist-test-slave-69rg krb5kdc[27370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978414, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:06:54.559383 28688 init.cc:377] Logged in from keytab as kudu/127.11.88.66@KRBTEST.COM (short username kudu)
I20260806 01:06:54.559798 28688 webserver.cc:460] Webserver started at http://127.11.88.66:42187/ using document root <none> and password file <none>
I20260806 01:06:54.560007 28688 fs_manager.cc:359] Metadata directory not provided
I20260806 01:06:54.560051 28688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:06:54.561319 28688 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:06:54.562038 28704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:54.562273 28688 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:06:54.562376 28688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "16238c4dfd83438ba8e70ae4ff7dd58f"
format_stamp: "Formatted at 2026-08-06 01:06:12 on dist-test-slave-69rg"
server_key: "b5476da6aa0708649b731162ca693e12"
server_key_iv: "4b58abef480d0bc7a8102423fe2e5225"
server_key_version: "encryptionkey@0"
I20260806 01:06:54.562763 28688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:06:54.580703 28688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:06:54.583603 28688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:06:54.583762 28688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:06:54.584096 28688 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:06:54.584430 28688 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:06:54.584465 28688 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:54.584489 28688 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:06:54.584501 28688 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:54.590840 28688 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:40157
I20260806 01:06:54.590942 28818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:40157 every 8 connection(s)
I20260806 01:06:54.591501 28688 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
I20260806 01:06:54.592777 28821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:54.592354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.66:43977)
0806 01:06:54.592530 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:54.592626 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":79,"threads_started":1}
W20260806 01:06:54.593266 28819 heartbeater.cc:644] Failed to heartbeat to 127.11.88.126:44403 (0 consecutive failures): Network error: Failed to ping master at 127.11.88.126:44403: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
I20260806 01:06:54.593593 28821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:54.593483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.66:56879)
0806 01:06:54.593530 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:54.593558 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260806 01:06:54.594076 28821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:54.593959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.66:33391)
0806 01:06:54.594012 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:54.594045 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260806 01:06:54.594172 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 28688
W20260806 01:06:54.594270 28819 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 01:06:54.594485 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:34375
--local_ip_for_outbound_sockets=127.11.88.67
--tserver_master_addrs=127.11.88.126:44403
--webserver_port=38985
--webserver_interface=127.11.88.67
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:39067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:06:54.678323 28822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:06:54.678560 28822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:06:54.678586 28822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:06:54.679827 28822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:06:54.679875 28822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:06:54.679904 28822 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:06:54.681452 28822 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:39067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:34375
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=38985
--tserver_master_addrs=127.11.88.126:44403
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28822
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:06:54.681721 28822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:06:54.682005 28822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:06:54.688122 28827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:06:54.688148 28828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:06:54.688124 28830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:06:54.689293 28822 server_base.cc:1034] running on GCE node
I20260806 01:06:54.689548 28822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:06:54.689859 28822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:06:54.691033 28822 hybrid_clock.cc:648] HybridClock initialized: now 1785978414690998 us; error 35 us; skew 500 ppm
Aug 06 01:06:54 dist-test-slave-69rg krb5kdc[27370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978414, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:06:54.694310 28822 init.cc:377] Logged in from keytab as kudu/127.11.88.67@KRBTEST.COM (short username kudu)
I20260806 01:06:54.694797 28822 webserver.cc:460] Webserver started at http://127.11.88.67:38985/ using document root <none> and password file <none>
I20260806 01:06:54.695008 28822 fs_manager.cc:359] Metadata directory not provided
I20260806 01:06:54.695052 28822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:06:54.696599 28822 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260806 01:06:54.697207 28837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:54.697368 28822 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:54.697458 28822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "f3ea836aee754d70909b1f7419609a35"
format_stamp: "Formatted at 2026-08-06 01:06:13 on dist-test-slave-69rg"
server_key: "f9a8463bc153e42ec96fee2c2ea281ba"
server_key_iv: "be31faa2d5255941ea757f35436bba00"
server_key_version: "encryptionkey@0"
I20260806 01:06:54.697860 28822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:06:54.705395 28822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:06:54.707690 28822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:06:54.707806 28822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:06:54.707993 28822 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:06:54.708320 28822 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:06:54.708356 28822 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:54.708379 28822 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:06:54.708427 28822 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:06:54.714648 28822 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:34375
I20260806 01:06:54.714754 28953 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:34375 every 8 connection(s)
I20260806 01:06:54.715086 28822 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
I20260806 01:06:54.716571 28956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:54.716025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.67:55573)
0806 01:06:54.716234 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:54.716371 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":112,"threads_started":1}
W20260806 01:06:54.716993 28954 heartbeater.cc:644] Failed to heartbeat to 127.11.88.126:44403 (0 consecutive failures): Network error: Failed to ping master at 127.11.88.126:44403: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
I20260806 01:06:54.717357 28956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:54.717235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.67:42343)
0806 01:06:54.717309 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:54.717337 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260806 01:06:54.717620 28956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:54.717573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.67:55571)
0806 01:06:54.717592 (+ 19us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:54.717610 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260806 01:06:54.717725 28954 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 01:06:54.720121 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 28822
I20260806 01:06:55.521517 28958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:55.521152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.65:56249)
0806 01:06:55.521351 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:55.521427 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":142,"threads_started":1}
I20260806 01:06:55.594882 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:55.594650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.66:46647)
0806 01:06:55.594783 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:55.594823 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":63,"threads_started":1}
I20260806 01:06:55.643635 28960 raft_consensus.cc:482] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:06:55.643831 28960 raft_consensus.cc:504] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } } peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } }
I20260806 01:06:55.644266 28960 leader_election.cc:288] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3ea836aee754d70909b1f7419609a35 (127.11.88.67:34375), 16238c4dfd83438ba8e70ae4ff7dd58f (127.11.88.66:40157)
Aug 06 01:06:55 dist-test-slave-69rg krb5kdc[27370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978414, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for kudu/127.11.88.67@KRBTEST.COM
Aug 06 01:06:55 dist-test-slave-69rg krb5kdc[27370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978414, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for kudu/127.11.88.66@KRBTEST.COM
I20260806 01:06:55.656301 28963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:55.644891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:48971 (local address 127.11.88.66:40157)
0806 01:06:55.645076 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 01:06:55.645085 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 01:06:55.645110 (+ 25us) server_negotiation.cc:407] Connection header received
0806 01:06:55.645538 (+ 428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:06:55.645540 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:06:55.645578 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:06:55.645785 (+ 207us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:06:55.646591 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:55.647513 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:55.648852 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:55.649276 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:55.649366 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:55.652514 (+ 3148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:06:55.652518 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:06:55.652518 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:06:55.652529 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:06:55.654372 (+ 1843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:06:55.654983 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:06:55.654986 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:06:55.654986 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:06:55.655073 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:06:55.655381 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:06:55.655382 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:06:55.655382 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:06:55.655626 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:06:55.655690 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 01:06:55.656027 (+ 337us) server_negotiation.cc:299] Negotiation successful
0806 01:06:55.656168 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":74,"threads_started":1}
I20260806 01:06:55.656286 28958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:55.644633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:34375 (local address 127.11.88.65:43515)
0806 01:06:55.644708 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:55.644724 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 01:06:55.644808 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:06:55.645777 (+ 969us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:06:55.645780 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:06:55.646237 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:06:55.646438 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:55.646445 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:55.647765 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:55.647766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:55.648753 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:55.648755 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:55.649440 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:55.649442 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:55.649521 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:55.650259 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:06:55.650269 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:06:55.651908 (+ 1639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:06:55.654450 (+ 2542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:06:55.654459 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:06:55.654461 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:06:55.654833 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:06:55.655131 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:06:55.655132 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:06:55.655133 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:06:55.655287 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:06:55.655787 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:06:55.655788 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:06:55.655860 (+ 72us) client_negotiation.cc:769] Sending connection context
0806 01:06:55.655974 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 01:06:55.656181 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":54}
I20260806 01:06:55.656347 28962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:55.644806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:43515 (local address 127.11.88.67:34375)
0806 01:06:55.644936 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0806 01:06:55.644949 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 01:06:55.644977 (+ 28us) server_negotiation.cc:407] Connection header received
0806 01:06:55.645476 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:06:55.645479 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:06:55.645539 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:06:55.645713 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:06:55.646596 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:55.647624 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:55.648853 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:06:55.649339 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:06:55.649462 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:55.652062 (+ 2600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:06:55.652066 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:06:55.652066 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:06:55.652078 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:06:55.654356 (+ 2278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:06:55.654926 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:06:55.654931 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:06:55.654931 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:06:55.655057 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:06:55.655362 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:06:55.655364 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:06:55.655364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:06:55.655698 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:06:55.655790 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 01:06:55.656039 (+ 249us) server_negotiation.cc:299] Negotiation successful
0806 01:06:55.656213 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":60,"threads_started":1}
I20260806 01:06:55.656769 28961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:55.644778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:40157 (local address 127.11.88.65:48971)
0806 01:06:55.644903 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:55.644915 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:06:55.644969 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:06:55.645777 (+ 808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:06:55.645781 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:06:55.646245 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:06:55.646438 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:55.646445 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:55.647638 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:55.647640 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:55.648753 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:06:55.648756 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:06:55.649382 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:06:55.649384 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:06:55.649520 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:06:55.650298 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:06:55.650303 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:06:55.652366 (+ 2063us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:06:55.654506 (+ 2140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:06:55.654508 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:06:55.654508 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:06:55.654884 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:06:55.655211 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:06:55.655212 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:06:55.655212 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:06:55.655290 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:06:55.655704 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:06:55.655712 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:06:55.655867 (+ 155us) client_negotiation.cc:769] Sending connection context
0806 01:06:55.655974 (+ 107us) client_negotiation.cc:240] Negotiation successful
0806 01:06:55.656270 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"mutex_wait_us":140,"thread_start_us":70,"threads_started":1}
W20260806 01:06:55.657285 28570 leader_election.cc:341] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f3ea836aee754d70909b1f7419609a35 (127.11.88.67:34375): Not found: Tablet not found: bf48caa367554bbdbb2f1eae40624bad
W20260806 01:06:55.658336 28570 leader_election.cc:341] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 16238c4dfd83438ba8e70ae4ff7dd58f (127.11.88.66:40157): Not found: Tablet not found: bf48caa367554bbdbb2f1eae40624bad
I20260806 01:06:55.658412 28570 leader_election.cc:302] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58a33330643446c5b5c29d0c3cab109e; no voters: 16238c4dfd83438ba8e70ae4ff7dd58f, f3ea836aee754d70909b1f7419609a35
I20260806 01:06:55.658595 28960 raft_consensus.cc:2726] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 01:06:55.718446 28964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:55.718190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.67:55061)
0806 01:06:55.718352 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:55.718400 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":65,"threads_started":1}
I20260806 01:06:56.522464 28965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:56.522185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.65:43835)
0806 01:06:56.522360 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:56.522413 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":74,"threads_started":1}
I20260806 01:06:56.595688 28966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:56.595451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.66:34617)
0806 01:06:56.595589 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:56.595635 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":65,"threads_started":1}
I20260806 01:06:56.719367 28967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:56.719071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.67:39935)
0806 01:06:56.719236 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:56.719298 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":69,"threads_started":1}
I20260806 01:06:57.163969 28968 raft_consensus.cc:482] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:06:57.164140 28968 raft_consensus.cc:504] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } } peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } }
I20260806 01:06:57.164350 28968 leader_election.cc:288] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3ea836aee754d70909b1f7419609a35 (127.11.88.67:34375), 16238c4dfd83438ba8e70ae4ff7dd58f (127.11.88.66:40157)
W20260806 01:06:57.164858 28570 leader_election.cc:341] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f3ea836aee754d70909b1f7419609a35 (127.11.88.67:34375): Not found: Tablet not found: bf48caa367554bbdbb2f1eae40624bad
W20260806 01:06:57.164927 28570 leader_election.cc:341] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 16238c4dfd83438ba8e70ae4ff7dd58f (127.11.88.66:40157): Not found: Tablet not found: bf48caa367554bbdbb2f1eae40624bad
I20260806 01:06:57.164943 28570 leader_election.cc:302] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58a33330643446c5b5c29d0c3cab109e; no voters: 16238c4dfd83438ba8e70ae4ff7dd58f, f3ea836aee754d70909b1f7419609a35
I20260806 01:06:57.165052 28968 raft_consensus.cc:2726] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 01:06:57.523440 28969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:57.523150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.65:44787)
0806 01:06:57.523314 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:57.523365 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":72,"threads_started":1}
I20260806 01:06:57.596561 28970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:57.596273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.66:33497)
0806 01:06:57.596464 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:57.596511 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":96,"threads_started":1}
I20260806 01:06:57.720412 28971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:57.720147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.67:55355)
0806 01:06:57.720306 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:57.720357 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":78,"threads_started":1}
I20260806 01:06:58.524371 28972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:58.524054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.65:37735)
0806 01:06:58.524264 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:58.524317 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":72,"threads_started":1}
I20260806 01:06:58.597448 28973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:58.597190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.66:50749)
0806 01:06:58.597348 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:58.597397 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":87,"threads_started":1}
I20260806 01:06:58.721262 28974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:58.721013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.67:54647)
0806 01:06:58.721166 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:58.721208 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":65,"threads_started":1}
I20260806 01:06:59.525329 28975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:59.525048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.65:56737)
0806 01:06:59.525231 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:59.525277 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":94,"threads_started":1}
I20260806 01:06:59.598265 28976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:59.598019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.66:44281)
0806 01:06:59.598167 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:59.598207 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":78,"threads_started":1}
I20260806 01:06:59.722221 28977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:06:59.721953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.67:57709)
0806 01:06:59.722111 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0806 01:06:59.722163 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":71,"threads_started":1}
I20260806 01:06:59.995373 28978 raft_consensus.cc:482] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:06:59.995482 28978 raft_consensus.cc:504] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } } peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } }
I20260806 01:06:59.995712 28978 leader_election.cc:288] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3ea836aee754d70909b1f7419609a35 (127.11.88.67:34375), 16238c4dfd83438ba8e70ae4ff7dd58f (127.11.88.66:40157)
W20260806 01:06:59.996165 28570 leader_election.cc:341] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f3ea836aee754d70909b1f7419609a35 (127.11.88.67:34375): Not found: Tablet not found: bf48caa367554bbdbb2f1eae40624bad
W20260806 01:06:59.996237 28570 leader_election.cc:341] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 16238c4dfd83438ba8e70ae4ff7dd58f (127.11.88.66:40157): Not found: Tablet not found: bf48caa367554bbdbb2f1eae40624bad
I20260806 01:06:59.996254 28570 leader_election.cc:302] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58a33330643446c5b5c29d0c3cab109e; no voters: 16238c4dfd83438ba8e70ae4ff7dd58f, f3ea836aee754d70909b1f7419609a35
I20260806 01:06:59.996328 28978 raft_consensus.cc:2726] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 01:07:00.526249 28979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:00.526011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.65:42631)
0806 01:07:00.526150 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:00.526196 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":70,"threads_started":1}
I20260806 01:07:00.599130 28980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:00.598863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.66:33679)
0806 01:07:00.599026 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:00.599075 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":74,"threads_started":1}
I20260806 01:07:00.723030 28981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:00.722785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.67:43887)
0806 01:07:00.722931 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:00.722977 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":70,"threads_started":1}
I20260806 01:07:01.527001 28982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:01.526745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.65:60193)
0806 01:07:01.526907 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:01.526950 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":71,"threads_started":1}
I20260806 01:07:01.600255 28983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:01.599945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.66:36453)
0806 01:07:01.600118 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:01.600188 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":107,"threads_started":1}
I20260806 01:07:01.723974 28984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:01.723709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.67:51945)
0806 01:07:01.723868 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:01.723920 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":69,"threads_started":1}
I20260806 01:07:01.897599 28985 raft_consensus.cc:482] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:07:01.897722 28985 raft_consensus.cc:504] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } } peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } }
I20260806 01:07:01.897960 28985 leader_election.cc:288] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3ea836aee754d70909b1f7419609a35 (127.11.88.67:34375), 16238c4dfd83438ba8e70ae4ff7dd58f (127.11.88.66:40157)
W20260806 01:07:01.898654 28570 leader_election.cc:341] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 16238c4dfd83438ba8e70ae4ff7dd58f (127.11.88.66:40157): Not found: Tablet not found: bf48caa367554bbdbb2f1eae40624bad
W20260806 01:07:01.898799 28570 leader_election.cc:341] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f3ea836aee754d70909b1f7419609a35 (127.11.88.67:34375): Not found: Tablet not found: bf48caa367554bbdbb2f1eae40624bad
I20260806 01:07:01.898842 28570 leader_election.cc:302] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58a33330643446c5b5c29d0c3cab109e; no voters: 16238c4dfd83438ba8e70ae4ff7dd58f, f3ea836aee754d70909b1f7419609a35
I20260806 01:07:01.898954 28985 raft_consensus.cc:2726] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 01:07:02.527844 28986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:02.527599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.65:54297)
0806 01:07:02.527747 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:02.527794 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":71,"threads_started":1}
I20260806 01:07:02.601038 28987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:02.600758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.66:48543)
0806 01:07:02.600948 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:02.600988 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":108,"threads_started":1}
I20260806 01:07:02.724979 28988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:02.724656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.67:37139)
0806 01:07:02.724873 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:02.724926 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":100,"threads_started":1}
I20260806 01:07:03.528604 28989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:03.528332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.65:35305)
0806 01:07:03.528508 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:03.528551 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":90,"threads_started":1}
I20260806 01:07:03.601943 28990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:03.601647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.66:60997)
0806 01:07:03.601791 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:03.601891 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":64,"threads_started":1}
I20260806 01:07:03.726083 28991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:03.725672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.67:54005)
0806 01:07:03.725942 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:03.726016 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":93,"threads_started":1}
I20260806 01:07:04.529666 28992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:04.529346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.65:50531)
0806 01:07:04.529514 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:04.529588 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":78,"threads_started":1}
I20260806 01:07:04.602703 28993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:04.602471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.66:44145)
0806 01:07:04.602602 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:04.602644 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":64,"threads_started":1}
I20260806 01:07:04.726986 28994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:04.726702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.67:52937)
0806 01:07:04.726880 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:04.726933 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":72,"threads_started":1}
I20260806 01:07:04.934513 28995 raft_consensus.cc:482] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:07:04.934677 28995 raft_consensus.cc:504] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3ea836aee754d70909b1f7419609a35" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34375 } } peers { permanent_uuid: "16238c4dfd83438ba8e70ae4ff7dd58f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 40157 } } peers { permanent_uuid: "58a33330643446c5b5c29d0c3cab109e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 41569 } }
I20260806 01:07:04.934966 28995 leader_election.cc:288] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3ea836aee754d70909b1f7419609a35 (127.11.88.67:34375), 16238c4dfd83438ba8e70ae4ff7dd58f (127.11.88.66:40157)
W20260806 01:07:04.935626 28570 leader_election.cc:341] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f3ea836aee754d70909b1f7419609a35 (127.11.88.67:34375): Not found: Tablet not found: bf48caa367554bbdbb2f1eae40624bad
W20260806 01:07:04.935986 28570 leader_election.cc:341] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 16238c4dfd83438ba8e70ae4ff7dd58f (127.11.88.66:40157): Not found: Tablet not found: bf48caa367554bbdbb2f1eae40624bad
I20260806 01:07:04.936177 28570 leader_election.cc:302] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58a33330643446c5b5c29d0c3cab109e; no voters: 16238c4dfd83438ba8e70ae4ff7dd58f, f3ea836aee754d70909b1f7419609a35
I20260806 01:07:04.936314 28995 raft_consensus.cc:2726] T bf48caa367554bbdbb2f1eae40624bad P 58a33330643446c5b5c29d0c3cab109e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 01:07:05.530617 28996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:05.530374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.65:56039)
0806 01:07:05.530516 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:05.530550 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":69,"threads_started":1}
I20260806 01:07:05.603470 28997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:05.603222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.66:40703)
0806 01:07:05.603374 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:05.603419 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":75,"threads_started":1}
I20260806 01:07:05.727926 28998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:05.727673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.67:44511)
0806 01:07:05.727829 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:05.727875 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":68,"threads_started":1}
I20260806 01:07:06.532017 28999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:06.531679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.65:40855)
0806 01:07:06.531913 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:06.531963 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":100,"threads_started":1}
I20260806 01:07:06.604303 29000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:06.604050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.66:59257)
0806 01:07:06.604206 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:06.604251 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":84,"threads_started":1}
I20260806 01:07:06.728894 29001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:06.728548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.67:51679)
0806 01:07:06.728800 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:06.728844 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":73,"threads_started":1}
I20260806 01:07:07.532902 29002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:07.532634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.65:33427)
0806 01:07:07.532814 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:07.532851 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":103,"threads_started":1}
I20260806 01:07:07.605296 29003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:07.604982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.66:41819)
0806 01:07:07.605169 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:07.605231 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":81,"threads_started":1}
I20260806 01:07:07.729806 29004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:07.729501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.67:60797)
0806 01:07:07.729703 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:07.729753 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":93,"threads_started":1}
I20260806 01:07:08.533977 29005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:08.533582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.65:56509)
0806 01:07:08.533810 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:08.533923 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":89,"threads_started":1}
I20260806 01:07:08.606302 29006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:08.605992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.66:53927)
0806 01:07:08.606182 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:08.606233 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":71,"threads_started":1}
I20260806 01:07:08.730873 29007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:08.730543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.67:42527)
0806 01:07:08.730768 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:08.730820 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":81,"threads_started":1}
I20260806 01:07:09.535019 29008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:09.534728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.65:43801)
0806 01:07:09.534907 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:09.534967 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":74,"threads_started":1}
I20260806 01:07:09.607161 29009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:09.606938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.66:53441)
0806 01:07:09.607074 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:09.607109 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":66,"threads_started":1}
I20260806 01:07:09.723647 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 28520
I20260806 01:07:09.732033 29010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:09.731783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:44403 (local address 127.11.88.67:34117)
0806 01:07:09.731931 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:09.731971 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.126:44403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":88,"threads_started":1}
I20260806 01:07:09.735635 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 28688
I20260806 01:07:09.744683 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 28822
2026-08-06T01:07:09Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58728 ms)
[----------] 30 tests from SecurityITest (243519 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:07:09 dist-test-slave-69rg krb5kdc[29013](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:07:09 dist-test-slave-69rg krb5kdc[29013](info): set up 2 sockets
Aug 06 01:07:09 dist-test-slave-69rg krb5kdc[29013](info): commencing operation
krb5kdc: starting...
W20260806 01:07:10.823781 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.056s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:07:10 dist-test-slave-69rg krb5kdc[29013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978430, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:07:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:07:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:07:10.971123 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:42647
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:41009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:42647
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:11.062381 29026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:11.062692 29026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:11.062740 29026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:11.064158 29026 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:11.064258 29026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:11.064283 29026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:11.064306 29026 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:11.064333 29026 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:11.066179 29026 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:41009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:42647
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:42647
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29026
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:11.066540 29026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:11.066819 29026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:11.072531 29032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:11.072533 29031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:11.072594 29026 server_base.cc:1034] running on GCE node
W20260806 01:07:11.072531 29034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:11.073338 29026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:11.074026 29026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:11.075269 29026 hybrid_clock.cc:648] HybridClock initialized: now 1785978431075246 us; error 44 us; skew 500 ppm
Aug 06 01:07:11 dist-test-slave-69rg krb5kdc[29013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978431, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:11.078195 29026 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:07:11.078825 29026 webserver.cc:460] Webserver started at http://127.11.88.126:35779/ using document root <none> and password file <none>
I20260806 01:07:11.079085 29026 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:11.079412 29026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:11.079598 29026 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:11.080848 29026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "49dee8844b05493695e750b5d8218a46"
format_stamp: "Formatted at 2026-08-06 01:07:11 on dist-test-slave-69rg"
server_key: "9839a67d59425de5708e448f3b88a9a2"
server_key_iv: "4ab96f64a341b1cb29c1ca5fd4c45e22"
server_key_version: "encryptionkey@0"
I20260806 01:07:11.081300 29026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "49dee8844b05493695e750b5d8218a46"
format_stamp: "Formatted at 2026-08-06 01:07:11 on dist-test-slave-69rg"
server_key: "9839a67d59425de5708e448f3b88a9a2"
server_key_iv: "4ab96f64a341b1cb29c1ca5fd4c45e22"
server_key_version: "encryptionkey@0"
I20260806 01:07:11.083649 29026 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260806 01:07:11.084848 29041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:11.085136 29026 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:11.085341 29026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "49dee8844b05493695e750b5d8218a46"
format_stamp: "Formatted at 2026-08-06 01:07:11 on dist-test-slave-69rg"
server_key: "9839a67d59425de5708e448f3b88a9a2"
server_key_iv: "4ab96f64a341b1cb29c1ca5fd4c45e22"
server_key_version: "encryptionkey@0"
I20260806 01:07:11.085445 29026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:11.104115 29026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:11.106976 29026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:11.107199 29026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:11.113380 29026 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:42647
I20260806 01:07:11.113423 29094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:42647 every 8 connection(s)
I20260806 01:07:11.113886 29026 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:07:11.114984 29095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:11.118088 29095 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49dee8844b05493695e750b5d8218a46: Bootstrap starting.
I20260806 01:07:11.118178 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 29026
I20260806 01:07:11.118297 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:07:11.118557 11617 external_mini_cluster.cc:1428] Setting key b2138c57736877cf5aa46ea511a28388
I20260806 01:07:11.118975 29095 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 49dee8844b05493695e750b5d8218a46: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:11.119501 29095 log.cc:824] T 00000000000000000000000000000000 P 49dee8844b05493695e750b5d8218a46: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:11.120417 29095 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49dee8844b05493695e750b5d8218a46: No bootstrap required, opened a new log
I20260806 01:07:11.123634 29095 raft_consensus.cc:348] T 00000000000000000000000000000000 P 49dee8844b05493695e750b5d8218a46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49dee8844b05493695e750b5d8218a46" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42647 } }
I20260806 01:07:11.123857 29095 raft_consensus.cc:374] T 00000000000000000000000000000000 P 49dee8844b05493695e750b5d8218a46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:11.123891 29095 raft_consensus.cc:729] T 00000000000000000000000000000000 P 49dee8844b05493695e750b5d8218a46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49dee8844b05493695e750b5d8218a46, State: Initialized, Role: FOLLOWER
I20260806 01:07:11.124030 29095 consensus_queue.cc:260] T 00000000000000000000000000000000 P 49dee8844b05493695e750b5d8218a46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49dee8844b05493695e750b5d8218a46" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42647 } }
I20260806 01:07:11.124114 29095 raft_consensus.cc:388] T 00000000000000000000000000000000 P 49dee8844b05493695e750b5d8218a46 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:07:11.124157 29095 raft_consensus.cc:482] T 00000000000000000000000000000000 P 49dee8844b05493695e750b5d8218a46 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:07:11.124226 29095 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 49dee8844b05493695e750b5d8218a46 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:11.125094 29095 raft_consensus.cc:504] T 00000000000000000000000000000000 P 49dee8844b05493695e750b5d8218a46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49dee8844b05493695e750b5d8218a46" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42647 } }
I20260806 01:07:11.125233 29095 leader_election.cc:302] T 00000000000000000000000000000000 P 49dee8844b05493695e750b5d8218a46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 49dee8844b05493695e750b5d8218a46; no voters:
I20260806 01:07:11.125466 29095 leader_election.cc:288] T 00000000000000000000000000000000 P 49dee8844b05493695e750b5d8218a46 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:07:11.125550 29100 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 49dee8844b05493695e750b5d8218a46 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:11.125761 29100 raft_consensus.cc:686] T 00000000000000000000000000000000 P 49dee8844b05493695e750b5d8218a46 [term 1 LEADER]: Becoming Leader. State: Replica: 49dee8844b05493695e750b5d8218a46, State: Running, Role: LEADER
I20260806 01:07:11.125849 29095 sys_catalog.cc:564] T 00000000000000000000000000000000 P 49dee8844b05493695e750b5d8218a46 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:11.125933 29100 consensus_queue.cc:237] T 00000000000000000000000000000000 P 49dee8844b05493695e750b5d8218a46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49dee8844b05493695e750b5d8218a46" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42647 } }
I20260806 01:07:11.126425 29101 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49dee8844b05493695e750b5d8218a46 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "49dee8844b05493695e750b5d8218a46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49dee8844b05493695e750b5d8218a46" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42647 } } }
I20260806 01:07:11.126413 29102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49dee8844b05493695e750b5d8218a46 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 49dee8844b05493695e750b5d8218a46. Latest consensus state: current_term: 1 leader_uuid: "49dee8844b05493695e750b5d8218a46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49dee8844b05493695e750b5d8218a46" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42647 } } }
I20260806 01:07:11.126515 29101 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49dee8844b05493695e750b5d8218a46 [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:11.126520 29102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49dee8844b05493695e750b5d8218a46 [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:11.126853 29107 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 06 01:07:11 dist-test-slave-69rg krb5kdc[29013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978430, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:07:11.127753 29107 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:07:11.129698 29107 catalog_manager.cc:1347] Generated new cluster ID: 0f17658778c648bda8e2cbd00dba799d
I20260806 01:07:11.129755 29107 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:07:11.132376 29098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:11.119332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40384 (local address 127.11.88.126:42647)
0806 01:07:11.119658 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:11.119669 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:11.119714 (+ 45us) server_negotiation.cc:407] Connection header received
0806 01:07:11.120399 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:11.120419 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:11.120526 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:11.120684 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:11.121795 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.122963 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.124164 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.124769 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.124863 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:11.128067 (+ 3204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:11.128072 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:11.128073 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:11.128087 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:11.130247 (+ 2160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:11.130707 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:11.130711 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:11.130711 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:11.130817 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:11.131033 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:11.131034 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:11.131034 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:11.131342 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:11.131507 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:11.131992 (+ 485us) server_negotiation.cc:299] Negotiation successful
0806 01:07:11.132141 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":109,"threads_started":1}
I20260806 01:07:11.136190 29107 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:07:11.136833 29107 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:07:11.142895 29107 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 49dee8844b05493695e750b5d8218a46: Generated new TSK 0
I20260806 01:07:11.143116 29107 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.88.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
I20260806 01:07:11.182442 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:0
--local_ip_for_outbound_sockets=127.11.88.65
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:42647
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:41009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:11.281675 29121 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:11.281972 29121 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:11.282006 29121 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:11.283360 29121 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:11.283414 29121 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:11.283445 29121 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:07:11.285075 29121 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:41009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:42647
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29121
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:11.285362 29121 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:11.285635 29121 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:11.291908 29126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:11.291927 29127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:11.292253 29129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:11.292629 29121 server_base.cc:1034] running on GCE node
I20260806 01:07:11.292876 29121 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:11.293157 29121 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:11.294337 29121 hybrid_clock.cc:648] HybridClock initialized: now 1785978431294321 us; error 30 us; skew 500 ppm
Aug 06 01:07:11 dist-test-slave-69rg krb5kdc[29013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978431, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:11.297276 29121 init.cc:377] Logged in from keytab as kudu/127.11.88.65@KRBTEST.COM (short username kudu)
I20260806 01:07:11.297955 29121 webserver.cc:460] Webserver started at http://127.11.88.65:39237/ using document root <none> and password file <none>
I20260806 01:07:11.298264 29121 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:11.298345 29121 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:11.298512 29121 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:11.299722 29121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-0/data/instance:
uuid: "df3ca434f0084c25bd184bcb50191d0e"
format_stamp: "Formatted at 2026-08-06 01:07:11 on dist-test-slave-69rg"
server_key: "40b9702705ef484c84e03a6ccfe99c66"
server_key_iv: "8f8c3117072bbf04309f6cf9d7f4ce78"
server_key_version: "encryptionkey@0"
I20260806 01:07:11.300143 29121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance:
uuid: "df3ca434f0084c25bd184bcb50191d0e"
format_stamp: "Formatted at 2026-08-06 01:07:11 on dist-test-slave-69rg"
server_key: "40b9702705ef484c84e03a6ccfe99c66"
server_key_iv: "8f8c3117072bbf04309f6cf9d7f4ce78"
server_key_version: "encryptionkey@0"
I20260806 01:07:11.301890 29121 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 01:07:11.302845 29136 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:11.303081 29121 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:07:11.303243 29121 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "df3ca434f0084c25bd184bcb50191d0e"
format_stamp: "Formatted at 2026-08-06 01:07:11 on dist-test-slave-69rg"
server_key: "40b9702705ef484c84e03a6ccfe99c66"
server_key_iv: "8f8c3117072bbf04309f6cf9d7f4ce78"
server_key_version: "encryptionkey@0"
I20260806 01:07:11.303339 29121 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:11.312609 29121 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:11.315140 29121 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:11.315325 29121 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:11.315606 29121 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:07:11.315945 29121 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:07:11.316004 29121 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:11.316048 29121 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:07:11.316071 29121 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:11.322467 29121 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:36161
I20260806 01:07:11.322546 29250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:36161 every 8 connection(s)
I20260806 01:07:11.322969 29121 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
Aug 06 01:07:11 dist-test-slave-69rg krb5kdc[29013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978431, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:07:11.332393 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 29121
I20260806 01:07:11.332546 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance
I20260806 01:07:11.332789 11617 external_mini_cluster.cc:1428] Setting key 6a935a0d2fc56266aeca1046e5c3b64c
I20260806 01:07:11.334661 29098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:11.323894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:42421 (local address 127.11.88.126:42647)
0806 01:07:11.323948 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:11.323950 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:11.324177 (+ 227us) server_negotiation.cc:407] Connection header received
0806 01:07:11.324703 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:11.324705 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:11.324717 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:11.324792 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:11.326137 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.326758 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.327897 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.328165 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.328232 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:11.330653 (+ 2421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:11.330655 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:11.330655 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:11.330670 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:11.332569 (+ 1899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:11.333220 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:11.333222 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:11.333222 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:11.333377 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:11.333787 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:11.333789 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:11.333789 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:11.333996 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:11.334080 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:11.334392 (+ 312us) server_negotiation.cc:299] Negotiation successful
0806 01:07:11.334510 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 01:07:11.334689 29253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:11.323838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42647 (local address 127.11.88.65:42421)
0806 01:07:11.324017 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:11.324064 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:11.324574 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:11.324879 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:11.324883 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:11.325594 (+ 711us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:11.325994 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:11.326002 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.326867 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.326868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:11.327794 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:11.327797 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.328258 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.328258 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:11.328377 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:11.328913 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:07:11.328922 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:11.330532 (+ 1610us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:11.332726 (+ 2194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:11.332736 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:11.332738 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:11.333116 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:11.333468 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:11.333469 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:11.333469 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:11.333645 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:11.334088 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:11.334095 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:11.334249 (+ 154us) client_negotiation.cc:769] Sending connection context
0806 01:07:11.334341 (+ 92us) client_negotiation.cc:240] Negotiation successful
0806 01:07:11.334495 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":101,"threads_started":1}
I20260806 01:07:11.335557 29251 heartbeater.cc:347] Connected to a master server at 127.11.88.126:42647
I20260806 01:07:11.335690 29251 heartbeater.cc:464] Registering TS with master...
I20260806 01:07:11.335950 29251 heartbeater.cc:511] Master 127.11.88.126:42647 requested a full tablet report, sending...
I20260806 01:07:11.336536 29058 ts_manager.cc:194] Registered new tserver with Master: df3ca434f0084c25bd184bcb50191d0e (127.11.88.65:36161)
I20260806 01:07:11.337219 29058 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.65@KRBTEST.COM'} at 127.11.88.65:42421
WARNING: no policy specified for kudu/127.11.88.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
I20260806 01:07:11.365473 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:0
--local_ip_for_outbound_sockets=127.11.88.66
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:42647
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:41009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:11.456108 29256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:11.456360 29256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:11.456387 29256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:11.457640 29256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:11.457698 29256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:11.457728 29256 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:07:11.459415 29256 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:41009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:42647
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:11.459712 29256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:11.459978 29256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:11.466037 29262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:11.466066 29264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:11.466095 29256 server_base.cc:1034] running on GCE node
W20260806 01:07:11.466037 29261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:11.466511 29256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:11.466779 29256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:11.467932 29256 hybrid_clock.cc:648] HybridClock initialized: now 1785978431467922 us; error 33 us; skew 500 ppm
Aug 06 01:07:11 dist-test-slave-69rg krb5kdc[29013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978431, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:11.470678 29256 init.cc:377] Logged in from keytab as kudu/127.11.88.66@KRBTEST.COM (short username kudu)
I20260806 01:07:11.471155 29256 webserver.cc:460] Webserver started at http://127.11.88.66:44845/ using document root <none> and password file <none>
I20260806 01:07:11.471449 29256 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:11.471501 29256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:11.471660 29256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:11.472785 29256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-1/data/instance:
uuid: "c65679cb8ed74ebeb55915ac0392da4f"
format_stamp: "Formatted at 2026-08-06 01:07:11 on dist-test-slave-69rg"
server_key: "50119ddb186db73cb61f5fea6db864d0"
server_key_iv: "ce61b392a83baad9f7ba4bd78740c20a"
server_key_version: "encryptionkey@0"
I20260806 01:07:11.473179 29256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance:
uuid: "c65679cb8ed74ebeb55915ac0392da4f"
format_stamp: "Formatted at 2026-08-06 01:07:11 on dist-test-slave-69rg"
server_key: "50119ddb186db73cb61f5fea6db864d0"
server_key_iv: "ce61b392a83baad9f7ba4bd78740c20a"
server_key_version: "encryptionkey@0"
I20260806 01:07:11.474793 29256 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 01:07:11.475652 29271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:11.475886 29256 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:07:11.476007 29256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "c65679cb8ed74ebeb55915ac0392da4f"
format_stamp: "Formatted at 2026-08-06 01:07:11 on dist-test-slave-69rg"
server_key: "50119ddb186db73cb61f5fea6db864d0"
server_key_iv: "ce61b392a83baad9f7ba4bd78740c20a"
server_key_version: "encryptionkey@0"
I20260806 01:07:11.476095 29256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:11.485404 29256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:11.488260 29256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:11.488447 29256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:11.488716 29256 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:07:11.489138 29256 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:07:11.489215 29256 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:11.489262 29256 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:07:11.489289 29256 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:11.495445 29256 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:36195
I20260806 01:07:11.495537 29385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:36195 every 8 connection(s)
I20260806 01:07:11.495893 29256 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
I20260806 01:07:11.502410 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 29256
I20260806 01:07:11.502580 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance
I20260806 01:07:11.502804 11617 external_mini_cluster.cc:1428] Setting key 7a3bb7f132479d169c3575c047924efa
Aug 06 01:07:11 dist-test-slave-69rg krb5kdc[29013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978431, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:07:11.507555 29098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:11.496825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:41827 (local address 127.11.88.126:42647)
0806 01:07:11.496891 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:11.496893 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:11.497115 (+ 222us) server_negotiation.cc:407] Connection header received
0806 01:07:11.497677 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:11.497678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:11.497690 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:11.497756 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:11.498858 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.499396 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.500457 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.500650 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.500716 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:11.503735 (+ 3019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:11.503737 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:11.503737 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:11.503747 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:11.505635 (+ 1888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:11.506377 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:11.506378 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:11.506379 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:11.506441 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:11.506780 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:11.506781 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:11.506782 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:11.506907 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:11.506962 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:11.507401 (+ 439us) server_negotiation.cc:299] Negotiation successful
0806 01:07:11.507484 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 01:07:11.507797 29388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:11.496788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42647 (local address 127.11.88.66:41827)
0806 01:07:11.496981 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:11.497020 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:11.497547 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:11.497880 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:11.497885 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:11.498541 (+ 656us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:11.498750 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:11.498755 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.499496 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.499496 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:11.500327 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:11.500330 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.500744 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.500745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:11.500865 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:11.501491 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:07:11.501499 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:11.503496 (+ 1997us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:11.505758 (+ 2262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:11.505771 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:11.505774 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:11.506292 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:11.506521 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:11.506522 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:11.506522 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:11.506693 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:11.506978 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:11.506993 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:11.507188 (+ 195us) client_negotiation.cc:769] Sending connection context
0806 01:07:11.507300 (+ 112us) client_negotiation.cc:240] Negotiation successful
0806 01:07:11.507506 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":123,"threads_started":1}
I20260806 01:07:11.508304 29386 heartbeater.cc:347] Connected to a master server at 127.11.88.126:42647
I20260806 01:07:11.508430 29386 heartbeater.cc:464] Registering TS with master...
I20260806 01:07:11.508635 29386 heartbeater.cc:511] Master 127.11.88.126:42647 requested a full tablet report, sending...
I20260806 01:07:11.509104 29058 ts_manager.cc:194] Registered new tserver with Master: c65679cb8ed74ebeb55915ac0392da4f (127.11.88.66:36195)
I20260806 01:07:11.509510 29058 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.66@KRBTEST.COM'} at 127.11.88.66:41827
WARNING: no policy specified for kudu/127.11.88.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
I20260806 01:07:11.533648 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:0
--local_ip_for_outbound_sockets=127.11.88.67
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:42647
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:41009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:11.619791 29391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:11.620054 29391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:11.620096 29391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:11.621372 29391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:11.621424 29391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:11.621454 29391 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:07:11.623059 29391 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:41009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:42647
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29391
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:11.623296 29391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:11.623499 29391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:11.628908 29399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:11.628917 29396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:11.628917 29397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:11.629241 29391 server_base.cc:1034] running on GCE node
I20260806 01:07:11.629472 29391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:11.629762 29391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:11.630981 29391 hybrid_clock.cc:648] HybridClock initialized: now 1785978431630987 us; error 47 us; skew 500 ppm
Aug 06 01:07:11 dist-test-slave-69rg krb5kdc[29013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978431, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:11.633535 29391 init.cc:377] Logged in from keytab as kudu/127.11.88.67@KRBTEST.COM (short username kudu)
I20260806 01:07:11.634014 29391 webserver.cc:460] Webserver started at http://127.11.88.67:35797/ using document root <none> and password file <none>
I20260806 01:07:11.634227 29391 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:11.634268 29391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:11.634361 29391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:11.635401 29391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-2/data/instance:
uuid: "0a1c5a68197a499388b5501341f19b19"
format_stamp: "Formatted at 2026-08-06 01:07:11 on dist-test-slave-69rg"
server_key: "ea61d77ac58c646edad634391b5e0585"
server_key_iv: "48ba5343009cca5eb13c3c377d8ef55e"
server_key_version: "encryptionkey@0"
I20260806 01:07:11.635792 29391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance:
uuid: "0a1c5a68197a499388b5501341f19b19"
format_stamp: "Formatted at 2026-08-06 01:07:11 on dist-test-slave-69rg"
server_key: "ea61d77ac58c646edad634391b5e0585"
server_key_iv: "48ba5343009cca5eb13c3c377d8ef55e"
server_key_version: "encryptionkey@0"
I20260806 01:07:11.637181 29391 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 01:07:11.637924 29406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:11.638090 29391 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:11.638186 29391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "0a1c5a68197a499388b5501341f19b19"
format_stamp: "Formatted at 2026-08-06 01:07:11 on dist-test-slave-69rg"
server_key: "ea61d77ac58c646edad634391b5e0585"
server_key_iv: "48ba5343009cca5eb13c3c377d8ef55e"
server_key_version: "encryptionkey@0"
I20260806 01:07:11.638252 29391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:11.660331 29391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:11.662923 29391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:11.663062 29391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:11.663270 29391 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:07:11.663631 29391 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:07:11.663677 29391 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:11.663727 29391 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:07:11.663753 29391 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:11.670284 29391 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:40759
I20260806 01:07:11.670326 29519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:40759 every 8 connection(s)
I20260806 01:07:11.670704 29391 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
Aug 06 01:07:11 dist-test-slave-69rg krb5kdc[29013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978431, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:07:11.679741 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 29391
I20260806 01:07:11.679876 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance
I20260806 01:07:11.680095 11617 external_mini_cluster.cc:1428] Setting key c04bfd50efa64e44f0fc1e1331742faf
I20260806 01:07:11.681630 29098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:11.671662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:40025 (local address 127.11.88.126:42647)
0806 01:07:11.671754 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:11.671758 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:11.671929 (+ 171us) server_negotiation.cc:407] Connection header received
0806 01:07:11.672482 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:11.672483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:11.672494 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:11.672564 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:11.673653 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.674293 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.675499 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.675742 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.675823 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:11.678246 (+ 2423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:11.678248 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:11.678248 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:11.678256 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:11.679887 (+ 1631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:11.680452 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:11.680455 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:11.680455 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:11.680526 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:11.680916 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:11.680917 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:11.680918 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:11.681074 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:11.681182 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:11.681482 (+ 300us) server_negotiation.cc:299] Negotiation successful
0806 01:07:11.681556 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 01:07:11.681826 29522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:11.671608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42647 (local address 127.11.88.67:40025)
0806 01:07:11.671786 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:11.671831 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:11.672381 (+ 550us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:11.672619 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:11.672622 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:11.673260 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:11.673525 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:11.673531 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.674454 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.674455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:11.675375 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:11.675378 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.675866 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.675867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:11.675988 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:11.676576 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:07:11.676585 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:11.678144 (+ 1559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:11.680000 (+ 1856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:11.680009 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:11.680011 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:11.680361 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:11.680638 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:11.680639 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:11.680640 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:11.680819 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:11.681163 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:11.681170 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:11.681346 (+ 176us) client_negotiation.cc:769] Sending connection context
0806 01:07:11.681455 (+ 109us) client_negotiation.cc:240] Negotiation successful
0806 01:07:11.681602 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":93,"threads_started":1}
I20260806 01:07:11.682346 29520 heartbeater.cc:347] Connected to a master server at 127.11.88.126:42647
I20260806 01:07:11.682451 29520 heartbeater.cc:464] Registering TS with master...
I20260806 01:07:11.682659 29520 heartbeater.cc:511] Master 127.11.88.126:42647 requested a full tablet report, sending...
I20260806 01:07:11.683080 29058 ts_manager.cc:194] Registered new tserver with Master: 0a1c5a68197a499388b5501341f19b19 (127.11.88.67:40759)
I20260806 01:07:11.683523 29058 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.67@KRBTEST.COM'} at 127.11.88.67:40025
I20260806 01:07:11.692358 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 01:07:11.700493 29098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:11.693935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40396 (local address 127.11.88.126:42647)
0806 01:07:11.694021 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:11.694023 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:11.694130 (+ 107us) server_negotiation.cc:407] Connection header received
0806 01:07:11.694214 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:11.694215 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:11.694226 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:11.694301 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:11.694900 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.695407 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.696193 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.696387 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.696466 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:11.697747 (+ 1281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:11.697749 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:11.697750 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:11.697756 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:11.699258 (+ 1502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:11.699630 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:11.699631 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:11.699631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:11.699694 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:11.699900 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:11.699901 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:11.699902 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:11.700076 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:11.700190 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:11.700293 (+ 103us) server_negotiation.cc:299] Negotiation successful
0806 01:07:11.700382 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 01:07:11.702234 29058 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40396:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 01:07:11.703933 29058 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:07:11.711447 29533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:11.706747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56650 (local address 127.11.88.66:36195)
0806 01:07:11.707333 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:11.707344 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:11.707373 (+ 29us) server_negotiation.cc:407] Connection header received
0806 01:07:11.707450 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:11.707453 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:11.707468 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:11.707549 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:11.707747 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.708808 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.710116 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.710913 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.710999 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:11.711071 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:11.711304 (+ 233us) server_negotiation.cc:299] Negotiation successful
0806 01:07:11.711351 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":97,"threads_started":1}
I20260806 01:07:11.711472 29535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:11.706824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:40759 (local address 127.0.0.1:34752)
0806 01:07:11.707656 (+ 832us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:11.707668 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:11.707729 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:11.707961 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:11.707962 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:11.707964 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:11.708004 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:11.708005 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.708918 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.708919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:11.710204 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:11.710206 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.711118 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.711119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:11.711188 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:11.711191 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:07:11.711300 (+ 109us) client_negotiation.cc:240] Negotiation successful
0806 01:07:11.711351 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":812,"mutex_wait_us":95,"thread_start_us":96,"threads_started":1}
I20260806 01:07:11.711860 29536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:11.707056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34752 (local address 127.11.88.67:40759)
0806 01:07:11.707284 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:11.707289 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:11.707795 (+ 506us) server_negotiation.cc:407] Connection header received
0806 01:07:11.707843 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:11.707845 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:11.707860 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:11.707952 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:11.708062 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.708794 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.710296 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.711037 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.711110 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:11.711164 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:11.711730 (+ 566us) server_negotiation.cc:299] Negotiation successful
0806 01:07:11.711782 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":120,"threads_started":1}
I20260806 01:07:11.711473 29531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:11.706598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:36195 (local address 127.0.0.1:56650)
0806 01:07:11.707034 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:11.707044 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:11.707100 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:11.707557 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:11.707558 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:11.707560 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:11.707625 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:11.707626 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.708915 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.708916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:11.710025 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:11.710028 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.711011 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.711012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:11.711103 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:11.711122 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 01:07:11.711271 (+ 149us) client_negotiation.cc:240] Negotiation successful
0806 01:07:11.711351 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":419,"mutex_wait_us":4,"thread_start_us":99,"threads_started":1}
I20260806 01:07:11.712393 29532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:11.706589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:36161 (local address 127.0.0.1:57836)
0806 01:07:11.706773 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:11.706821 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:11.706892 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:11.707243 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:11.707246 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:11.707249 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:11.707334 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:11.707336 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.708801 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.708802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:11.710199 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:11.710202 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.712146 (+ 1944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.712146 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:11.712230 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:11.712234 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:07:11.712289 (+ 55us) client_negotiation.cc:240] Negotiation successful
0806 01:07:11.712329 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":2,"thread_start_us":78,"threads_started":1}
I20260806 01:07:11.712469 29534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:11.706814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57836 (local address 127.11.88.65:36161)
0806 01:07:11.706993 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:11.706999 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:11.707013 (+ 14us) server_negotiation.cc:407] Connection header received
0806 01:07:11.707063 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:11.707065 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:11.707082 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:11.707173 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:11.707428 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.708668 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.711212 (+ 2544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.711968 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.712041 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:11.712107 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:11.712337 (+ 230us) server_negotiation.cc:299] Negotiation successful
0806 01:07:11.712390 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":95,"threads_started":1}
I20260806 01:07:11.712671 29454 tablet_service.cc:1467] Processing CreateTablet for tablet 369b9e353ea1429e9c57529a936c63c8 (DEFAULT_TABLE table=test-table [id=12546e97082b486793a7a7f889a6e26d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:07:11.713105 29454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 369b9e353ea1429e9c57529a936c63c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:11.713138 29184 tablet_service.cc:1467] Processing CreateTablet for tablet 369b9e353ea1429e9c57529a936c63c8 (DEFAULT_TABLE table=test-table [id=12546e97082b486793a7a7f889a6e26d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:07:11.713465 29184 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 369b9e353ea1429e9c57529a936c63c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:11.714733 29318 tablet_service.cc:1467] Processing CreateTablet for tablet 369b9e353ea1429e9c57529a936c63c8 (DEFAULT_TABLE table=test-table [id=12546e97082b486793a7a7f889a6e26d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:07:11.715111 29318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 369b9e353ea1429e9c57529a936c63c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:11.716799 29538 tablet_bootstrap.cc:492] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19: Bootstrap starting.
I20260806 01:07:11.717486 29538 tablet_bootstrap.cc:654] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:11.717975 29539 tablet_bootstrap.cc:492] T 369b9e353ea1429e9c57529a936c63c8 P c65679cb8ed74ebeb55915ac0392da4f: Bootstrap starting.
I20260806 01:07:11.717981 29537 tablet_bootstrap.cc:492] T 369b9e353ea1429e9c57529a936c63c8 P df3ca434f0084c25bd184bcb50191d0e: Bootstrap starting.
I20260806 01:07:11.718360 29538 log.cc:824] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:11.718669 29539 tablet_bootstrap.cc:654] T 369b9e353ea1429e9c57529a936c63c8 P c65679cb8ed74ebeb55915ac0392da4f: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:11.718669 29537 tablet_bootstrap.cc:654] T 369b9e353ea1429e9c57529a936c63c8 P df3ca434f0084c25bd184bcb50191d0e: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:11.719223 29538 tablet_bootstrap.cc:492] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19: No bootstrap required, opened a new log
I20260806 01:07:11.719317 29538 ts_tablet_manager.cc:1397] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260806 01:07:11.719336 29537 log.cc:824] T 369b9e353ea1429e9c57529a936c63c8 P df3ca434f0084c25bd184bcb50191d0e: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:11.719336 29539 log.cc:824] T 369b9e353ea1429e9c57529a936c63c8 P c65679cb8ed74ebeb55915ac0392da4f: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:11.720060 29537 tablet_bootstrap.cc:492] T 369b9e353ea1429e9c57529a936c63c8 P df3ca434f0084c25bd184bcb50191d0e: No bootstrap required, opened a new log
I20260806 01:07:11.720149 29537 ts_tablet_manager.cc:1397] T 369b9e353ea1429e9c57529a936c63c8 P df3ca434f0084c25bd184bcb50191d0e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 01:07:11.721017 29538 raft_consensus.cc:348] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c65679cb8ed74ebeb55915ac0392da4f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36195 } } peers { permanent_uuid: "0a1c5a68197a499388b5501341f19b19" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40759 } } peers { permanent_uuid: "df3ca434f0084c25bd184bcb50191d0e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 36161 } }
I20260806 01:07:11.721171 29538 raft_consensus.cc:374] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:11.721199 29538 raft_consensus.cc:729] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a1c5a68197a499388b5501341f19b19, State: Initialized, Role: FOLLOWER
I20260806 01:07:11.721330 29538 consensus_queue.cc:260] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c65679cb8ed74ebeb55915ac0392da4f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36195 } } peers { permanent_uuid: "0a1c5a68197a499388b5501341f19b19" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40759 } } peers { permanent_uuid: "df3ca434f0084c25bd184bcb50191d0e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 36161 } }
I20260806 01:07:11.721664 29538 ts_tablet_manager.cc:1428] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260806 01:07:11.721693 29520 heartbeater.cc:503] Master 127.11.88.126:42647 was elected leader, sending a full tablet report...
I20260806 01:07:11.722011 29537 raft_consensus.cc:348] T 369b9e353ea1429e9c57529a936c63c8 P df3ca434f0084c25bd184bcb50191d0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c65679cb8ed74ebeb55915ac0392da4f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36195 } } peers { permanent_uuid: "0a1c5a68197a499388b5501341f19b19" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40759 } } peers { permanent_uuid: "df3ca434f0084c25bd184bcb50191d0e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 36161 } }
I20260806 01:07:11.722208 29539 tablet_bootstrap.cc:492] T 369b9e353ea1429e9c57529a936c63c8 P c65679cb8ed74ebeb55915ac0392da4f: No bootstrap required, opened a new log
I20260806 01:07:11.722216 29537 raft_consensus.cc:374] T 369b9e353ea1429e9c57529a936c63c8 P df3ca434f0084c25bd184bcb50191d0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:11.722280 29539 ts_tablet_manager.cc:1397] T 369b9e353ea1429e9c57529a936c63c8 P c65679cb8ed74ebeb55915ac0392da4f: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260806 01:07:11.722287 29537 raft_consensus.cc:729] T 369b9e353ea1429e9c57529a936c63c8 P df3ca434f0084c25bd184bcb50191d0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df3ca434f0084c25bd184bcb50191d0e, State: Initialized, Role: FOLLOWER
I20260806 01:07:11.722401 29537 consensus_queue.cc:260] T 369b9e353ea1429e9c57529a936c63c8 P df3ca434f0084c25bd184bcb50191d0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c65679cb8ed74ebeb55915ac0392da4f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36195 } } peers { permanent_uuid: "0a1c5a68197a499388b5501341f19b19" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40759 } } peers { permanent_uuid: "df3ca434f0084c25bd184bcb50191d0e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 36161 } }
I20260806 01:07:11.722679 29537 ts_tablet_manager.cc:1428] T 369b9e353ea1429e9c57529a936c63c8 P df3ca434f0084c25bd184bcb50191d0e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260806 01:07:11.722818 29251 heartbeater.cc:503] Master 127.11.88.126:42647 was elected leader, sending a full tablet report...
I20260806 01:07:11.724238 29539 raft_consensus.cc:348] T 369b9e353ea1429e9c57529a936c63c8 P c65679cb8ed74ebeb55915ac0392da4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c65679cb8ed74ebeb55915ac0392da4f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36195 } } peers { permanent_uuid: "0a1c5a68197a499388b5501341f19b19" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40759 } } peers { permanent_uuid: "df3ca434f0084c25bd184bcb50191d0e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 36161 } }
I20260806 01:07:11.724381 29539 raft_consensus.cc:374] T 369b9e353ea1429e9c57529a936c63c8 P c65679cb8ed74ebeb55915ac0392da4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:11.724402 29539 raft_consensus.cc:729] T 369b9e353ea1429e9c57529a936c63c8 P c65679cb8ed74ebeb55915ac0392da4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c65679cb8ed74ebeb55915ac0392da4f, State: Initialized, Role: FOLLOWER
I20260806 01:07:11.724510 29539 consensus_queue.cc:260] T 369b9e353ea1429e9c57529a936c63c8 P c65679cb8ed74ebeb55915ac0392da4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c65679cb8ed74ebeb55915ac0392da4f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36195 } } peers { permanent_uuid: "0a1c5a68197a499388b5501341f19b19" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40759 } } peers { permanent_uuid: "df3ca434f0084c25bd184bcb50191d0e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 36161 } }
I20260806 01:07:11.724793 29539 ts_tablet_manager.cc:1428] T 369b9e353ea1429e9c57529a936c63c8 P c65679cb8ed74ebeb55915ac0392da4f: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260806 01:07:11.724828 29386 heartbeater.cc:503] Master 127.11.88.126:42647 was elected leader, sending a full tablet report...
W20260806 01:07:11.746526 29387 tablet.cc:2369] T 369b9e353ea1429e9c57529a936c63c8 P c65679cb8ed74ebeb55915ac0392da4f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 01:07:11.768996 29543 raft_consensus.cc:482] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:07:11.769199 29543 raft_consensus.cc:504] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c65679cb8ed74ebeb55915ac0392da4f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36195 } } peers { permanent_uuid: "0a1c5a68197a499388b5501341f19b19" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40759 } } peers { permanent_uuid: "df3ca434f0084c25bd184bcb50191d0e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 36161 } }
I20260806 01:07:11.769629 29543 leader_election.cc:288] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c65679cb8ed74ebeb55915ac0392da4f (127.11.88.66:36195), df3ca434f0084c25bd184bcb50191d0e (127.11.88.65:36161)
I20260806 01:07:11.772663 29522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:11.769846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:36161 (local address 127.11.88.67:34363)
0806 01:07:11.769912 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:11.769925 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:11.769974 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:11.770158 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:11.770159 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:11.770161 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:11.770250 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:11.770251 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.770923 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.770924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:11.771706 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:11.771709 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.772395 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.772396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:11.772478 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:11.772481 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:07:11.772547 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 01:07:11.772588 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260806 01:07:11.772665 29534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:11.769966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:34363 (local address 127.11.88.65:36161)
0806 01:07:11.770017 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:11.770019 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:11.770027 (+ 8us) server_negotiation.cc:407] Connection header received
0806 01:07:11.770060 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:11.770061 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:11.770069 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:11.770152 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:11.770331 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.770831 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.771812 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.772302 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.772385 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:11.772395 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:11.772554 (+ 159us) server_negotiation.cc:299] Negotiation successful
0806 01:07:11.772591 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260806 01:07:11.772807 29546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:11.769836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:36195 (local address 127.11.88.67:60429)
0806 01:07:11.770076 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:11.770086 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:11.770175 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:11.770330 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:11.770331 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:11.770332 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:11.770414 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:11.770421 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.771076 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.771078 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:11.771861 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:11.771863 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.772522 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.772523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:11.772613 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:11.772616 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:07:11.772683 (+ 67us) client_negotiation.cc:240] Negotiation successful
0806 01:07:11.772723 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":127,"threads_started":1}
I20260806 01:07:11.772795 29533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:11.769968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:60429 (local address 127.11.88.66:36195)
0806 01:07:11.770032 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:11.770034 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:11.770165 (+ 131us) server_negotiation.cc:407] Connection header received
0806 01:07:11.770235 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:11.770236 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:11.770246 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:11.770325 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:11.770492 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.770977 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.771957 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.772430 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.772521 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:11.772529 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:11.772689 (+ 160us) server_negotiation.cc:299] Negotiation successful
0806 01:07:11.772729 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 01:07:11.773051 29204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "369b9e353ea1429e9c57529a936c63c8" candidate_uuid: "0a1c5a68197a499388b5501341f19b19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df3ca434f0084c25bd184bcb50191d0e" is_pre_election: true
I20260806 01:07:11.773154 29339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "369b9e353ea1429e9c57529a936c63c8" candidate_uuid: "0a1c5a68197a499388b5501341f19b19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c65679cb8ed74ebeb55915ac0392da4f" is_pre_election: true
I20260806 01:07:11.773244 29204 raft_consensus.cc:2454] T 369b9e353ea1429e9c57529a936c63c8 P df3ca434f0084c25bd184bcb50191d0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a1c5a68197a499388b5501341f19b19 in term 0.
I20260806 01:07:11.773288 29339 raft_consensus.cc:2454] T 369b9e353ea1429e9c57529a936c63c8 P c65679cb8ed74ebeb55915ac0392da4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a1c5a68197a499388b5501341f19b19 in term 0.
I20260806 01:07:11.773489 29409 leader_election.cc:302] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a1c5a68197a499388b5501341f19b19, df3ca434f0084c25bd184bcb50191d0e; no voters:
I20260806 01:07:11.773679 29543 raft_consensus.cc:2781] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:07:11.773741 29543 raft_consensus.cc:482] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:07:11.773765 29543 raft_consensus.cc:3037] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:11.774461 29543 raft_consensus.cc:504] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c65679cb8ed74ebeb55915ac0392da4f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36195 } } peers { permanent_uuid: "0a1c5a68197a499388b5501341f19b19" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40759 } } peers { permanent_uuid: "df3ca434f0084c25bd184bcb50191d0e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 36161 } }
I20260806 01:07:11.774610 29543 leader_election.cc:288] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19 [CANDIDATE]: Term 1 election: Requested vote from peers c65679cb8ed74ebeb55915ac0392da4f (127.11.88.66:36195), df3ca434f0084c25bd184bcb50191d0e (127.11.88.65:36161)
I20260806 01:07:11.774765 29339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "369b9e353ea1429e9c57529a936c63c8" candidate_uuid: "0a1c5a68197a499388b5501341f19b19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c65679cb8ed74ebeb55915ac0392da4f"
I20260806 01:07:11.774794 29204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "369b9e353ea1429e9c57529a936c63c8" candidate_uuid: "0a1c5a68197a499388b5501341f19b19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df3ca434f0084c25bd184bcb50191d0e"
I20260806 01:07:11.774868 29339 raft_consensus.cc:3037] T 369b9e353ea1429e9c57529a936c63c8 P c65679cb8ed74ebeb55915ac0392da4f [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:11.774875 29204 raft_consensus.cc:3037] T 369b9e353ea1429e9c57529a936c63c8 P df3ca434f0084c25bd184bcb50191d0e [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:11.775657 29204 raft_consensus.cc:2454] T 369b9e353ea1429e9c57529a936c63c8 P df3ca434f0084c25bd184bcb50191d0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a1c5a68197a499388b5501341f19b19 in term 1.
I20260806 01:07:11.775676 29339 raft_consensus.cc:2454] T 369b9e353ea1429e9c57529a936c63c8 P c65679cb8ed74ebeb55915ac0392da4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a1c5a68197a499388b5501341f19b19 in term 1.
I20260806 01:07:11.775836 29409 leader_election.cc:302] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a1c5a68197a499388b5501341f19b19, df3ca434f0084c25bd184bcb50191d0e; no voters:
I20260806 01:07:11.775923 29543 raft_consensus.cc:2781] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:11.776175 29543 raft_consensus.cc:686] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19 [term 1 LEADER]: Becoming Leader. State: Replica: 0a1c5a68197a499388b5501341f19b19, State: Running, Role: LEADER
I20260806 01:07:11.776298 29543 consensus_queue.cc:237] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c65679cb8ed74ebeb55915ac0392da4f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36195 } } peers { permanent_uuid: "0a1c5a68197a499388b5501341f19b19" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40759 } } peers { permanent_uuid: "df3ca434f0084c25bd184bcb50191d0e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 36161 } }
I20260806 01:07:11.777303 29057 catalog_manager.cc:5495] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a1c5a68197a499388b5501341f19b19 (127.11.88.67). New cstate: current_term: 1 leader_uuid: "0a1c5a68197a499388b5501341f19b19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c65679cb8ed74ebeb55915ac0392da4f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a1c5a68197a499388b5501341f19b19" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 40759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df3ca434f0084c25bd184bcb50191d0e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 36161 } health_report { overall_health: UNKNOWN } } }
I20260806 01:07:11.785492 29536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:11.783052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34758 (local address 127.11.88.67:40759)
0806 01:07:11.783124 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:11.783126 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:11.783133 (+ 7us) server_negotiation.cc:407] Connection header received
0806 01:07:11.783167 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:11.783168 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:11.783186 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:11.783246 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:07:11.783414 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.783868 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.784672 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.784870 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.784932 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:11.785069 (+ 137us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:07:11.785213 (+ 144us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:07:11.785276 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:11.785324 (+ 48us) server_negotiation.cc:299] Negotiation successful
0806 01:07:11.785343 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 01:07:11.787477 29339 raft_consensus.cc:1261] T 369b9e353ea1429e9c57529a936c63c8 P c65679cb8ed74ebeb55915ac0392da4f [term 1 FOLLOWER]: Refusing update from remote peer 0a1c5a68197a499388b5501341f19b19: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:07:11.787503 29204 raft_consensus.cc:1261] T 369b9e353ea1429e9c57529a936c63c8 P df3ca434f0084c25bd184bcb50191d0e [term 1 FOLLOWER]: Refusing update from remote peer 0a1c5a68197a499388b5501341f19b19: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:07:11.787892 29543 consensus_queue.cc:1035] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df3ca434f0084c25bd184bcb50191d0e" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:07:11.788048 29547 consensus_queue.cc:1035] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65679cb8ed74ebeb55915ac0392da4f" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:07:11.790869 29550 mvcc.cc:205] Tried to move back new op lower bound from 7315367656598765568 to 7315367656556564480. Current Snapshot: MvccSnapshot[applied={T|T < 7315367656598765568}]
I20260806 01:07:11.791235 29552 mvcc.cc:205] Tried to move back new op lower bound from 7315367656598765568 to 7315367656556564480. Current Snapshot: MvccSnapshot[applied={T|T < 7315367656598765568}]
I20260806 01:07:11.791630 29551 mvcc.cc:205] Tried to move back new op lower bound from 7315367656598765568 to 7315367656556564480. Current Snapshot: MvccSnapshot[applied={T|T < 7315367656598765568}]
I20260806 01:07:11.794332 29057 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40396:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:07:11.794423 29057 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40396:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:07:11.795300 29057 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 49dee8844b05493695e750b5d8218a46: Sending DeleteTablet for 3 replicas of tablet 369b9e353ea1429e9c57529a936c63c8
I20260806 01:07:11.795646 29318 tablet_service.cc:1514] Processing DeleteTablet for tablet 369b9e353ea1429e9c57529a936c63c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:07:11 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:56650
I20260806 01:07:11.795663 29184 tablet_service.cc:1514] Processing DeleteTablet for tablet 369b9e353ea1429e9c57529a936c63c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:07:11 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:57836
I20260806 01:07:11.795886 29561 tablet_replica.cc:330] T 369b9e353ea1429e9c57529a936c63c8 P df3ca434f0084c25bd184bcb50191d0e: stopping tablet replica
I20260806 01:07:11.796034 29561 raft_consensus.cc:2229] T 369b9e353ea1429e9c57529a936c63c8 P df3ca434f0084c25bd184bcb50191d0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:07:11.796151 29561 raft_consensus.cc:2258] T 369b9e353ea1429e9c57529a936c63c8 P df3ca434f0084c25bd184bcb50191d0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:07:11.796212 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 29121
I20260806 01:07:11.798942 29454 tablet_service.cc:1514] Processing DeleteTablet for tablet 369b9e353ea1429e9c57529a936c63c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:07:11 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:34752
I20260806 01:07:11.799211 29563 tablet_replica.cc:330] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19: stopping tablet replica
I20260806 01:07:11.799319 29563 raft_consensus.cc:2229] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19 [term 1 LEADER]: Raft consensus shutting down.
I20260806 01:07:11.799446 29563 raft_consensus.cc:2258] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:07:11.799718 29562 tablet_replica.cc:330] T 369b9e353ea1429e9c57529a936c63c8 P c65679cb8ed74ebeb55915ac0392da4f: stopping tablet replica
I20260806 01:07:11.799880 29562 raft_consensus.cc:2229] T 369b9e353ea1429e9c57529a936c63c8 P c65679cb8ed74ebeb55915ac0392da4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:07:11.799963 29563 ts_tablet_manager.cc:1905] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:07:11.800032 29562 raft_consensus.cc:2258] T 369b9e353ea1429e9c57529a936c63c8 P c65679cb8ed74ebeb55915ac0392da4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:07:11.800549 29562 ts_tablet_manager.cc:1905] T 369b9e353ea1429e9c57529a936c63c8 P c65679cb8ed74ebeb55915ac0392da4f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:07:11.802116 29563 ts_tablet_manager.cc:1918] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:07:11.802250 29563 log.cc:1196] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-2/wal/wals/369b9e353ea1429e9c57529a936c63c8
I20260806 01:07:11.802630 29563 ts_tablet_manager.cc:1939] T 369b9e353ea1429e9c57529a936c63c8 P 0a1c5a68197a499388b5501341f19b19: Deleting consensus metadata
I20260806 01:07:11.802628 29562 ts_tablet_manager.cc:1918] T 369b9e353ea1429e9c57529a936c63c8 P c65679cb8ed74ebeb55915ac0392da4f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:07:11.802701 29562 log.cc:1196] T 369b9e353ea1429e9c57529a936c63c8 P c65679cb8ed74ebeb55915ac0392da4f: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785978186227899-11617-0/minicluster-data/ts-1/wal/wals/369b9e353ea1429e9c57529a936c63c8
I20260806 01:07:11.803040 29562 ts_tablet_manager.cc:1939] T 369b9e353ea1429e9c57529a936c63c8 P c65679cb8ed74ebeb55915ac0392da4f: Deleting consensus metadata
I20260806 01:07:11.803385 29045 catalog_manager.cc:4841] TS 0a1c5a68197a499388b5501341f19b19 (127.11.88.67:40759): tablet 369b9e353ea1429e9c57529a936c63c8 (table test-table [id=12546e97082b486793a7a7f889a6e26d]) successfully deleted
I20260806 01:07:11.803574 29045 catalog_manager.cc:4841] TS c65679cb8ed74ebeb55915ac0392da4f (127.11.88.66:36195): tablet 369b9e353ea1429e9c57529a936c63c8 (table test-table [id=12546e97082b486793a7a7f889a6e26d]) successfully deleted
W20260806 01:07:11.805262 29044 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.88.65:36161 (error 108)
I20260806 01:07:11.805497 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 29256
I20260806 01:07:11.806941 29532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:11.806805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:36161 (local address 127.0.0.1:57852)
0806 01:07:11.806861 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:11.806904 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.65:36161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260806 01:07:11.807108 29044 catalog_manager.cc:4584] TS df3ca434f0084c25bd184bcb50191d0e (127.11.88.65:36161): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 369b9e353ea1429e9c57529a936c63c8: Network error: Client connection negotiation failed: client connection to 127.11.88.65:36161: connect: Connection refused (error 111)
I20260806 01:07:11.814313 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 29391
I20260806 01:07:11.820550 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 29026
2026-08-06T01:07:11Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2075 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-06T01:07:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:07:11Z Disabled control of system clock
I20260806 01:07:11.852250 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:41757
--webserver_interface=127.11.88.126
--webserver_port=0
--builtin_ntp_servers=127.11.88.84:39947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:41757
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 01:07:11.934614 29568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:11.934893 29568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:11.934932 29568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:11.936129 29568 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:11.936225 29568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:11.936249 29568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:11.936280 29568 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:11.936306 29568 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:11.937844 29568 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:39947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:41757
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:41757
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29568
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:11.938179 29568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:11.938521 29568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:11.943943 29574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:11.943913 29576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:11.943924 29573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:11.944072 29568 server_base.cc:1034] running on GCE node
I20260806 01:07:11.944557 29568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:11.944909 29568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:11.946126 29568 hybrid_clock.cc:648] HybridClock initialized: now 1785978431946099 us; error 51 us; skew 500 ppm
I20260806 01:07:11.947543 29568 webserver.cc:460] Webserver started at http://127.11.88.126:43263/ using document root <none> and password file <none>
I20260806 01:07:11.947844 29568 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:11.947894 29568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:11.948077 29568 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:11.949178 29568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "b1933ef6c42040e39acf6f7b5b4d1d5c"
format_stamp: "Formatted at 2026-08-06 01:07:11 on dist-test-slave-69rg"
server_key: "188b2e27c85efd1ef3a863d40d0a1b7f"
server_key_iv: "fc6090cd63cdf5ebcc091c9e9e8afa8b"
server_key_version: "encryptionkey@0"
I20260806 01:07:11.949548 29568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "b1933ef6c42040e39acf6f7b5b4d1d5c"
format_stamp: "Formatted at 2026-08-06 01:07:11 on dist-test-slave-69rg"
server_key: "188b2e27c85efd1ef3a863d40d0a1b7f"
server_key_iv: "fc6090cd63cdf5ebcc091c9e9e8afa8b"
server_key_version: "encryptionkey@0"
I20260806 01:07:11.950899 29568 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:07:11.951664 29582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:11.951890 29568 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:11.951983 29568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "b1933ef6c42040e39acf6f7b5b4d1d5c"
format_stamp: "Formatted at 2026-08-06 01:07:11 on dist-test-slave-69rg"
server_key: "188b2e27c85efd1ef3a863d40d0a1b7f"
server_key_iv: "fc6090cd63cdf5ebcc091c9e9e8afa8b"
server_key_version: "encryptionkey@0"
I20260806 01:07:11.952047 29568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:11.969165 29568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:11.969497 29568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:11.969623 29568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:11.974246 29568 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:41757
I20260806 01:07:11.974327 29636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:41757 every 8 connection(s)
I20260806 01:07:11.974733 29568 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:07:11.975878 29637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:11.977506 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 29568
I20260806 01:07:11.977605 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:07:11.977873 11617 external_mini_cluster.cc:1428] Setting key 32a1040de274d734d98249fe27203155
I20260806 01:07:11.978971 29637 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1933ef6c42040e39acf6f7b5b4d1d5c: Bootstrap starting.
I20260806 01:07:11.979729 29637 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1933ef6c42040e39acf6f7b5b4d1d5c: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:11.980104 29637 log.cc:824] T 00000000000000000000000000000000 P b1933ef6c42040e39acf6f7b5b4d1d5c: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:11.980904 29637 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1933ef6c42040e39acf6f7b5b4d1d5c: No bootstrap required, opened a new log
I20260806 01:07:11.983299 29637 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1933ef6c42040e39acf6f7b5b4d1d5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1933ef6c42040e39acf6f7b5b4d1d5c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 41757 } }
I20260806 01:07:11.983439 29637 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1933ef6c42040e39acf6f7b5b4d1d5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:11.983462 29637 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1933ef6c42040e39acf6f7b5b4d1d5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1933ef6c42040e39acf6f7b5b4d1d5c, State: Initialized, Role: FOLLOWER
I20260806 01:07:11.983618 29637 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1933ef6c42040e39acf6f7b5b4d1d5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1933ef6c42040e39acf6f7b5b4d1d5c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 41757 } }
I20260806 01:07:11.983717 29637 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1933ef6c42040e39acf6f7b5b4d1d5c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:07:11.983767 29637 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1933ef6c42040e39acf6f7b5b4d1d5c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:07:11.983820 29637 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1933ef6c42040e39acf6f7b5b4d1d5c [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:11.984318 29640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:11.978577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51392 (local address 127.11.88.126:41757)
0806 01:07:11.978815 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:11.978825 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:11.978858 (+ 33us) server_negotiation.cc:407] Connection header received
0806 01:07:11.979476 (+ 618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:11.979485 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:11.979565 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:11.979731 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:11.979988 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.981323 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.982135 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:11.982782 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:11.982936 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:11.983607 (+ 671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:11.983611 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:11.983612 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:11.983832 (+ 220us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:11.983877 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:11.983892 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:11.983950 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:11.984025 (+ 75us) server_negotiation.cc:299] Negotiation successful
0806 01:07:11.984108 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":89,"threads_started":1}
I20260806 01:07:11.984622 29637 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1933ef6c42040e39acf6f7b5b4d1d5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1933ef6c42040e39acf6f7b5b4d1d5c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 41757 } }
I20260806 01:07:11.984750 29637 leader_election.cc:302] T 00000000000000000000000000000000 P b1933ef6c42040e39acf6f7b5b4d1d5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1933ef6c42040e39acf6f7b5b4d1d5c; no voters:
I20260806 01:07:11.984928 29637 leader_election.cc:288] T 00000000000000000000000000000000 P b1933ef6c42040e39acf6f7b5b4d1d5c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:07:11.984995 29642 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1933ef6c42040e39acf6f7b5b4d1d5c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:11.985185 29637 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1933ef6c42040e39acf6f7b5b4d1d5c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:11.985194 29642 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1933ef6c42040e39acf6f7b5b4d1d5c [term 1 LEADER]: Becoming Leader. State: Replica: b1933ef6c42040e39acf6f7b5b4d1d5c, State: Running, Role: LEADER
I20260806 01:07:11.985364 29642 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1933ef6c42040e39acf6f7b5b4d1d5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1933ef6c42040e39acf6f7b5b4d1d5c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 41757 } }
I20260806 01:07:11.985725 29644 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1933ef6c42040e39acf6f7b5b4d1d5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1933ef6c42040e39acf6f7b5b4d1d5c. Latest consensus state: current_term: 1 leader_uuid: "b1933ef6c42040e39acf6f7b5b4d1d5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1933ef6c42040e39acf6f7b5b4d1d5c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 41757 } } }
I20260806 01:07:11.985884 29644 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1933ef6c42040e39acf6f7b5b4d1d5c [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:11.985724 29643 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1933ef6c42040e39acf6f7b5b4d1d5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1933ef6c42040e39acf6f7b5b4d1d5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1933ef6c42040e39acf6f7b5b4d1d5c" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 41757 } } }
I20260806 01:07:11.986104 29651 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:07:11.986119 29643 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1933ef6c42040e39acf6f7b5b4d1d5c [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:11.986644 29651 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:07:11.988294 29651 catalog_manager.cc:1347] Generated new cluster ID: d351d188bf5348e193dba6a4b5f84eba
I20260806 01:07:11.988359 29651 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:07:11.999425 29651 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:07:12.000021 29651 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:07:12.007186 29651 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1933ef6c42040e39acf6f7b5b4d1d5c: Generated new TSK 0
I20260806 01:07:12.007450 29651 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:07:12.017673 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:0
--local_ip_for_outbound_sockets=127.11.88.65
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:41757
--builtin_ntp_servers=127.11.88.84:39947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 01:07:12.108006 29661 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:12.108248 29661 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:12.108274 29661 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:12.109565 29661 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:12.109618 29661 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:12.109647 29661 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:07:12.111332 29661 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:39947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:41757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29661
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:12.111675 29661 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:12.112082 29661 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:12.117935 29666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:12.117938 29669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:12.117938 29667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:12.118850 29661 server_base.cc:1034] running on GCE node
I20260806 01:07:12.119131 29661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:12.119436 29661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:12.120628 29661 hybrid_clock.cc:648] HybridClock initialized: now 1785978432120595 us; error 56 us; skew 500 ppm
I20260806 01:07:12.122543 29661 webserver.cc:460] Webserver started at http://127.11.88.65:44351/ using document root <none> and password file <none>
I20260806 01:07:12.122861 29661 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:12.122926 29661 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:12.123070 29661 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:12.124733 29661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-0/data/instance:
uuid: "b904bfb996b94955abcde5cb9e9894ed"
format_stamp: "Formatted at 2026-08-06 01:07:12 on dist-test-slave-69rg"
server_key: "5548e44c869180fb444dcd46fb5e884f"
server_key_iv: "5e13bed5f2f44bb0929617c03fdcbce9"
server_key_version: "encryptionkey@0"
I20260806 01:07:12.125221 29661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance:
uuid: "b904bfb996b94955abcde5cb9e9894ed"
format_stamp: "Formatted at 2026-08-06 01:07:12 on dist-test-slave-69rg"
server_key: "5548e44c869180fb444dcd46fb5e884f"
server_key_iv: "5e13bed5f2f44bb0929617c03fdcbce9"
server_key_version: "encryptionkey@0"
I20260806 01:07:12.127127 29661 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260806 01:07:12.128255 29675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:12.128475 29661 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:12.128579 29661 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "b904bfb996b94955abcde5cb9e9894ed"
format_stamp: "Formatted at 2026-08-06 01:07:12 on dist-test-slave-69rg"
server_key: "5548e44c869180fb444dcd46fb5e884f"
server_key_iv: "5e13bed5f2f44bb0929617c03fdcbce9"
server_key_version: "encryptionkey@0"
I20260806 01:07:12.128670 29661 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:12.147979 29661 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:12.148304 29661 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:12.148422 29661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:12.148648 29661 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:07:12.149130 29661 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:07:12.149171 29661 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:12.149194 29661 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:07:12.149207 29661 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:12.155628 29661 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:34259
I20260806 01:07:12.155710 29789 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:34259 every 8 connection(s)
I20260806 01:07:12.156067 29661 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
I20260806 01:07:12.161777 29640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:12.156927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:40483 (local address 127.11.88.126:41757)
0806 01:07:12.156997 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:12.156999 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:12.157252 (+ 253us) server_negotiation.cc:407] Connection header received
0806 01:07:12.157780 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:12.157782 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:12.157794 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:12.157961 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:12.158696 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.159227 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.160282 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.160482 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.160541 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:12.161468 (+ 927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:12.161470 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:12.161470 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:12.161474 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:12.161489 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:12.161494 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:12.161542 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:12.161663 (+ 121us) server_negotiation.cc:299] Negotiation successful
0806 01:07:12.161691 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 01:07:12.161934 29792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:12.156921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:41757 (local address 127.11.88.65:40483)
0806 01:07:12.157113 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:12.157155 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:12.157658 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:12.158059 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:12.158063 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:12.158072 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:12.158590 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:12.158595 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.159324 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.159325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:12.160180 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:12.160184 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.160568 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.160569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:12.160690 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:12.161328 (+ 638us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 01:07:12.161329 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:12.161358 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 01:07:12.161382 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:12.161578 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:12.161585 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:12.161588 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:07:12.161657 (+ 69us) client_negotiation.cc:240] Negotiation successful
0806 01:07:12.161747 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":92,"threads_started":1}
I20260806 01:07:12.162667 29790 heartbeater.cc:347] Connected to a master server at 127.11.88.126:41757
I20260806 01:07:12.162794 29790 heartbeater.cc:464] Registering TS with master...
I20260806 01:07:12.162995 29790 heartbeater.cc:511] Master 127.11.88.126:41757 requested a full tablet report, sending...
I20260806 01:07:12.163630 29599 ts_manager.cc:194] Registered new tserver with Master: b904bfb996b94955abcde5cb9e9894ed (127.11.88.65:34259)
I20260806 01:07:12.163810 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 29661
I20260806 01:07:12.163933 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance
I20260806 01:07:12.164144 11617 external_mini_cluster.cc:1428] Setting key 7f62ce66acbbaad16e67e76cd174a265
I20260806 01:07:12.164494 29599 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.88.65:40483
I20260806 01:07:12.165342 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:0
--local_ip_for_outbound_sockets=127.11.88.66
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:41757
--builtin_ntp_servers=127.11.88.84:39947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 01:07:12.249950 29793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:12.250219 29793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:12.250262 29793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:12.251574 29793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:12.251648 29793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:12.251694 29793 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:07:12.253196 29793 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:39947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:41757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29793
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:12.253510 29793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:12.253908 29793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:12.259711 29799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:12.259656 29793 server_base.cc:1034] running on GCE node
W20260806 01:07:12.259766 29801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:12.259657 29798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:12.260121 29793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:12.260397 29793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:12.261646 29793 hybrid_clock.cc:648] HybridClock initialized: now 1785978432261603 us; error 58 us; skew 500 ppm
I20260806 01:07:12.263356 29793 webserver.cc:460] Webserver started at http://127.11.88.66:46171/ using document root <none> and password file <none>
I20260806 01:07:12.263665 29793 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:12.263722 29793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:12.263870 29793 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:12.265111 29793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-1/data/instance:
uuid: "56a88f0d643e476fa638da8126ad1691"
format_stamp: "Formatted at 2026-08-06 01:07:12 on dist-test-slave-69rg"
server_key: "c363eca9065a46338277dedaf57e3da5"
server_key_iv: "3a725b6e5f2275ebea9c8f13aa7ed84e"
server_key_version: "encryptionkey@0"
I20260806 01:07:12.265501 29793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance:
uuid: "56a88f0d643e476fa638da8126ad1691"
format_stamp: "Formatted at 2026-08-06 01:07:12 on dist-test-slave-69rg"
server_key: "c363eca9065a46338277dedaf57e3da5"
server_key_iv: "3a725b6e5f2275ebea9c8f13aa7ed84e"
server_key_version: "encryptionkey@0"
I20260806 01:07:12.267127 29793 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.002s
I20260806 01:07:12.268059 29808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:12.268343 29793 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:12.268456 29793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "56a88f0d643e476fa638da8126ad1691"
format_stamp: "Formatted at 2026-08-06 01:07:12 on dist-test-slave-69rg"
server_key: "c363eca9065a46338277dedaf57e3da5"
server_key_iv: "3a725b6e5f2275ebea9c8f13aa7ed84e"
server_key_version: "encryptionkey@0"
I20260806 01:07:12.268535 29793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:12.282612 29793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:12.283005 29793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:12.283174 29793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:12.283430 29793 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:07:12.283792 29793 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:07:12.283847 29793 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:12.283885 29793 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:07:12.283928 29793 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:12.290131 29793 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:45457
I20260806 01:07:12.290207 29924 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:45457 every 8 connection(s)
I20260806 01:07:12.290555 29793 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
I20260806 01:07:12.291288 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 29793
I20260806 01:07:12.291447 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance
I20260806 01:07:12.291709 11617 external_mini_cluster.cc:1428] Setting key e949c6832c706c19a85df4f0df54178f
I20260806 01:07:12.292852 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:0
--local_ip_for_outbound_sockets=127.11.88.67
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:41757
--builtin_ntp_servers=127.11.88.84:39947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 01:07:12.296768 29640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:12.291334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:48231 (local address 127.11.88.126:41757)
0806 01:07:12.291428 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:12.291431 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:12.291597 (+ 166us) server_negotiation.cc:407] Connection header received
0806 01:07:12.292279 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:12.292280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:12.292293 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:12.292340 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:12.293173 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.293674 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.295095 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.295316 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.295390 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:12.296459 (+ 1069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:12.296461 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:12.296461 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:12.296467 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:12.296483 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:12.296494 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:12.296550 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:12.296673 (+ 123us) server_negotiation.cc:299] Negotiation successful
0806 01:07:12.296702 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 01:07:12.297152 29927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:12.291254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:41757 (local address 127.11.88.66:48231)
0806 01:07:12.291473 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:12.291518 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:12.292159 (+ 641us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:12.292411 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:12.292415 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:12.292425 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:12.293083 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:12.293090 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.293781 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.293782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:12.294927 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:12.294931 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.295426 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.295427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:12.295596 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:12.296289 (+ 693us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 01:07:12.296289 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:12.296330 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 01:07:12.296359 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:12.296562 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:12.296568 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:12.296571 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:07:12.296643 (+ 72us) client_negotiation.cc:240] Negotiation successful
0806 01:07:12.296775 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":91,"threads_started":1}
I20260806 01:07:12.297717 29925 heartbeater.cc:347] Connected to a master server at 127.11.88.126:41757
I20260806 01:07:12.297884 29925 heartbeater.cc:464] Registering TS with master...
I20260806 01:07:12.298132 29925 heartbeater.cc:511] Master 127.11.88.126:41757 requested a full tablet report, sending...
I20260806 01:07:12.298704 29598 ts_manager.cc:194] Registered new tserver with Master: 56a88f0d643e476fa638da8126ad1691 (127.11.88.66:45457)
I20260806 01:07:12.299146 29598 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.88.66:48231
W20260806 01:07:12.383971 29928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:12.384250 29928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:12.384289 29928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:12.385605 29928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:12.385672 29928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:12.385716 29928 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:07:12.387323 29928 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:39947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:41757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29928
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:12.387637 29928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:12.387985 29928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:12.393451 29934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:12.393460 29928 server_base.cc:1034] running on GCE node
W20260806 01:07:12.393469 29933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:12.393481 29936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:12.393994 29928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:12.394243 29928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:12.395419 29928 hybrid_clock.cc:648] HybridClock initialized: now 1785978432395402 us; error 35 us; skew 500 ppm
I20260806 01:07:12.396867 29928 webserver.cc:460] Webserver started at http://127.11.88.67:45993/ using document root <none> and password file <none>
I20260806 01:07:12.397207 29928 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:12.397260 29928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:12.397400 29928 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:12.398965 29928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-2/data/instance:
uuid: "b5b5b2b351124ab493967528edc29ea0"
format_stamp: "Formatted at 2026-08-06 01:07:12 on dist-test-slave-69rg"
server_key: "2b741fc240c73a7da93960ba0f53573b"
server_key_iv: "7cddf7d135c21fc0c3699fd87178dd66"
server_key_version: "encryptionkey@0"
I20260806 01:07:12.399381 29928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance:
uuid: "b5b5b2b351124ab493967528edc29ea0"
format_stamp: "Formatted at 2026-08-06 01:07:12 on dist-test-slave-69rg"
server_key: "2b741fc240c73a7da93960ba0f53573b"
server_key_iv: "7cddf7d135c21fc0c3699fd87178dd66"
server_key_version: "encryptionkey@0"
I20260806 01:07:12.400907 29928 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:07:12.401988 29942 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:12.402227 29928 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:12.402346 29928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "b5b5b2b351124ab493967528edc29ea0"
format_stamp: "Formatted at 2026-08-06 01:07:12 on dist-test-slave-69rg"
server_key: "2b741fc240c73a7da93960ba0f53573b"
server_key_iv: "7cddf7d135c21fc0c3699fd87178dd66"
server_key_version: "encryptionkey@0"
I20260806 01:07:12.402443 29928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:12.423265 29928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:12.423642 29928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:12.423813 29928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:12.424090 29928 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:07:12.424495 29928 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:07:12.424564 29928 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:12.424603 29928 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:07:12.424651 29928 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:12.431087 29928 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:42837
I20260806 01:07:12.431135 30057 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:42837 every 8 connection(s)
I20260806 01:07:12.431509 29928 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
I20260806 01:07:12.437098 29640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:12.432399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:40617 (local address 127.11.88.126:41757)
0806 01:07:12.432494 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:12.432497 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:12.432733 (+ 236us) server_negotiation.cc:407] Connection header received
0806 01:07:12.433347 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:12.433349 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:12.433361 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:12.433427 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:12.434201 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.434703 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.435727 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.435908 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.435960 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:12.436876 (+ 916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:12.436877 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:12.436877 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:12.436882 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:12.436896 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:12.436900 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:12.436943 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:12.437009 (+ 66us) server_negotiation.cc:299] Negotiation successful
0806 01:07:12.437033 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 01:07:12.437288 30060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:12.432360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:41757 (local address 127.11.88.67:40617)
0806 01:07:12.432564 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:12.432615 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:12.433235 (+ 620us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:12.433480 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:12.433484 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:12.433492 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:12.434110 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:12.434116 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.434805 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.434805 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:12.435641 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:12.435644 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.435985 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.435986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:12.436096 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:12.436735 (+ 639us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 01:07:12.436736 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:12.436765 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 01:07:12.436789 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:12.436943 (+ 154us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:12.436945 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:12.436948 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:07:12.436995 (+ 47us) client_negotiation.cc:240] Negotiation successful
0806 01:07:12.437074 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":96,"threads_started":1}
I20260806 01:07:12.437906 30058 heartbeater.cc:347] Connected to a master server at 127.11.88.126:41757
I20260806 01:07:12.438050 30058 heartbeater.cc:464] Registering TS with master...
I20260806 01:07:12.438249 30058 heartbeater.cc:511] Master 127.11.88.126:41757 requested a full tablet report, sending...
I20260806 01:07:12.438690 29598 ts_manager.cc:194] Registered new tserver with Master: b5b5b2b351124ab493967528edc29ea0 (127.11.88.67:42837)
I20260806 01:07:12.439080 29598 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.88.67:40617
I20260806 01:07:12.439759 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 29928
I20260806 01:07:12.439878 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance
I20260806 01:07:12.440081 11617 external_mini_cluster.cc:1428] Setting key 015e35e86aed105783134a9025797d11
I20260806 01:07:12.441227 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 01:07:12.446283 29640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:12.442814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51396 (local address 127.11.88.126:41757)
0806 01:07:12.442876 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:12.442878 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:12.442936 (+ 58us) server_negotiation.cc:407] Connection header received
0806 01:07:12.442977 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:12.442977 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:12.442986 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:12.443040 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:12.443454 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.443950 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.444843 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.445120 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.445182 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:12.446013 (+ 831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:12.446014 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:12.446015 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:12.446020 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:12.446035 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:12.446039 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:12.446092 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:12.446186 (+ 94us) server_negotiation.cc:299] Negotiation successful
0806 01:07:12.446218 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260806 01:07:12.447923 29598 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51396:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 01:07:12.449568 29598 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:07:12.456931 30066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:12.452177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:42837 (local address 127.0.0.1:37008)
0806 01:07:12.452355 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:12.452396 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:12.452462 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:12.452833 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:12.452836 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:12.452839 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:12.452925 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:12.452928 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.454055 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.454056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:12.455300 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:12.455303 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.456220 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.456221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:12.456398 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:12.456449 (+ 51us) client_negotiation.cc:769] Sending connection context
0806 01:07:12.456563 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 01:07:12.456791 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":65,"threads_started":1}
I20260806 01:07:12.457228 30069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:12.452394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:34259 (local address 127.0.0.1:53284)
0806 01:07:12.452717 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:12.452729 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:12.452778 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:12.453164 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:12.453165 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:12.453167 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:12.453204 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:12.453205 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.454517 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.454518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:12.455636 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:12.455638 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.456763 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.456765 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:12.456825 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:12.456829 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:07:12.456882 (+ 53us) client_negotiation.cc:240] Negotiation successful
0806 01:07:12.456928 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":89,"threads_started":1}
I20260806 01:07:12.457392 30068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:12.452313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37008 (local address 127.11.88.67:42837)
0806 01:07:12.452555 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:12.452560 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:12.452573 (+ 13us) server_negotiation.cc:407] Connection header received
0806 01:07:12.452660 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:12.452662 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:12.452681 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:12.453010 (+ 329us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:12.453072 (+ 62us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.453957 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.455408 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.456141 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.456215 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:12.456310 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:12.457154 (+ 844us) server_negotiation.cc:299] Negotiation successful
0806 01:07:12.457201 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":117,"threads_started":1}
I20260806 01:07:12.457494 30070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:12.452526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53284 (local address 127.11.88.65:34259)
0806 01:07:12.452905 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:12.452910 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:12.452919 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:07:12.452957 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:12.452959 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:12.452974 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:12.453042 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:12.453291 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.454439 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.455729 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.456461 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.456527 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:12.456611 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:12.456977 (+ 366us) server_negotiation.cc:299] Negotiation successful
0806 01:07:12.457397 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":86,"threads_started":1}
I20260806 01:07:12.458153 30067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:12.452189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:45457 (local address 127.0.0.1:57546)
0806 01:07:12.452572 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:12.452582 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:12.452655 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:12.452977 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:12.452978 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:12.452980 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:12.453052 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:12.453054 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.454460 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.454461 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:12.455500 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:12.455504 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.457842 (+ 2338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.457843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:12.457911 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:12.457914 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:07:12.458010 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 01:07:12.458073 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"mutex_wait_us":9,"thread_start_us":56,"threads_started":1}
I20260806 01:07:12.458177 30071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:12.452560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57546 (local address 127.11.88.66:45457)
0806 01:07:12.452762 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:12.452766 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:12.452776 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:07:12.452814 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:12.452816 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:12.452833 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:12.452903 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:12.453140 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.454340 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.455598 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.457619 (+ 2021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.457694 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:12.457780 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:12.458030 (+ 250us) server_negotiation.cc:299] Negotiation successful
0806 01:07:12.458098 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":81,"threads_started":1}
I20260806 01:07:12.458259 29724 tablet_service.cc:1467] Processing CreateTablet for tablet 6d1856d0ddf44465bf759a689837bc07 (DEFAULT_TABLE table=test-table [id=482feaeec57447a293232af5c6daf580]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:07:12.458259 29992 tablet_service.cc:1467] Processing CreateTablet for tablet 6d1856d0ddf44465bf759a689837bc07 (DEFAULT_TABLE table=test-table [id=482feaeec57447a293232af5c6daf580]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:07:12.458678 29992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d1856d0ddf44465bf759a689837bc07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:12.458688 29724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d1856d0ddf44465bf759a689837bc07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:12.458999 29858 tablet_service.cc:1467] Processing CreateTablet for tablet 6d1856d0ddf44465bf759a689837bc07 (DEFAULT_TABLE table=test-table [id=482feaeec57447a293232af5c6daf580]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:07:12.459275 29858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d1856d0ddf44465bf759a689837bc07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:12.462124 30072 tablet_bootstrap.cc:492] T 6d1856d0ddf44465bf759a689837bc07 P 56a88f0d643e476fa638da8126ad1691: Bootstrap starting.
I20260806 01:07:12.462440 30073 tablet_bootstrap.cc:492] T 6d1856d0ddf44465bf759a689837bc07 P b5b5b2b351124ab493967528edc29ea0: Bootstrap starting.
I20260806 01:07:12.462889 30072 tablet_bootstrap.cc:654] T 6d1856d0ddf44465bf759a689837bc07 P 56a88f0d643e476fa638da8126ad1691: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:12.463047 30073 tablet_bootstrap.cc:654] T 6d1856d0ddf44465bf759a689837bc07 P b5b5b2b351124ab493967528edc29ea0: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:12.463155 30072 log.cc:824] T 6d1856d0ddf44465bf759a689837bc07 P 56a88f0d643e476fa638da8126ad1691: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:12.463398 30073 log.cc:824] T 6d1856d0ddf44465bf759a689837bc07 P b5b5b2b351124ab493967528edc29ea0: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:12.463533 30074 tablet_bootstrap.cc:492] T 6d1856d0ddf44465bf759a689837bc07 P b904bfb996b94955abcde5cb9e9894ed: Bootstrap starting.
I20260806 01:07:12.464063 30072 tablet_bootstrap.cc:492] T 6d1856d0ddf44465bf759a689837bc07 P 56a88f0d643e476fa638da8126ad1691: No bootstrap required, opened a new log
I20260806 01:07:12.464143 30072 ts_tablet_manager.cc:1397] T 6d1856d0ddf44465bf759a689837bc07 P 56a88f0d643e476fa638da8126ad1691: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 01:07:12.464334 30073 tablet_bootstrap.cc:492] T 6d1856d0ddf44465bf759a689837bc07 P b5b5b2b351124ab493967528edc29ea0: No bootstrap required, opened a new log
I20260806 01:07:12.464401 30073 ts_tablet_manager.cc:1397] T 6d1856d0ddf44465bf759a689837bc07 P b5b5b2b351124ab493967528edc29ea0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 01:07:12.464532 30074 tablet_bootstrap.cc:654] T 6d1856d0ddf44465bf759a689837bc07 P b904bfb996b94955abcde5cb9e9894ed: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:12.464844 30074 log.cc:824] T 6d1856d0ddf44465bf759a689837bc07 P b904bfb996b94955abcde5cb9e9894ed: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:12.465545 30074 tablet_bootstrap.cc:492] T 6d1856d0ddf44465bf759a689837bc07 P b904bfb996b94955abcde5cb9e9894ed: No bootstrap required, opened a new log
I20260806 01:07:12.465641 30074 ts_tablet_manager.cc:1397] T 6d1856d0ddf44465bf759a689837bc07 P b904bfb996b94955abcde5cb9e9894ed: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 01:07:12.466936 30072 raft_consensus.cc:348] T 6d1856d0ddf44465bf759a689837bc07 P 56a88f0d643e476fa638da8126ad1691 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a88f0d643e476fa638da8126ad1691" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 45457 } } peers { permanent_uuid: "b5b5b2b351124ab493967528edc29ea0" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42837 } } peers { permanent_uuid: "b904bfb996b94955abcde5cb9e9894ed" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 34259 } }
I20260806 01:07:12.467131 30072 raft_consensus.cc:374] T 6d1856d0ddf44465bf759a689837bc07 P 56a88f0d643e476fa638da8126ad1691 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:12.467033 30073 raft_consensus.cc:348] T 6d1856d0ddf44465bf759a689837bc07 P b5b5b2b351124ab493967528edc29ea0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a88f0d643e476fa638da8126ad1691" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 45457 } } peers { permanent_uuid: "b5b5b2b351124ab493967528edc29ea0" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42837 } } peers { permanent_uuid: "b904bfb996b94955abcde5cb9e9894ed" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 34259 } }
I20260806 01:07:12.467170 30072 raft_consensus.cc:729] T 6d1856d0ddf44465bf759a689837bc07 P 56a88f0d643e476fa638da8126ad1691 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a88f0d643e476fa638da8126ad1691, State: Initialized, Role: FOLLOWER
I20260806 01:07:12.467185 30073 raft_consensus.cc:374] T 6d1856d0ddf44465bf759a689837bc07 P b5b5b2b351124ab493967528edc29ea0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:12.467219 30073 raft_consensus.cc:729] T 6d1856d0ddf44465bf759a689837bc07 P b5b5b2b351124ab493967528edc29ea0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5b5b2b351124ab493967528edc29ea0, State: Initialized, Role: FOLLOWER
I20260806 01:07:12.467336 30073 consensus_queue.cc:260] T 6d1856d0ddf44465bf759a689837bc07 P b5b5b2b351124ab493967528edc29ea0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a88f0d643e476fa638da8126ad1691" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 45457 } } peers { permanent_uuid: "b5b5b2b351124ab493967528edc29ea0" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42837 } } peers { permanent_uuid: "b904bfb996b94955abcde5cb9e9894ed" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 34259 } }
I20260806 01:07:12.467336 30072 consensus_queue.cc:260] T 6d1856d0ddf44465bf759a689837bc07 P 56a88f0d643e476fa638da8126ad1691 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a88f0d643e476fa638da8126ad1691" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 45457 } } peers { permanent_uuid: "b5b5b2b351124ab493967528edc29ea0" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42837 } } peers { permanent_uuid: "b904bfb996b94955abcde5cb9e9894ed" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 34259 } }
I20260806 01:07:12.467631 30073 ts_tablet_manager.cc:1428] T 6d1856d0ddf44465bf759a689837bc07 P b5b5b2b351124ab493967528edc29ea0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 01:07:12.467633 30072 ts_tablet_manager.cc:1428] T 6d1856d0ddf44465bf759a689837bc07 P 56a88f0d643e476fa638da8126ad1691: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260806 01:07:12.467760 29925 heartbeater.cc:503] Master 127.11.88.126:41757 was elected leader, sending a full tablet report...
I20260806 01:07:12.467811 30058 heartbeater.cc:503] Master 127.11.88.126:41757 was elected leader, sending a full tablet report...
I20260806 01:07:12.467974 30074 raft_consensus.cc:348] T 6d1856d0ddf44465bf759a689837bc07 P b904bfb996b94955abcde5cb9e9894ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a88f0d643e476fa638da8126ad1691" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 45457 } } peers { permanent_uuid: "b5b5b2b351124ab493967528edc29ea0" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42837 } } peers { permanent_uuid: "b904bfb996b94955abcde5cb9e9894ed" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 34259 } }
I20260806 01:07:12.468168 30074 raft_consensus.cc:374] T 6d1856d0ddf44465bf759a689837bc07 P b904bfb996b94955abcde5cb9e9894ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:12.468222 30074 raft_consensus.cc:729] T 6d1856d0ddf44465bf759a689837bc07 P b904bfb996b94955abcde5cb9e9894ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b904bfb996b94955abcde5cb9e9894ed, State: Initialized, Role: FOLLOWER
I20260806 01:07:12.468343 30074 consensus_queue.cc:260] T 6d1856d0ddf44465bf759a689837bc07 P b904bfb996b94955abcde5cb9e9894ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a88f0d643e476fa638da8126ad1691" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 45457 } } peers { permanent_uuid: "b5b5b2b351124ab493967528edc29ea0" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42837 } } peers { permanent_uuid: "b904bfb996b94955abcde5cb9e9894ed" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 34259 } }
I20260806 01:07:12.468640 29790 heartbeater.cc:503] Master 127.11.88.126:41757 was elected leader, sending a full tablet report...
I20260806 01:07:12.468878 30074 ts_tablet_manager.cc:1428] T 6d1856d0ddf44465bf759a689837bc07 P b904bfb996b94955abcde5cb9e9894ed: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260806 01:07:12.541265 29926 tablet.cc:2369] T 6d1856d0ddf44465bf759a689837bc07 P 56a88f0d643e476fa638da8126ad1691: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 01:07:12.656862 29791 tablet.cc:2369] T 6d1856d0ddf44465bf759a689837bc07 P b904bfb996b94955abcde5cb9e9894ed: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 01:07:12.682080 30059 tablet.cc:2369] T 6d1856d0ddf44465bf759a689837bc07 P b5b5b2b351124ab493967528edc29ea0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 01:07:12.834589 30080 raft_consensus.cc:482] T 6d1856d0ddf44465bf759a689837bc07 P b904bfb996b94955abcde5cb9e9894ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:07:12.834770 30080 raft_consensus.cc:504] T 6d1856d0ddf44465bf759a689837bc07 P b904bfb996b94955abcde5cb9e9894ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a88f0d643e476fa638da8126ad1691" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 45457 } } peers { permanent_uuid: "b5b5b2b351124ab493967528edc29ea0" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42837 } } peers { permanent_uuid: "b904bfb996b94955abcde5cb9e9894ed" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 34259 } }
I20260806 01:07:12.835282 30080 leader_election.cc:288] T 6d1856d0ddf44465bf759a689837bc07 P b904bfb996b94955abcde5cb9e9894ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56a88f0d643e476fa638da8126ad1691 (127.11.88.66:45457), b5b5b2b351124ab493967528edc29ea0 (127.11.88.67:42837)
I20260806 01:07:12.838547 30071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:12.835545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:38897 (local address 127.11.88.66:45457)
0806 01:07:12.835602 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:12.835604 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:12.835745 (+ 141us) server_negotiation.cc:407] Connection header received
0806 01:07:12.835812 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:12.835814 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:12.835827 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:12.835880 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:12.836072 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.836575 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.837651 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.838143 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.838230 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:12.838239 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:12.838423 (+ 184us) server_negotiation.cc:299] Negotiation successful
0806 01:07:12.838462 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260806 01:07:12.838547 30068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:12.835716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:58389 (local address 127.11.88.67:42837)
0806 01:07:12.835765 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:12.835767 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:12.835778 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:07:12.835836 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:12.835837 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:12.835853 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:12.835926 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:12.836134 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.836630 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.837649 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.838117 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.838263 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:12.838272 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:12.838421 (+ 149us) server_negotiation.cc:299] Negotiation successful
0806 01:07:12.838462 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260806 01:07:12.838608 30081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:12.835467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:45457 (local address 127.11.88.65:38897)
0806 01:07:12.835613 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:12.835627 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:12.835739 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:12.835900 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:12.835901 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:12.835904 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:12.835995 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:12.835998 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.836669 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.836670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:12.837535 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:12.837538 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.838250 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.838252 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:12.838340 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:12.838344 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:07:12.838417 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 01:07:12.838463 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":78,"threads_started":1}
I20260806 01:07:12.838621 30082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:12.835530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:42837 (local address 127.11.88.65:58389)
0806 01:07:12.835672 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:12.835685 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:12.835775 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:12.835947 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:12.835948 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:12.835950 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:12.836043 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:12.836045 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.836731 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.836732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:12.837536 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:12.837539 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.838265 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.838267 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:12.838337 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:12.838341 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:07:12.838414 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 01:07:12.838464 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":5,"thread_start_us":100,"threads_started":1}
I20260806 01:07:12.839224 29878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d1856d0ddf44465bf759a689837bc07" candidate_uuid: "b904bfb996b94955abcde5cb9e9894ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a88f0d643e476fa638da8126ad1691" is_pre_election: true
I20260806 01:07:12.839265 30012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d1856d0ddf44465bf759a689837bc07" candidate_uuid: "b904bfb996b94955abcde5cb9e9894ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5b5b2b351124ab493967528edc29ea0" is_pre_election: true
I20260806 01:07:12.839404 29878 raft_consensus.cc:2454] T 6d1856d0ddf44465bf759a689837bc07 P 56a88f0d643e476fa638da8126ad1691 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b904bfb996b94955abcde5cb9e9894ed in term 0.
I20260806 01:07:12.839430 30012 raft_consensus.cc:2454] T 6d1856d0ddf44465bf759a689837bc07 P b5b5b2b351124ab493967528edc29ea0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b904bfb996b94955abcde5cb9e9894ed in term 0.
I20260806 01:07:12.839697 29678 leader_election.cc:302] T 6d1856d0ddf44465bf759a689837bc07 P b904bfb996b94955abcde5cb9e9894ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a88f0d643e476fa638da8126ad1691, b904bfb996b94955abcde5cb9e9894ed; no voters:
I20260806 01:07:12.839893 30080 raft_consensus.cc:2781] T 6d1856d0ddf44465bf759a689837bc07 P b904bfb996b94955abcde5cb9e9894ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:07:12.839963 30080 raft_consensus.cc:482] T 6d1856d0ddf44465bf759a689837bc07 P b904bfb996b94955abcde5cb9e9894ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:07:12.840000 30080 raft_consensus.cc:3037] T 6d1856d0ddf44465bf759a689837bc07 P b904bfb996b94955abcde5cb9e9894ed [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:12.840786 30080 raft_consensus.cc:504] T 6d1856d0ddf44465bf759a689837bc07 P b904bfb996b94955abcde5cb9e9894ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a88f0d643e476fa638da8126ad1691" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 45457 } } peers { permanent_uuid: "b5b5b2b351124ab493967528edc29ea0" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42837 } } peers { permanent_uuid: "b904bfb996b94955abcde5cb9e9894ed" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 34259 } }
I20260806 01:07:12.840956 30080 leader_election.cc:288] T 6d1856d0ddf44465bf759a689837bc07 P b904bfb996b94955abcde5cb9e9894ed [CANDIDATE]: Term 1 election: Requested vote from peers 56a88f0d643e476fa638da8126ad1691 (127.11.88.66:45457), b5b5b2b351124ab493967528edc29ea0 (127.11.88.67:42837)
I20260806 01:07:12.841166 30012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d1856d0ddf44465bf759a689837bc07" candidate_uuid: "b904bfb996b94955abcde5cb9e9894ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5b5b2b351124ab493967528edc29ea0"
I20260806 01:07:12.841203 29878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d1856d0ddf44465bf759a689837bc07" candidate_uuid: "b904bfb996b94955abcde5cb9e9894ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56a88f0d643e476fa638da8126ad1691"
I20260806 01:07:12.841284 29878 raft_consensus.cc:3037] T 6d1856d0ddf44465bf759a689837bc07 P 56a88f0d643e476fa638da8126ad1691 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:12.841272 30012 raft_consensus.cc:3037] T 6d1856d0ddf44465bf759a689837bc07 P b5b5b2b351124ab493967528edc29ea0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:12.842304 29878 raft_consensus.cc:2454] T 6d1856d0ddf44465bf759a689837bc07 P 56a88f0d643e476fa638da8126ad1691 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b904bfb996b94955abcde5cb9e9894ed in term 1.
I20260806 01:07:12.842304 30012 raft_consensus.cc:2454] T 6d1856d0ddf44465bf759a689837bc07 P b5b5b2b351124ab493967528edc29ea0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b904bfb996b94955abcde5cb9e9894ed in term 1.
I20260806 01:07:12.842511 29678 leader_election.cc:302] T 6d1856d0ddf44465bf759a689837bc07 P b904bfb996b94955abcde5cb9e9894ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56a88f0d643e476fa638da8126ad1691, b904bfb996b94955abcde5cb9e9894ed; no voters:
I20260806 01:07:12.842624 30080 raft_consensus.cc:2781] T 6d1856d0ddf44465bf759a689837bc07 P b904bfb996b94955abcde5cb9e9894ed [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:12.842782 30080 raft_consensus.cc:686] T 6d1856d0ddf44465bf759a689837bc07 P b904bfb996b94955abcde5cb9e9894ed [term 1 LEADER]: Becoming Leader. State: Replica: b904bfb996b94955abcde5cb9e9894ed, State: Running, Role: LEADER
I20260806 01:07:12.842890 30080 consensus_queue.cc:237] T 6d1856d0ddf44465bf759a689837bc07 P b904bfb996b94955abcde5cb9e9894ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a88f0d643e476fa638da8126ad1691" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 45457 } } peers { permanent_uuid: "b5b5b2b351124ab493967528edc29ea0" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42837 } } peers { permanent_uuid: "b904bfb996b94955abcde5cb9e9894ed" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 34259 } }
I20260806 01:07:12.843801 29597 catalog_manager.cc:5495] T 6d1856d0ddf44465bf759a689837bc07 P b904bfb996b94955abcde5cb9e9894ed reported cstate change: term changed from 0 to 1, leader changed from <none> to b904bfb996b94955abcde5cb9e9894ed (127.11.88.65). New cstate: current_term: 1 leader_uuid: "b904bfb996b94955abcde5cb9e9894ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56a88f0d643e476fa638da8126ad1691" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 45457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5b5b2b351124ab493967528edc29ea0" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b904bfb996b94955abcde5cb9e9894ed" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 34259 } health_report { overall_health: HEALTHY } } }
I20260806 01:07:12.899497 30070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:12.897015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53286 (local address 127.11.88.65:34259)
0806 01:07:12.897063 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:12.897066 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:12.897076 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:07:12.897132 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:12.897132 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:12.897155 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:12.897245 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:07:12.897393 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.897906 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.898684 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:12.898883 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:12.898965 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:12.899140 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:07:12.899254 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:07:12.899354 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:12.899373 (+ 19us) server_negotiation.cc:299] Negotiation successful
0806 01:07:12.899395 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 01:07:12.901621 29878 raft_consensus.cc:1261] T 6d1856d0ddf44465bf759a689837bc07 P 56a88f0d643e476fa638da8126ad1691 [term 1 FOLLOWER]: Refusing update from remote peer b904bfb996b94955abcde5cb9e9894ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:07:12.901643 30012 raft_consensus.cc:1261] T 6d1856d0ddf44465bf759a689837bc07 P b5b5b2b351124ab493967528edc29ea0 [term 1 FOLLOWER]: Refusing update from remote peer b904bfb996b94955abcde5cb9e9894ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:07:12.902006 30080 consensus_queue.cc:1035] T 6d1856d0ddf44465bf759a689837bc07 P b904bfb996b94955abcde5cb9e9894ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5b5b2b351124ab493967528edc29ea0" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:07:12.902169 30083 consensus_queue.cc:1035] T 6d1856d0ddf44465bf759a689837bc07 P b904bfb996b94955abcde5cb9e9894ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56a88f0d643e476fa638da8126ad1691" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 45457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:07:12.904556 30087 mvcc.cc:205] Tried to move back new op lower bound from 7315367661161885696 to 7315367660925153280. Current Snapshot: MvccSnapshot[applied={T|T < 7315367661161885696}]
I20260806 01:07:12.906747 29598 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51396:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:07:12.906863 29598 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51396:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:07:12.907691 29598 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b1933ef6c42040e39acf6f7b5b4d1d5c: Sending DeleteTablet for 3 replicas of tablet 6d1856d0ddf44465bf759a689837bc07
I20260806 01:07:12.908026 29858 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d1856d0ddf44465bf759a689837bc07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:07:12 UTC) from {username='slave'} at 127.0.0.1:57546
I20260806 01:07:12.908026 29992 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d1856d0ddf44465bf759a689837bc07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:07:12 UTC) from {username='slave'} at 127.0.0.1:37008
I20260806 01:07:12.908321 29724 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d1856d0ddf44465bf759a689837bc07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:07:12 UTC) from {username='slave'} at 127.0.0.1:53284
I20260806 01:07:12.908401 30096 tablet_replica.cc:330] T 6d1856d0ddf44465bf759a689837bc07 P b5b5b2b351124ab493967528edc29ea0: stopping tablet replica
I20260806 01:07:12.908497 30096 raft_consensus.cc:2229] T 6d1856d0ddf44465bf759a689837bc07 P b5b5b2b351124ab493967528edc29ea0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:07:12.908609 30096 raft_consensus.cc:2258] T 6d1856d0ddf44465bf759a689837bc07 P b5b5b2b351124ab493967528edc29ea0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:07:12.908600 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 29661
I20260806 01:07:12.909637 30097 tablet_replica.cc:330] T 6d1856d0ddf44465bf759a689837bc07 P 56a88f0d643e476fa638da8126ad1691: stopping tablet replica
I20260806 01:07:12.909761 30097 raft_consensus.cc:2229] T 6d1856d0ddf44465bf759a689837bc07 P 56a88f0d643e476fa638da8126ad1691 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:07:12.909896 30097 raft_consensus.cc:2258] T 6d1856d0ddf44465bf759a689837bc07 P 56a88f0d643e476fa638da8126ad1691 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:07:12.911343 30096 ts_tablet_manager.cc:1905] T 6d1856d0ddf44465bf759a689837bc07 P b5b5b2b351124ab493967528edc29ea0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:07:12.913426 30096 ts_tablet_manager.cc:1918] T 6d1856d0ddf44465bf759a689837bc07 P b5b5b2b351124ab493967528edc29ea0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:07:12.913717 30096 log.cc:1196] T 6d1856d0ddf44465bf759a689837bc07 P b5b5b2b351124ab493967528edc29ea0: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785978186227899-11617-0/minicluster-data/ts-2/wal/wals/6d1856d0ddf44465bf759a689837bc07
I20260806 01:07:12.914094 30096 ts_tablet_manager.cc:1939] T 6d1856d0ddf44465bf759a689837bc07 P b5b5b2b351124ab493967528edc29ea0: Deleting consensus metadata
I20260806 01:07:12.914273 30097 ts_tablet_manager.cc:1905] T 6d1856d0ddf44465bf759a689837bc07 P 56a88f0d643e476fa638da8126ad1691: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:07:12.914707 29583 catalog_manager.cc:4841] TS b5b5b2b351124ab493967528edc29ea0 (127.11.88.67:42837): tablet 6d1856d0ddf44465bf759a689837bc07 (table test-table [id=482feaeec57447a293232af5c6daf580]) successfully deleted
W20260806 01:07:12.917129 29585 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.88.65:34259 (error 108)
I20260806 01:07:12.917176 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 29793
I20260806 01:07:12.919392 30067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:12.918820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:34259 (local address 127.0.0.1:53296)
0806 01:07:12.919300 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:12.919351 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.65:34259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":458}
W20260806 01:07:12.919647 29585 catalog_manager.cc:4584] TS b904bfb996b94955abcde5cb9e9894ed (127.11.88.65:34259): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6d1856d0ddf44465bf759a689837bc07: Network error: Client connection negotiation failed: client connection to 127.11.88.65:34259: connect: Connection refused (error 111)
I20260806 01:07:12.924432 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 29928
I20260806 01:07:12.924497 30067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:12.924351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:45457 (local address 127.0.0.1:57550)
0806 01:07:12.924408 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:12.924452 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.66:45457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260806 01:07:12.930438 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 29568
2026-08-06T01:07:12Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1109 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:07:12 dist-test-slave-69rg krb5kdc[30102](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:07:12 dist-test-slave-69rg krb5kdc[30102](info): set up 2 sockets
Aug 06 01:07:12 dist-test-slave-69rg krb5kdc[30102](info): commencing operation
krb5kdc: starting...
W20260806 01:07:13.998982 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.047s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:07:14 dist-test-slave-69rg krb5kdc[30102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978434, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:07:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:07:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:07:14.138803 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:35603
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:40397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:35603
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:14.222841 30116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:14.223129 30116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:14.223155 30116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:14.224398 30116 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:14.224447 30116 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:14.224462 30116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:14.224474 30116 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:14.224486 30116 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:14.226050 30116 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:35603
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:35603
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30116
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:14.226291 30116 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:14.226488 30116 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:14.231863 30122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:14.231854 30123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:14.231890 30116 server_base.cc:1034] running on GCE node
W20260806 01:07:14.231850 30125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:14.232405 30116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:14.232774 30116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:14.233954 30116 hybrid_clock.cc:648] HybridClock initialized: now 1785978434233934 us; error 47 us; skew 500 ppm
Aug 06 01:07:14 dist-test-slave-69rg krb5kdc[30102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978434, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:14.236676 30116 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:07:14.237120 30116 webserver.cc:460] Webserver started at http://127.11.88.126:41651/ using document root <none> and password file <none>
I20260806 01:07:14.237373 30116 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:14.237421 30116 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:14.237560 30116 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:14.238788 30116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "4938985f6e594769888c2930030089d6"
format_stamp: "Formatted at 2026-08-06 01:07:14 on dist-test-slave-69rg"
server_key: "5eae278aa1773d0ab66dc22849d2634e"
server_key_iv: "95c435a0ef747caf990d44cc10b64613"
server_key_version: "encryptionkey@0"
I20260806 01:07:14.239176 30116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "4938985f6e594769888c2930030089d6"
format_stamp: "Formatted at 2026-08-06 01:07:14 on dist-test-slave-69rg"
server_key: "5eae278aa1773d0ab66dc22849d2634e"
server_key_iv: "95c435a0ef747caf990d44cc10b64613"
server_key_version: "encryptionkey@0"
I20260806 01:07:14.240949 30116 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 01:07:14.242086 30132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:14.242377 30116 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:14.242496 30116 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "4938985f6e594769888c2930030089d6"
format_stamp: "Formatted at 2026-08-06 01:07:14 on dist-test-slave-69rg"
server_key: "5eae278aa1773d0ab66dc22849d2634e"
server_key_iv: "95c435a0ef747caf990d44cc10b64613"
server_key_version: "encryptionkey@0"
I20260806 01:07:14.242587 30116 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:14.263798 30116 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:14.266408 30116 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:14.266531 30116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:14.271131 30116 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:35603
I20260806 01:07:14.271164 30185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:35603 every 8 connection(s)
I20260806 01:07:14.271544 30116 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:07:14.272503 30186 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:14.274909 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 30116
I20260806 01:07:14.275018 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:07:14.275236 11617 external_mini_cluster.cc:1428] Setting key 74840da08b5d17209c47e80263f84964
I20260806 01:07:14.275435 30186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4938985f6e594769888c2930030089d6: Bootstrap starting.
I20260806 01:07:14.276345 30186 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4938985f6e594769888c2930030089d6: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:14.276724 30186 log.cc:824] T 00000000000000000000000000000000 P 4938985f6e594769888c2930030089d6: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:14.277555 30186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4938985f6e594769888c2930030089d6: No bootstrap required, opened a new log
I20260806 01:07:14.279845 30186 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4938985f6e594769888c2930030089d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4938985f6e594769888c2930030089d6" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 35603 } }
I20260806 01:07:14.280035 30186 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4938985f6e594769888c2930030089d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:14.280094 30186 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4938985f6e594769888c2930030089d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4938985f6e594769888c2930030089d6, State: Initialized, Role: FOLLOWER
I20260806 01:07:14.280260 30186 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4938985f6e594769888c2930030089d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4938985f6e594769888c2930030089d6" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 35603 } }
I20260806 01:07:14.280370 30186 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4938985f6e594769888c2930030089d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:07:14.280417 30186 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4938985f6e594769888c2930030089d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:07:14.280474 30186 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4938985f6e594769888c2930030089d6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:14.281172 30186 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4938985f6e594769888c2930030089d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4938985f6e594769888c2930030089d6" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 35603 } }
I20260806 01:07:14.281311 30186 leader_election.cc:302] T 00000000000000000000000000000000 P 4938985f6e594769888c2930030089d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4938985f6e594769888c2930030089d6; no voters:
I20260806 01:07:14.281548 30186 leader_election.cc:288] T 00000000000000000000000000000000 P 4938985f6e594769888c2930030089d6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:07:14.281585 30191 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4938985f6e594769888c2930030089d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:14.281714 30191 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4938985f6e594769888c2930030089d6 [term 1 LEADER]: Becoming Leader. State: Replica: 4938985f6e594769888c2930030089d6, State: Running, Role: LEADER
I20260806 01:07:14.281896 30186 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4938985f6e594769888c2930030089d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:14.281896 30191 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4938985f6e594769888c2930030089d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4938985f6e594769888c2930030089d6" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 35603 } }
I20260806 01:07:14.282356 30191 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4938985f6e594769888c2930030089d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4938985f6e594769888c2930030089d6. Latest consensus state: current_term: 1 leader_uuid: "4938985f6e594769888c2930030089d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4938985f6e594769888c2930030089d6" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 35603 } } }
Aug 06 01:07:14 dist-test-slave-69rg krb5kdc[30102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978434, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:07:14.282550 30191 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4938985f6e594769888c2930030089d6 [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:14.282810 30199 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:07:14.283624 30199 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:07:14.284430 30192 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4938985f6e594769888c2930030089d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4938985f6e594769888c2930030089d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4938985f6e594769888c2930030089d6" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 35603 } } }
I20260806 01:07:14.284607 30192 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4938985f6e594769888c2930030089d6 [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:14.285641 30199 catalog_manager.cc:1347] Generated new cluster ID: f3411e1620f4482e9ad1a5a3d65da23b
I20260806 01:07:14.285703 30199 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:07:14.287765 30189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:14.275825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45358 (local address 127.11.88.126:35603)
0806 01:07:14.276076 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:14.276086 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:14.276135 (+ 49us) server_negotiation.cc:407] Connection header received
0806 01:07:14.276859 (+ 724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:14.276871 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:14.276945 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:14.277110 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:14.277850 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.278786 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.279668 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.280156 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.280273 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:14.283277 (+ 3004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:14.283312 (+ 35us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:14.283312 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:14.283327 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:14.285641 (+ 2314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:14.286144 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:14.286147 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:14.286147 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:14.286253 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:14.286442 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:14.286443 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:14.286443 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:14.286740 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:14.286891 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:14.287404 (+ 513us) server_negotiation.cc:299] Negotiation successful
0806 01:07:14.287540 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":109,"threads_started":1}
I20260806 01:07:14.296589 30199 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:07:14.297263 30199 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:07:14.308877 30199 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4938985f6e594769888c2930030089d6: Generated new TSK 0
I20260806 01:07:14.309123 30199 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.88.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
I20260806 01:07:14.340901 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:0
--local_ip_for_outbound_sockets=127.11.88.65
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:35603
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:40397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:14.427598 30212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:14.427909 30212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:14.427942 30212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:14.429113 30212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:14.429152 30212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:14.429178 30212 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:07:14.430717 30212 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:35603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30212
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:14.430932 30212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:14.431116 30212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:14.436643 30218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:14.436599 30217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:14.436664 30220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:14.437114 30212 server_base.cc:1034] running on GCE node
I20260806 01:07:14.437310 30212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:14.437544 30212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:14.438717 30212 hybrid_clock.cc:648] HybridClock initialized: now 1785978434438704 us; error 32 us; skew 500 ppm
Aug 06 01:07:14 dist-test-slave-69rg krb5kdc[30102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978434, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:14.441277 30212 init.cc:377] Logged in from keytab as kudu/127.11.88.65@KRBTEST.COM (short username kudu)
I20260806 01:07:14.441888 30212 webserver.cc:460] Webserver started at http://127.11.88.65:45175/ using document root <none> and password file <none>
I20260806 01:07:14.442188 30212 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:14.442266 30212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:14.442435 30212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:14.443609 30212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-0/data/instance:
uuid: "1a836e2e162441059ad77dabaee43f67"
format_stamp: "Formatted at 2026-08-06 01:07:14 on dist-test-slave-69rg"
server_key: "1821160b7c1bd4036695a5e15f750202"
server_key_iv: "1d44227795c6a8b04683a3841937554e"
server_key_version: "encryptionkey@0"
I20260806 01:07:14.444101 30212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance:
uuid: "1a836e2e162441059ad77dabaee43f67"
format_stamp: "Formatted at 2026-08-06 01:07:14 on dist-test-slave-69rg"
server_key: "1821160b7c1bd4036695a5e15f750202"
server_key_iv: "1d44227795c6a8b04683a3841937554e"
server_key_version: "encryptionkey@0"
I20260806 01:07:14.445878 30212 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260806 01:07:14.446899 30227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:14.447126 30212 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:07:14.447245 30212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "1a836e2e162441059ad77dabaee43f67"
format_stamp: "Formatted at 2026-08-06 01:07:14 on dist-test-slave-69rg"
server_key: "1821160b7c1bd4036695a5e15f750202"
server_key_iv: "1d44227795c6a8b04683a3841937554e"
server_key_version: "encryptionkey@0"
I20260806 01:07:14.447345 30212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:14.491277 30212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:14.493580 30212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:14.493779 30212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:14.494096 30212 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:07:14.494458 30212 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:07:14.494521 30212 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:14.494571 30212 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:07:14.494596 30212 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:14.501120 30212 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:45191
I20260806 01:07:14.501212 30344 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:45191 every 8 connection(s)
I20260806 01:07:14.501582 30212 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
I20260806 01:07:14.507500 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 30212
I20260806 01:07:14.507599 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance
I20260806 01:07:14.507858 11617 external_mini_cluster.cc:1428] Setting key 320b3c215631fe294cbf8fcb755f2828
Aug 06 01:07:14 dist-test-slave-69rg krb5kdc[30102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978434, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:07:14.512320 30347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:14.502363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:35603 (local address 127.11.88.65:44945)
0806 01:07:14.502548 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:14.502593 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:14.503164 (+ 571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:14.503435 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:14.503439 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:14.504082 (+ 643us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:14.504288 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:14.504293 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.505069 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.505070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:14.506017 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:14.506019 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.506463 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.506464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:14.506608 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:14.507134 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:07:14.507144 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:14.508922 (+ 1778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:14.510898 (+ 1976us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:14.510906 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:14.510907 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:14.511150 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:14.511381 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:14.511382 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:14.511382 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:14.511490 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:14.511790 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:14.511795 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:14.511916 (+ 121us) client_negotiation.cc:769] Sending connection context
0806 01:07:14.512002 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 01:07:14.512140 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":81,"threads_started":1}
I20260806 01:07:14.512322 30189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:14.502371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:44945 (local address 127.11.88.126:35603)
0806 01:07:14.502419 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:14.502421 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:14.502691 (+ 270us) server_negotiation.cc:407] Connection header received
0806 01:07:14.503283 (+ 592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:14.503286 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:14.503299 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:14.503364 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:14.504401 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.504960 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.506114 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.506352 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.506449 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:14.509035 (+ 2586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:14.509037 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:14.509037 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:14.509045 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:14.510794 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:14.511231 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:14.511233 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:14.511233 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:14.511310 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:14.511559 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:14.511560 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:14.511561 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:14.511721 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:14.511796 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:14.512052 (+ 256us) server_negotiation.cc:299] Negotiation successful
0806 01:07:14.512173 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 01:07:14.512910 30345 heartbeater.cc:347] Connected to a master server at 127.11.88.126:35603
I20260806 01:07:14.513039 30345 heartbeater.cc:464] Registering TS with master...
I20260806 01:07:14.513273 30345 heartbeater.cc:511] Master 127.11.88.126:35603 requested a full tablet report, sending...
I20260806 01:07:14.513916 30149 ts_manager.cc:194] Registered new tserver with Master: 1a836e2e162441059ad77dabaee43f67 (127.11.88.65:45191)
I20260806 01:07:14.514557 30149 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.65@KRBTEST.COM'} at 127.11.88.65:44945
WARNING: no policy specified for kudu/127.11.88.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
I20260806 01:07:14.538117 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:0
--local_ip_for_outbound_sockets=127.11.88.66
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:35603
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:40397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:14.623994 30350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:14.624255 30350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:14.624293 30350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:14.625437 30350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:14.625516 30350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:14.625559 30350 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:07:14.627064 30350 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:35603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30350
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:14.627355 30350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:14.627590 30350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:14.632921 30356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:14.632936 30358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:14.632973 30350 server_base.cc:1034] running on GCE node
W20260806 01:07:14.632921 30355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:14.633455 30350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:14.633780 30350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:14.634979 30350 hybrid_clock.cc:648] HybridClock initialized: now 1785978434634946 us; error 52 us; skew 500 ppm
Aug 06 01:07:14 dist-test-slave-69rg krb5kdc[30102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978434, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:14.637915 30350 init.cc:377] Logged in from keytab as kudu/127.11.88.66@KRBTEST.COM (short username kudu)
I20260806 01:07:14.638489 30350 webserver.cc:460] Webserver started at http://127.11.88.66:33937/ using document root <none> and password file <none>
I20260806 01:07:14.638746 30350 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:14.638819 30350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:14.638986 30350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:14.640097 30350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-1/data/instance:
uuid: "58a912d983d5450487f3403722bc328d"
format_stamp: "Formatted at 2026-08-06 01:07:14 on dist-test-slave-69rg"
server_key: "77e95c46e4b264937ae0f96aab7d87d8"
server_key_iv: "17ab20d082415ca24ce281500d7d5d35"
server_key_version: "encryptionkey@0"
I20260806 01:07:14.640492 30350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance:
uuid: "58a912d983d5450487f3403722bc328d"
format_stamp: "Formatted at 2026-08-06 01:07:14 on dist-test-slave-69rg"
server_key: "77e95c46e4b264937ae0f96aab7d87d8"
server_key_iv: "17ab20d082415ca24ce281500d7d5d35"
server_key_version: "encryptionkey@0"
I20260806 01:07:14.641952 30350 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 01:07:14.642885 30365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:14.643118 30350 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:14.643266 30350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "58a912d983d5450487f3403722bc328d"
format_stamp: "Formatted at 2026-08-06 01:07:14 on dist-test-slave-69rg"
server_key: "77e95c46e4b264937ae0f96aab7d87d8"
server_key_iv: "17ab20d082415ca24ce281500d7d5d35"
server_key_version: "encryptionkey@0"
I20260806 01:07:14.643345 30350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:14.652561 30350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:14.654806 30350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:14.654974 30350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:14.655216 30350 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:07:14.655546 30350 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:07:14.655611 30350 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:14.655645 30350 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:07:14.655678 30350 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:14.661985 30350 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:44861
I20260806 01:07:14.662030 30481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:44861 every 8 connection(s)
I20260806 01:07:14.662461 30350 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
I20260806 01:07:14.663929 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 30350
I20260806 01:07:14.664063 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance
I20260806 01:07:14.664279 11617 external_mini_cluster.cc:1428] Setting key 5dc3766cce984eb950cad3408157adf2
Aug 06 01:07:14 dist-test-slave-69rg krb5kdc[30102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978434, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:07:14.673585 30189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:14.663280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:59191 (local address 127.11.88.126:35603)
0806 01:07:14.663331 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:14.663333 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:14.663517 (+ 184us) server_negotiation.cc:407] Connection header received
0806 01:07:14.664234 (+ 717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:14.664235 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:14.664245 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:14.664309 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:14.665640 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.666220 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.667477 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.667734 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.667806 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:14.670508 (+ 2702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:14.670509 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:14.670509 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:14.670518 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:14.671966 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:14.672517 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:14.672518 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:14.672518 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:14.672576 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:14.672878 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:14.672878 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:14.672879 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:14.672994 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:14.673046 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:14.673436 (+ 390us) server_negotiation.cc:299] Negotiation successful
0806 01:07:14.673515 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260806 01:07:14.673889 30484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:14.663219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:35603 (local address 127.11.88.66:59191)
0806 01:07:14.663386 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:14.663430 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:14.664121 (+ 691us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:14.664388 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:14.664393 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:14.665261 (+ 868us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:14.665538 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:14.665544 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.666312 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.666313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:14.667374 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:14.667377 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.667856 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.667857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:14.667969 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:14.668535 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:07:14.668543 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:14.670380 (+ 1837us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:14.672056 (+ 1676us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:14.672066 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:14.672069 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:14.672425 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:14.672650 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:14.672651 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:14.672652 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:14.672808 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:14.673065 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:14.673073 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:14.673277 (+ 204us) client_negotiation.cc:769] Sending connection context
0806 01:07:14.673413 (+ 136us) client_negotiation.cc:240] Negotiation successful
0806 01:07:14.673613 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":94,"threads_started":1}
WARNING: no policy specified for kudu/127.11.88.67@KRBTEST.COM; defaulting to no policy
I20260806 01:07:14.674440 30482 heartbeater.cc:347] Connected to a master server at 127.11.88.126:35603
I20260806 01:07:14.674577 30482 heartbeater.cc:464] Registering TS with master...
I20260806 01:07:14.674808 30482 heartbeater.cc:511] Master 127.11.88.126:35603 requested a full tablet report, sending...
I20260806 01:07:14.675282 30149 ts_manager.cc:194] Registered new tserver with Master: 58a912d983d5450487f3403722bc328d (127.11.88.66:44861)
I20260806 01:07:14.675688 30149 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.66@KRBTEST.COM'} at 127.11.88.66:59191
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
I20260806 01:07:14.693969 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:0
--local_ip_for_outbound_sockets=127.11.88.67
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:35603
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:40397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:14.782316 30487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:14.782612 30487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:14.782673 30487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:14.784065 30487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:14.784116 30487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:14.784143 30487 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:07:14.785674 30487 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:40397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:35603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30487
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:14.785954 30487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:14.786217 30487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 01:07:14.792080 30487 server_base.cc:1034] running on GCE node
W20260806 01:07:14.792057 30493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:14.792053 30492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:14.792354 30495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:14.792598 30487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:14.792882 30487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:14.794051 30487 hybrid_clock.cc:648] HybridClock initialized: now 1785978434794046 us; error 41 us; skew 500 ppm
Aug 06 01:07:14 dist-test-slave-69rg krb5kdc[30102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978434, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:14.796733 30487 init.cc:377] Logged in from keytab as kudu/127.11.88.67@KRBTEST.COM (short username kudu)
I20260806 01:07:14.797153 30487 webserver.cc:460] Webserver started at http://127.11.88.67:33151/ using document root <none> and password file <none>
I20260806 01:07:14.797389 30487 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:14.797434 30487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:14.797567 30487 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:14.798709 30487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-2/data/instance:
uuid: "068ed68fe0e94f7bb567f1eb6d64959f"
format_stamp: "Formatted at 2026-08-06 01:07:14 on dist-test-slave-69rg"
server_key: "23532dd98f196ddbe84c7fc8de2e3d6c"
server_key_iv: "05cd1c7673c8b6e84ac67a876e1065ea"
server_key_version: "encryptionkey@0"
I20260806 01:07:14.799094 30487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance:
uuid: "068ed68fe0e94f7bb567f1eb6d64959f"
format_stamp: "Formatted at 2026-08-06 01:07:14 on dist-test-slave-69rg"
server_key: "23532dd98f196ddbe84c7fc8de2e3d6c"
server_key_iv: "05cd1c7673c8b6e84ac67a876e1065ea"
server_key_version: "encryptionkey@0"
I20260806 01:07:14.800442 30487 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 01:07:14.801246 30502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:14.801424 30487 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 01:07:14.801532 30487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "068ed68fe0e94f7bb567f1eb6d64959f"
format_stamp: "Formatted at 2026-08-06 01:07:14 on dist-test-slave-69rg"
server_key: "23532dd98f196ddbe84c7fc8de2e3d6c"
server_key_iv: "05cd1c7673c8b6e84ac67a876e1065ea"
server_key_version: "encryptionkey@0"
I20260806 01:07:14.801605 30487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:14.822759 30487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:14.825472 30487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:14.825664 30487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:14.826056 30487 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:07:14.826431 30487 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:07:14.826493 30487 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:14.826545 30487 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:07:14.826581 30487 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:14.833545 30487 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:44445
I20260806 01:07:14.833598 30617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:44445 every 8 connection(s)
I20260806 01:07:14.834040 30487 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
I20260806 01:07:14.840583 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 30487
I20260806 01:07:14.840751 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance
I20260806 01:07:14.840965 11617 external_mini_cluster.cc:1428] Setting key 097907f3a53347f1c26655e2f4041746
Aug 06 01:07:14 dist-test-slave-69rg krb5kdc[30102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978434, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:07:14.844983 30189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:14.834918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:33591 (local address 127.11.88.126:35603)
0806 01:07:14.835180 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:14.835183 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:14.835357 (+ 174us) server_negotiation.cc:407] Connection header received
0806 01:07:14.835951 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:14.835953 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:14.835967 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:14.836028 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:14.837057 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.837586 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.838693 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.838905 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.839001 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:14.841960 (+ 2959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:14.841961 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:14.841962 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:14.841971 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:14.843383 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:14.843878 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:14.843879 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:14.843879 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:14.843950 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:14.844244 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:14.844245 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:14.844245 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:14.844380 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:14.844460 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:14.844769 (+ 309us) server_negotiation.cc:299] Negotiation successful
0806 01:07:14.844864 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225}
I20260806 01:07:14.845220 30620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:14.834834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:35603 (local address 127.11.88.67:33591)
0806 01:07:14.835193 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:14.835252 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:14.835830 (+ 578us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:14.836108 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:14.836112 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:14.836727 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:14.836939 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:14.836945 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.837719 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.837720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:14.838576 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:14.838578 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.839019 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.839020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:14.839169 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:14.839857 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:07:14.839866 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:14.841822 (+ 1956us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:14.843513 (+ 1691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:14.843523 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:14.843525 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:14.843790 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:14.844030 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:14.844031 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:14.844031 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:14.844164 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:14.844450 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:14.844458 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:14.844625 (+ 167us) client_negotiation.cc:769] Sending connection context
0806 01:07:14.844745 (+ 120us) client_negotiation.cc:240] Negotiation successful
0806 01:07:14.844947 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":114,"threads_started":1}
I20260806 01:07:14.845897 30618 heartbeater.cc:347] Connected to a master server at 127.11.88.126:35603
I20260806 01:07:14.846001 30618 heartbeater.cc:464] Registering TS with master...
I20260806 01:07:14.846216 30618 heartbeater.cc:511] Master 127.11.88.126:35603 requested a full tablet report, sending...
I20260806 01:07:14.846692 30149 ts_manager.cc:194] Registered new tserver with Master: 068ed68fe0e94f7bb567f1eb6d64959f (127.11.88.67:44445)
I20260806 01:07:14.847107 30149 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.67@KRBTEST.COM'} at 127.11.88.67:33591
I20260806 01:07:14.853432 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 01:07:14.861654 30189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:14.855076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45362 (local address 127.11.88.126:35603)
0806 01:07:14.855147 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:14.855149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:14.855169 (+ 20us) server_negotiation.cc:407] Connection header received
0806 01:07:14.855245 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:14.855245 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:14.855256 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:14.855321 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:14.855889 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.856392 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.857121 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.857317 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.857378 (+ 61us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:14.858874 (+ 1496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:14.858875 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:14.858875 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:14.858882 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:14.860299 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:14.860751 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:14.860753 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:14.860753 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:14.860831 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:14.861067 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:14.861068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:14.861068 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:14.861228 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:14.861319 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:14.861510 (+ 191us) server_negotiation.cc:299] Negotiation successful
0806 01:07:14.861566 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 01:07:14.863981 30149 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45362:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 01:07:14.865805 30149 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:07:14.873366 30634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:14.869306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45784 (local address 127.11.88.66:44861)
0806 01:07:14.869518 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:14.869523 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:14.869534 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:07:14.869576 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:14.869578 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:14.869594 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:14.869692 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:14.869911 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.870747 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.872219 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.872894 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.872984 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:14.873054 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:14.873225 (+ 171us) server_negotiation.cc:299] Negotiation successful
0806 01:07:14.873269 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":97,"threads_started":1}
I20260806 01:07:14.873358 30629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:14.869070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:44861 (local address 127.0.0.1:45784)
0806 01:07:14.869311 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:14.869322 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:14.869366 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:14.869708 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:14.869712 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:14.869714 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:14.869802 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:14.869805 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.870856 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.870857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:14.872113 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:14.872116 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.872997 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.872998 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:14.873087 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:14.873110 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 01:07:14.873207 (+ 97us) client_negotiation.cc:240] Negotiation successful
0806 01:07:14.873267 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":79,"threads_started":1}
I20260806 01:07:14.873607 30632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:14.868837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:44445 (local address 127.0.0.1:43512)
0806 01:07:14.869320 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:14.869334 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:14.869418 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:14.869776 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:14.869777 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:14.869779 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:14.869857 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:14.869859 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.871236 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.871237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:14.872330 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:14.872332 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.873347 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.873348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:14.873414 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:14.873418 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:07:14.873468 (+ 50us) client_negotiation.cc:240] Negotiation successful
0806 01:07:14.873513 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"mutex_wait_us":44,"spinlock_wait_cycles":768,"thread_start_us":124,"threads_started":1}
I20260806 01:07:14.873806 30631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:14.869006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58976 (local address 127.11.88.65:45191)
0806 01:07:14.869951 (+ 945us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:14.869956 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:14.869967 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:07:14.870015 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:14.870018 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:14.870033 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:14.870115 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:14.870239 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.871334 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.872557 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.873294 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.873358 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:14.873411 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:14.873655 (+ 244us) server_negotiation.cc:299] Negotiation successful
0806 01:07:14.873708 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":901,"thread_start_us":175,"threads_started":1}
I20260806 01:07:14.873979 30633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:14.869049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43512 (local address 127.11.88.67:44445)
0806 01:07:14.869544 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:14.869549 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:14.869559 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:07:14.869604 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:14.869606 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:14.869624 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:14.869698 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:14.869948 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.871119 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.872416 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.873177 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.873251 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:14.873309 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:14.873803 (+ 494us) server_negotiation.cc:299] Negotiation successful
0806 01:07:14.873883 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":155,"threads_started":1}
I20260806 01:07:14.873759 30630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:14.868836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:45191 (local address 127.0.0.1:58976)
0806 01:07:14.869044 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:14.869097 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:14.869174 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:14.870126 (+ 952us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:14.870127 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:14.870130 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:14.870169 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:14.870170 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.871446 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.871447 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:14.872459 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:14.872462 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:14.873443 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:14.873444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:14.873517 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:14.873519 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 01:07:14.873565 (+ 46us) client_negotiation.cc:240] Negotiation successful
0806 01:07:14.873599 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":80,"threads_started":1}
I20260806 01:07:14.874724 30415 tablet_service.cc:1467] Processing CreateTablet for tablet 947e03538bbc41e7b26741e7504c8149 (DEFAULT_TABLE table=test-table [id=d2b5c4821d8048f0ba96869773475af6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:07:14.874722 30552 tablet_service.cc:1467] Processing CreateTablet for tablet 947e03538bbc41e7b26741e7504c8149 (DEFAULT_TABLE table=test-table [id=d2b5c4821d8048f0ba96869773475af6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:07:14.875111 30552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 947e03538bbc41e7b26741e7504c8149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:14.875111 30415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 947e03538bbc41e7b26741e7504c8149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:14.878716 30636 tablet_bootstrap.cc:492] T 947e03538bbc41e7b26741e7504c8149 P 58a912d983d5450487f3403722bc328d: Bootstrap starting.
I20260806 01:07:14.879374 30279 tablet_service.cc:1467] Processing CreateTablet for tablet 947e03538bbc41e7b26741e7504c8149 (DEFAULT_TABLE table=test-table [id=d2b5c4821d8048f0ba96869773475af6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:07:14.879550 30636 tablet_bootstrap.cc:654] T 947e03538bbc41e7b26741e7504c8149 P 58a912d983d5450487f3403722bc328d: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:14.879761 30279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 947e03538bbc41e7b26741e7504c8149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:14.880167 30636 log.cc:824] T 947e03538bbc41e7b26741e7504c8149 P 58a912d983d5450487f3403722bc328d: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:14.880599 30635 tablet_bootstrap.cc:492] T 947e03538bbc41e7b26741e7504c8149 P 068ed68fe0e94f7bb567f1eb6d64959f: Bootstrap starting.
I20260806 01:07:14.881148 30636 tablet_bootstrap.cc:492] T 947e03538bbc41e7b26741e7504c8149 P 58a912d983d5450487f3403722bc328d: No bootstrap required, opened a new log
I20260806 01:07:14.881249 30636 ts_tablet_manager.cc:1397] T 947e03538bbc41e7b26741e7504c8149 P 58a912d983d5450487f3403722bc328d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 01:07:14.881371 30635 tablet_bootstrap.cc:654] T 947e03538bbc41e7b26741e7504c8149 P 068ed68fe0e94f7bb567f1eb6d64959f: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:14.881974 30635 log.cc:824] T 947e03538bbc41e7b26741e7504c8149 P 068ed68fe0e94f7bb567f1eb6d64959f: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:14.882855 30635 tablet_bootstrap.cc:492] T 947e03538bbc41e7b26741e7504c8149 P 068ed68fe0e94f7bb567f1eb6d64959f: No bootstrap required, opened a new log
I20260806 01:07:14.882930 30635 ts_tablet_manager.cc:1397] T 947e03538bbc41e7b26741e7504c8149 P 068ed68fe0e94f7bb567f1eb6d64959f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 01:07:14.883723 30639 tablet_bootstrap.cc:492] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67: Bootstrap starting.
I20260806 01:07:14.883498 30636 raft_consensus.cc:348] T 947e03538bbc41e7b26741e7504c8149 P 58a912d983d5450487f3403722bc328d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a836e2e162441059ad77dabaee43f67" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 45191 } } peers { permanent_uuid: "068ed68fe0e94f7bb567f1eb6d64959f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 44445 } } peers { permanent_uuid: "58a912d983d5450487f3403722bc328d" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 44861 } }
I20260806 01:07:14.883941 30636 raft_consensus.cc:374] T 947e03538bbc41e7b26741e7504c8149 P 58a912d983d5450487f3403722bc328d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:14.884027 30636 raft_consensus.cc:729] T 947e03538bbc41e7b26741e7504c8149 P 58a912d983d5450487f3403722bc328d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58a912d983d5450487f3403722bc328d, State: Initialized, Role: FOLLOWER
I20260806 01:07:14.884181 30636 consensus_queue.cc:260] T 947e03538bbc41e7b26741e7504c8149 P 58a912d983d5450487f3403722bc328d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a836e2e162441059ad77dabaee43f67" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 45191 } } peers { permanent_uuid: "068ed68fe0e94f7bb567f1eb6d64959f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 44445 } } peers { permanent_uuid: "58a912d983d5450487f3403722bc328d" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 44861 } }
I20260806 01:07:14.884438 30639 tablet_bootstrap.cc:654] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:14.884497 30636 ts_tablet_manager.cc:1428] T 947e03538bbc41e7b26741e7504c8149 P 58a912d983d5450487f3403722bc328d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 01:07:14.884682 30482 heartbeater.cc:503] Master 127.11.88.126:35603 was elected leader, sending a full tablet report...
I20260806 01:07:14.885144 30639 log.cc:824] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:14.885104 30635 raft_consensus.cc:348] T 947e03538bbc41e7b26741e7504c8149 P 068ed68fe0e94f7bb567f1eb6d64959f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a836e2e162441059ad77dabaee43f67" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 45191 } } peers { permanent_uuid: "068ed68fe0e94f7bb567f1eb6d64959f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 44445 } } peers { permanent_uuid: "58a912d983d5450487f3403722bc328d" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 44861 } }
I20260806 01:07:14.885341 30635 raft_consensus.cc:374] T 947e03538bbc41e7b26741e7504c8149 P 068ed68fe0e94f7bb567f1eb6d64959f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:14.885404 30635 raft_consensus.cc:729] T 947e03538bbc41e7b26741e7504c8149 P 068ed68fe0e94f7bb567f1eb6d64959f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 068ed68fe0e94f7bb567f1eb6d64959f, State: Initialized, Role: FOLLOWER
I20260806 01:07:14.885519 30635 consensus_queue.cc:260] T 947e03538bbc41e7b26741e7504c8149 P 068ed68fe0e94f7bb567f1eb6d64959f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a836e2e162441059ad77dabaee43f67" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 45191 } } peers { permanent_uuid: "068ed68fe0e94f7bb567f1eb6d64959f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 44445 } } peers { permanent_uuid: "58a912d983d5450487f3403722bc328d" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 44861 } }
I20260806 01:07:14.885854 30635 ts_tablet_manager.cc:1428] T 947e03538bbc41e7b26741e7504c8149 P 068ed68fe0e94f7bb567f1eb6d64959f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 01:07:14.885870 30618 heartbeater.cc:503] Master 127.11.88.126:35603 was elected leader, sending a full tablet report...
I20260806 01:07:14.886214 30639 tablet_bootstrap.cc:492] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67: No bootstrap required, opened a new log
I20260806 01:07:14.886301 30639 ts_tablet_manager.cc:1397] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 01:07:14.887869 30639 raft_consensus.cc:348] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a836e2e162441059ad77dabaee43f67" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 45191 } } peers { permanent_uuid: "068ed68fe0e94f7bb567f1eb6d64959f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 44445 } } peers { permanent_uuid: "58a912d983d5450487f3403722bc328d" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 44861 } }
I20260806 01:07:14.888015 30639 raft_consensus.cc:374] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:14.888037 30639 raft_consensus.cc:729] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a836e2e162441059ad77dabaee43f67, State: Initialized, Role: FOLLOWER
I20260806 01:07:14.888170 30639 consensus_queue.cc:260] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a836e2e162441059ad77dabaee43f67" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 45191 } } peers { permanent_uuid: "068ed68fe0e94f7bb567f1eb6d64959f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 44445 } } peers { permanent_uuid: "58a912d983d5450487f3403722bc328d" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 44861 } }
I20260806 01:07:14.888486 30639 ts_tablet_manager.cc:1428] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 01:07:14.888517 30345 heartbeater.cc:503] Master 127.11.88.126:35603 was elected leader, sending a full tablet report...
W20260806 01:07:14.913172 30483 tablet.cc:2369] T 947e03538bbc41e7b26741e7504c8149 P 58a912d983d5450487f3403722bc328d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 01:07:15.002494 30346 tablet.cc:2369] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 01:07:15.046070 30643 raft_consensus.cc:482] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:07:15.046387 30643 raft_consensus.cc:504] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a836e2e162441059ad77dabaee43f67" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 45191 } } peers { permanent_uuid: "068ed68fe0e94f7bb567f1eb6d64959f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 44445 } } peers { permanent_uuid: "58a912d983d5450487f3403722bc328d" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 44861 } }
I20260806 01:07:15.046917 30643 leader_election.cc:288] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 068ed68fe0e94f7bb567f1eb6d64959f (127.11.88.67:44445), 58a912d983d5450487f3403722bc328d (127.11.88.66:44861)
I20260806 01:07:15.051227 30645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:15.047156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:44445 (local address 127.11.88.65:59327)
0806 01:07:15.047457 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:15.047467 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:15.047515 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:15.047712 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:15.047713 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:15.047715 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:15.047832 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:15.047834 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.048807 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.048808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:15.050268 (+ 1460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:15.050272 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.050954 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.050955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:15.051042 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:15.051048 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 01:07:15.051107 (+ 59us) client_negotiation.cc:240] Negotiation successful
0806 01:07:15.051149 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"mutex_wait_us":57,"thread_start_us":62,"threads_started":1}
I20260806 01:07:15.051292 30633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:15.047501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:59327 (local address 127.11.88.67:44445)
0806 01:07:15.047551 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:15.047553 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:15.047561 (+ 8us) server_negotiation.cc:407] Connection header received
0806 01:07:15.047591 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:15.047592 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:15.047602 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:15.047669 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:15.047918 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.048702 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.050437 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.050866 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.050937 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:15.050945 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:15.051138 (+ 193us) server_negotiation.cc:299] Negotiation successful
0806 01:07:15.051205 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 01:07:15.051402 30644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:15.047122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:44861 (local address 127.11.88.65:37877)
0806 01:07:15.047394 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:15.047408 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:15.047489 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:15.047854 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:15.047854 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:15.047857 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:15.047928 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:15.047930 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.048890 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.048890 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:15.050268 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:15.050272 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.051047 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.051048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:15.051184 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:15.051189 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 01:07:15.051261 (+ 72us) client_negotiation.cc:240] Negotiation successful
0806 01:07:15.051307 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"mutex_wait_us":18,"thread_start_us":92,"threads_started":1}
I20260806 01:07:15.051437 30634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:15.047302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:37877 (local address 127.11.88.66:44861)
0806 01:07:15.047473 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:15.047476 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:15.047493 (+ 17us) server_negotiation.cc:407] Connection header received
0806 01:07:15.047756 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:15.047757 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:15.047765 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:15.047807 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:15.048094 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.048800 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.050443 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.050946 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.051023 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:15.051034 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:15.051291 (+ 257us) server_negotiation.cc:299] Negotiation successful
0806 01:07:15.051347 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131}
I20260806 01:07:15.051951 30436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "947e03538bbc41e7b26741e7504c8149" candidate_uuid: "1a836e2e162441059ad77dabaee43f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a912d983d5450487f3403722bc328d" is_pre_election: true
I20260806 01:07:15.052106 30572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "947e03538bbc41e7b26741e7504c8149" candidate_uuid: "1a836e2e162441059ad77dabaee43f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "068ed68fe0e94f7bb567f1eb6d64959f" is_pre_election: true
I20260806 01:07:15.052177 30436 raft_consensus.cc:2454] T 947e03538bbc41e7b26741e7504c8149 P 58a912d983d5450487f3403722bc328d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a836e2e162441059ad77dabaee43f67 in term 0.
I20260806 01:07:15.052294 30572 raft_consensus.cc:2454] T 947e03538bbc41e7b26741e7504c8149 P 068ed68fe0e94f7bb567f1eb6d64959f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a836e2e162441059ad77dabaee43f67 in term 0.
I20260806 01:07:15.052551 30231 leader_election.cc:302] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a836e2e162441059ad77dabaee43f67, 58a912d983d5450487f3403722bc328d; no voters:
I20260806 01:07:15.052757 30643 raft_consensus.cc:2781] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:07:15.052832 30643 raft_consensus.cc:482] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:07:15.052868 30643 raft_consensus.cc:3037] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:15.053719 30643 raft_consensus.cc:504] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a836e2e162441059ad77dabaee43f67" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 45191 } } peers { permanent_uuid: "068ed68fe0e94f7bb567f1eb6d64959f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 44445 } } peers { permanent_uuid: "58a912d983d5450487f3403722bc328d" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 44861 } }
I20260806 01:07:15.053915 30643 leader_election.cc:288] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67 [CANDIDATE]: Term 1 election: Requested vote from peers 068ed68fe0e94f7bb567f1eb6d64959f (127.11.88.67:44445), 58a912d983d5450487f3403722bc328d (127.11.88.66:44861)
I20260806 01:07:15.054077 30572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "947e03538bbc41e7b26741e7504c8149" candidate_uuid: "1a836e2e162441059ad77dabaee43f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "068ed68fe0e94f7bb567f1eb6d64959f"
I20260806 01:07:15.054180 30572 raft_consensus.cc:3037] T 947e03538bbc41e7b26741e7504c8149 P 068ed68fe0e94f7bb567f1eb6d64959f [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:15.054198 30436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "947e03538bbc41e7b26741e7504c8149" candidate_uuid: "1a836e2e162441059ad77dabaee43f67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a912d983d5450487f3403722bc328d"
I20260806 01:07:15.054273 30436 raft_consensus.cc:3037] T 947e03538bbc41e7b26741e7504c8149 P 58a912d983d5450487f3403722bc328d [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:15.055197 30572 raft_consensus.cc:2454] T 947e03538bbc41e7b26741e7504c8149 P 068ed68fe0e94f7bb567f1eb6d64959f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a836e2e162441059ad77dabaee43f67 in term 1.
I20260806 01:07:15.055212 30436 raft_consensus.cc:2454] T 947e03538bbc41e7b26741e7504c8149 P 58a912d983d5450487f3403722bc328d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a836e2e162441059ad77dabaee43f67 in term 1.
I20260806 01:07:15.055383 30231 leader_election.cc:302] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a836e2e162441059ad77dabaee43f67, 58a912d983d5450487f3403722bc328d; no voters:
I20260806 01:07:15.055483 30643 raft_consensus.cc:2781] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:15.055650 30643 raft_consensus.cc:686] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67 [term 1 LEADER]: Becoming Leader. State: Replica: 1a836e2e162441059ad77dabaee43f67, State: Running, Role: LEADER
I20260806 01:07:15.055735 30643 consensus_queue.cc:237] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a836e2e162441059ad77dabaee43f67" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 45191 } } peers { permanent_uuid: "068ed68fe0e94f7bb567f1eb6d64959f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 44445 } } peers { permanent_uuid: "58a912d983d5450487f3403722bc328d" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 44861 } }
I20260806 01:07:15.056816 30149 catalog_manager.cc:5495] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a836e2e162441059ad77dabaee43f67 (127.11.88.65). New cstate: current_term: 1 leader_uuid: "1a836e2e162441059ad77dabaee43f67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a836e2e162441059ad77dabaee43f67" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 45191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "068ed68fe0e94f7bb567f1eb6d64959f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 44445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58a912d983d5450487f3403722bc328d" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 44861 } health_report { overall_health: UNKNOWN } } }
W20260806 01:07:15.084847 30619 tablet.cc:2369] T 947e03538bbc41e7b26741e7504c8149 P 068ed68fe0e94f7bb567f1eb6d64959f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 01:07:15.103451 30631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:15.100469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58982 (local address 127.11.88.65:45191)
0806 01:07:15.100570 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:15.100573 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:15.100586 (+ 13us) server_negotiation.cc:407] Connection header received
0806 01:07:15.100738 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:15.100739 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:15.100763 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:15.100859 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:07:15.101020 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.101587 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.102494 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.102734 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.102824 (+ 90us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:15.103003 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:07:15.103111 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:07:15.103280 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:15.103349 (+ 69us) server_negotiation.cc:299] Negotiation successful
0806 01:07:15.103365 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 01:07:15.105759 30572 raft_consensus.cc:1261] T 947e03538bbc41e7b26741e7504c8149 P 068ed68fe0e94f7bb567f1eb6d64959f [term 1 FOLLOWER]: Refusing update from remote peer 1a836e2e162441059ad77dabaee43f67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:07:15.105767 30436 raft_consensus.cc:1261] T 947e03538bbc41e7b26741e7504c8149 P 58a912d983d5450487f3403722bc328d [term 1 FOLLOWER]: Refusing update from remote peer 1a836e2e162441059ad77dabaee43f67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:07:15.106179 30646 consensus_queue.cc:1035] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "068ed68fe0e94f7bb567f1eb6d64959f" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 44445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:07:15.106345 30643 consensus_queue.cc:1035] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a912d983d5450487f3403722bc328d" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 44861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:07:15.109287 30652 mvcc.cc:205] Tried to move back new op lower bound from 7315367670190088192 to 7315367669989347328. Current Snapshot: MvccSnapshot[applied={T|T < 7315367670190088192}]
I20260806 01:07:15.109666 30651 mvcc.cc:205] Tried to move back new op lower bound from 7315367670190088192 to 7315367669989347328. Current Snapshot: MvccSnapshot[applied={T|T < 7315367670190088192}]
I20260806 01:07:15.111550 30148 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45362:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:07:15.111675 30148 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45362:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:07:15.112576 30148 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4938985f6e594769888c2930030089d6: Sending DeleteTablet for 3 replicas of tablet 947e03538bbc41e7b26741e7504c8149
I20260806 01:07:15.113006 30552 tablet_service.cc:1514] Processing DeleteTablet for tablet 947e03538bbc41e7b26741e7504c8149 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:07:15 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:43512
I20260806 01:07:15.113059 30279 tablet_service.cc:1514] Processing DeleteTablet for tablet 947e03538bbc41e7b26741e7504c8149 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:07:15 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:58976
I20260806 01:07:15.113152 30415 tablet_service.cc:1514] Processing DeleteTablet for tablet 947e03538bbc41e7b26741e7504c8149 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:07:15 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:45784
I20260806 01:07:15.113315 30660 tablet_replica.cc:330] T 947e03538bbc41e7b26741e7504c8149 P 068ed68fe0e94f7bb567f1eb6d64959f: stopping tablet replica
I20260806 01:07:15.113440 30661 tablet_replica.cc:330] T 947e03538bbc41e7b26741e7504c8149 P 1a836e2e162441059ad77dabaee43f67: stopping tablet replica
I20260806 01:07:15.113483 30660 raft_consensus.cc:2229] T 947e03538bbc41e7b26741e7504c8149 P 068ed68fe0e94f7bb567f1eb6d64959f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:07:15.113548 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 30212
I20260806 01:07:15.113636 30660 raft_consensus.cc:2258] T 947e03538bbc41e7b26741e7504c8149 P 068ed68fe0e94f7bb567f1eb6d64959f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:07:15.114902 30660 ts_tablet_manager.cc:1905] T 947e03538bbc41e7b26741e7504c8149 P 068ed68fe0e94f7bb567f1eb6d64959f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:07:15.117359 30660 ts_tablet_manager.cc:1918] T 947e03538bbc41e7b26741e7504c8149 P 068ed68fe0e94f7bb567f1eb6d64959f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:07:15.117452 30660 log.cc:1196] T 947e03538bbc41e7b26741e7504c8149 P 068ed68fe0e94f7bb567f1eb6d64959f: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-2/wal/wals/947e03538bbc41e7b26741e7504c8149
I20260806 01:07:15.117784 30660 ts_tablet_manager.cc:1939] T 947e03538bbc41e7b26741e7504c8149 P 068ed68fe0e94f7bb567f1eb6d64959f: Deleting consensus metadata
I20260806 01:07:15.118424 30135 catalog_manager.cc:4841] TS 068ed68fe0e94f7bb567f1eb6d64959f (127.11.88.67:44445): tablet 947e03538bbc41e7b26741e7504c8149 (table test-table [id=d2b5c4821d8048f0ba96869773475af6]) successfully deleted
I20260806 01:07:15.118924 30662 tablet_replica.cc:330] T 947e03538bbc41e7b26741e7504c8149 P 58a912d983d5450487f3403722bc328d: stopping tablet replica
I20260806 01:07:15.119096 30662 raft_consensus.cc:2229] T 947e03538bbc41e7b26741e7504c8149 P 58a912d983d5450487f3403722bc328d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:07:15.119266 30662 raft_consensus.cc:2258] T 947e03538bbc41e7b26741e7504c8149 P 58a912d983d5450487f3403722bc328d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:07:15.119735 30662 ts_tablet_manager.cc:1905] T 947e03538bbc41e7b26741e7504c8149 P 58a912d983d5450487f3403722bc328d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:07:15.121534 30662 ts_tablet_manager.cc:1918] T 947e03538bbc41e7b26741e7504c8149 P 58a912d983d5450487f3403722bc328d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:07:15.121621 30662 log.cc:1196] T 947e03538bbc41e7b26741e7504c8149 P 58a912d983d5450487f3403722bc328d: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785978186227899-11617-0/minicluster-data/ts-1/wal/wals/947e03538bbc41e7b26741e7504c8149
I20260806 01:07:15.121990 30662 ts_tablet_manager.cc:1939] T 947e03538bbc41e7b26741e7504c8149 P 58a912d983d5450487f3403722bc328d: Deleting consensus metadata
I20260806 01:07:15.122519 30136 catalog_manager.cc:4841] TS 58a912d983d5450487f3403722bc328d (127.11.88.66:44861): tablet 947e03538bbc41e7b26741e7504c8149 (table test-table [id=d2b5c4821d8048f0ba96869773475af6]) successfully deleted
W20260806 01:07:15.123381 30136 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.88.65:45191 (error 108)
I20260806 01:07:15.123602 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 30350
I20260806 01:07:15.125188 30632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:15.124992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:45191 (local address 127.0.0.1:58992)
0806 01:07:15.125072 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:15.125140 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.65:45191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260806 01:07:15.125370 30136 catalog_manager.cc:4584] TS 1a836e2e162441059ad77dabaee43f67 (127.11.88.65:45191): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 947e03538bbc41e7b26741e7504c8149: Network error: Client connection negotiation failed: client connection to 127.11.88.65:45191: connect: Connection refused (error 111)
I20260806 01:07:15.130124 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 30487
I20260806 01:07:15.136215 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 30116
2026-08-06T01:07:15Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2207 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-06T01:07:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:07:15Z Disabled control of system clock
I20260806 01:07:15.168145 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:39767
--webserver_interface=127.11.88.126
--webserver_port=0
--builtin_ntp_servers=127.11.88.84:45193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:39767
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 01:07:15.253221 30667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:15.253477 30667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:15.253501 30667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:15.254830 30667 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:15.254886 30667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:15.254899 30667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:15.254912 30667 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:15.254925 30667 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:15.256434 30667 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:45193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:39767
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:39767
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30667
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:15.256742 30667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:15.257097 30667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:15.262423 30676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:15.262423 30674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:15.262558 30673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:15.262634 30667 server_base.cc:1034] running on GCE node
I20260806 01:07:15.262992 30667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:15.263270 30667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:15.264460 30667 hybrid_clock.cc:648] HybridClock initialized: now 1785978435264446 us; error 32 us; skew 500 ppm
I20260806 01:07:15.265892 30667 webserver.cc:460] Webserver started at http://127.11.88.126:34453/ using document root <none> and password file <none>
I20260806 01:07:15.266188 30667 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:15.266258 30667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:15.266397 30667 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:15.267510 30667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "3d00c4b5fa6d433e92b01c0ae23137ea"
format_stamp: "Formatted at 2026-08-06 01:07:15 on dist-test-slave-69rg"
server_key: "0ec3215916c46c8db260435d94a3609b"
server_key_iv: "5b8ebf170aec859cf397db4cd5e6042f"
server_key_version: "encryptionkey@0"
I20260806 01:07:15.267885 30667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "3d00c4b5fa6d433e92b01c0ae23137ea"
format_stamp: "Formatted at 2026-08-06 01:07:15 on dist-test-slave-69rg"
server_key: "0ec3215916c46c8db260435d94a3609b"
server_key_iv: "5b8ebf170aec859cf397db4cd5e6042f"
server_key_version: "encryptionkey@0"
I20260806 01:07:15.269326 30667 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:07:15.270270 30682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:15.270503 30667 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 01:07:15.270648 30667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "3d00c4b5fa6d433e92b01c0ae23137ea"
format_stamp: "Formatted at 2026-08-06 01:07:15 on dist-test-slave-69rg"
server_key: "0ec3215916c46c8db260435d94a3609b"
server_key_iv: "5b8ebf170aec859cf397db4cd5e6042f"
server_key_version: "encryptionkey@0"
I20260806 01:07:15.270737 30667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:15.280727 30667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:15.281096 30667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:15.281260 30667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:15.286156 30667 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:39767
I20260806 01:07:15.286237 30734 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:39767 every 8 connection(s)
I20260806 01:07:15.286633 30667 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:07:15.287686 30735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:15.290259 30735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d00c4b5fa6d433e92b01c0ae23137ea: Bootstrap starting.
I20260806 01:07:15.290887 30735 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d00c4b5fa6d433e92b01c0ae23137ea: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:15.291204 30735 log.cc:824] T 00000000000000000000000000000000 P 3d00c4b5fa6d433e92b01c0ae23137ea: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:15.291986 30735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d00c4b5fa6d433e92b01c0ae23137ea: No bootstrap required, opened a new log
I20260806 01:07:15.293290 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 30667
I20260806 01:07:15.293434 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:07:15.293668 11617 external_mini_cluster.cc:1428] Setting key 24e90b733cee46a7984a6977be894ab1
I20260806 01:07:15.293921 30735 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d00c4b5fa6d433e92b01c0ae23137ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d00c4b5fa6d433e92b01c0ae23137ea" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39767 } }
I20260806 01:07:15.294121 30735 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3d00c4b5fa6d433e92b01c0ae23137ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:15.294204 30735 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d00c4b5fa6d433e92b01c0ae23137ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d00c4b5fa6d433e92b01c0ae23137ea, State: Initialized, Role: FOLLOWER
I20260806 01:07:15.294646 30735 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d00c4b5fa6d433e92b01c0ae23137ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d00c4b5fa6d433e92b01c0ae23137ea" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39767 } }
I20260806 01:07:15.294740 30735 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3d00c4b5fa6d433e92b01c0ae23137ea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:07:15.294773 30735 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d00c4b5fa6d433e92b01c0ae23137ea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:07:15.294816 30735 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d00c4b5fa6d433e92b01c0ae23137ea [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:15.295631 30735 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d00c4b5fa6d433e92b01c0ae23137ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d00c4b5fa6d433e92b01c0ae23137ea" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39767 } }
I20260806 01:07:15.295742 30735 leader_election.cc:302] T 00000000000000000000000000000000 P 3d00c4b5fa6d433e92b01c0ae23137ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d00c4b5fa6d433e92b01c0ae23137ea; no voters:
I20260806 01:07:15.295919 30735 leader_election.cc:288] T 00000000000000000000000000000000 P 3d00c4b5fa6d433e92b01c0ae23137ea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:07:15.296025 30740 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3d00c4b5fa6d433e92b01c0ae23137ea [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:15.296182 30735 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d00c4b5fa6d433e92b01c0ae23137ea [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:15.296224 30740 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3d00c4b5fa6d433e92b01c0ae23137ea [term 1 LEADER]: Becoming Leader. State: Replica: 3d00c4b5fa6d433e92b01c0ae23137ea, State: Running, Role: LEADER
I20260806 01:07:15.296535 30740 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d00c4b5fa6d433e92b01c0ae23137ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d00c4b5fa6d433e92b01c0ae23137ea" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39767 } }
I20260806 01:07:15.297158 30742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d00c4b5fa6d433e92b01c0ae23137ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d00c4b5fa6d433e92b01c0ae23137ea. Latest consensus state: current_term: 1 leader_uuid: "3d00c4b5fa6d433e92b01c0ae23137ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d00c4b5fa6d433e92b01c0ae23137ea" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39767 } } }
I20260806 01:07:15.297257 30742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d00c4b5fa6d433e92b01c0ae23137ea [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:15.297608 30741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d00c4b5fa6d433e92b01c0ae23137ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3d00c4b5fa6d433e92b01c0ae23137ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d00c4b5fa6d433e92b01c0ae23137ea" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 39767 } } }
I20260806 01:07:15.297693 30741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d00c4b5fa6d433e92b01c0ae23137ea [sys.catalog]: This master's current role is: LEADER
W20260806 01:07:15.298615 30756 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3d00c4b5fa6d433e92b01c0ae23137ea: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 01:07:15.298674 30756 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 01:07:15.298720 30749 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:07:15.298914 30749 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:07:15.300854 30739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:15.294330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57022 (local address 127.11.88.126:39767)
0806 01:07:15.294555 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:15.294564 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:15.294599 (+ 35us) server_negotiation.cc:407] Connection header received
0806 01:07:15.294716 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:15.294723 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:15.294810 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:15.294959 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:15.295137 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.297116 (+ 1979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.298312 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.298945 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.299090 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:15.300066 (+ 976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:15.300070 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:15.300070 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:15.300302 (+ 232us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:15.300350 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:15.300367 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:15.300433 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:15.300504 (+ 71us) server_negotiation.cc:299] Negotiation successful
0806 01:07:15.300600 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":95,"threads_started":1}
I20260806 01:07:15.300998 30749 catalog_manager.cc:1347] Generated new cluster ID: 44879d9e8a954557bd09bf95ed469297
I20260806 01:07:15.301049 30749 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:07:15.328627 30749 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:07:15.329219 30749 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:07:15.334054 30749 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3d00c4b5fa6d433e92b01c0ae23137ea: Generated new TSK 0
I20260806 01:07:15.334430 30749 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:07:15.343093 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:0
--local_ip_for_outbound_sockets=127.11.88.65
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:39767
--builtin_ntp_servers=127.11.88.84:45193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 01:07:15.437872 30759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:15.438114 30759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:15.438140 30759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:15.439391 30759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:15.439436 30759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:15.439463 30759 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:07:15.440793 30759 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:45193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:39767
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30759
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:15.441015 30759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:15.441298 30759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:15.446694 30767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:15.446733 30765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:15.446642 30764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:15.446842 30759 server_base.cc:1034] running on GCE node
I20260806 01:07:15.447279 30759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:15.447528 30759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:15.448683 30759 hybrid_clock.cc:648] HybridClock initialized: now 1785978435448665 us; error 31 us; skew 500 ppm
I20260806 01:07:15.450302 30759 webserver.cc:460] Webserver started at http://127.11.88.65:37297/ using document root <none> and password file <none>
I20260806 01:07:15.450590 30759 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:15.450642 30759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:15.450775 30759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:15.451954 30759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-0/data/instance:
uuid: "b7468a26d9e94fa99a82de7f8f3abead"
format_stamp: "Formatted at 2026-08-06 01:07:15 on dist-test-slave-69rg"
server_key: "77880f2ea77484f17be1ef1207d6159d"
server_key_iv: "a330836efcda32f81b03bc8876ba0d28"
server_key_version: "encryptionkey@0"
I20260806 01:07:15.452342 30759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance:
uuid: "b7468a26d9e94fa99a82de7f8f3abead"
format_stamp: "Formatted at 2026-08-06 01:07:15 on dist-test-slave-69rg"
server_key: "77880f2ea77484f17be1ef1207d6159d"
server_key_iv: "a330836efcda32f81b03bc8876ba0d28"
server_key_version: "encryptionkey@0"
I20260806 01:07:15.453732 30759 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:07:15.454659 30773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:15.454876 30759 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:15.454994 30759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "b7468a26d9e94fa99a82de7f8f3abead"
format_stamp: "Formatted at 2026-08-06 01:07:15 on dist-test-slave-69rg"
server_key: "77880f2ea77484f17be1ef1207d6159d"
server_key_iv: "a330836efcda32f81b03bc8876ba0d28"
server_key_version: "encryptionkey@0"
I20260806 01:07:15.455075 30759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:15.463492 30759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:15.464026 30759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:15.464284 30759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:15.464586 30759 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:07:15.465000 30759 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:07:15.465065 30759 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:15.465145 30759 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:07:15.465183 30759 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:15.472324 30759 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:35423
I20260806 01:07:15.472370 30890 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:35423 every 8 connection(s)
I20260806 01:07:15.472764 30759 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
I20260806 01:07:15.478603 30739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:15.473599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:33413 (local address 127.11.88.126:39767)
0806 01:07:15.473688 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:15.473691 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:15.473969 (+ 278us) server_negotiation.cc:407] Connection header received
0806 01:07:15.474583 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:15.474584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:15.474598 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:15.474654 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:15.475522 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.476032 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.477149 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.477349 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.477409 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:15.478365 (+ 956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:15.478366 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:15.478366 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:15.478374 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:15.478388 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:15.478392 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:15.478440 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:15.478508 (+ 68us) server_negotiation.cc:299] Negotiation successful
0806 01:07:15.478538 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 01:07:15.478899 30893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:15.473534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:39767 (local address 127.11.88.65:33413)
0806 01:07:15.473782 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:15.473873 (+ 91us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:15.474489 (+ 616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:15.474776 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:15.474780 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:15.474789 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:15.475407 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:15.475422 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.476196 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.476197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:15.477041 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:15.477043 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.477437 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.477438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:15.477554 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:15.478212 (+ 658us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 01:07:15.478213 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:15.478245 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 01:07:15.478270 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:15.478441 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:15.478443 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:15.478446 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:07:15.478498 (+ 52us) client_negotiation.cc:240] Negotiation successful
0806 01:07:15.478589 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":132,"threads_started":1}
I20260806 01:07:15.479642 30891 heartbeater.cc:347] Connected to a master server at 127.11.88.126:39767
I20260806 01:07:15.479672 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 30759
I20260806 01:07:15.479766 30891 heartbeater.cc:464] Registering TS with master...
I20260806 01:07:15.479794 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance
I20260806 01:07:15.479977 30891 heartbeater.cc:511] Master 127.11.88.126:39767 requested a full tablet report, sending...
I20260806 01:07:15.479997 11617 external_mini_cluster.cc:1428] Setting key 5da225048d5eaedb51cbc5382dfc3fb7
I20260806 01:07:15.480633 30698 ts_manager.cc:194] Registered new tserver with Master: b7468a26d9e94fa99a82de7f8f3abead (127.11.88.65:35423)
I20260806 01:07:15.481160 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:0
--local_ip_for_outbound_sockets=127.11.88.66
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:39767
--builtin_ntp_servers=127.11.88.84:45193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 01:07:15.481571 30698 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.88.65:33413
W20260806 01:07:15.567080 30894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:15.567358 30894 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:15.567399 30894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:15.568629 30894 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:15.568703 30894 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:15.568744 30894 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:07:15.570240 30894 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:45193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:39767
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30894
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:15.570546 30894 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:15.570886 30894 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:15.577555 30902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:15.577795 30894 server_base.cc:1034] running on GCE node
W20260806 01:07:15.577884 30900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:15.577919 30899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:15.578176 30894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:15.578464 30894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:15.579701 30894 hybrid_clock.cc:648] HybridClock initialized: now 1785978435579662 us; error 55 us; skew 500 ppm
I20260806 01:07:15.581292 30894 webserver.cc:460] Webserver started at http://127.11.88.66:43495/ using document root <none> and password file <none>
I20260806 01:07:15.581578 30894 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:15.581661 30894 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:15.582203 30894 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:15.583452 30894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-1/data/instance:
uuid: "d414e19f8dd54fc89b0ff06f84686425"
format_stamp: "Formatted at 2026-08-06 01:07:15 on dist-test-slave-69rg"
server_key: "9920701e809cdbbf5c622307911d3a7f"
server_key_iv: "1cbe6cb0a2d1ee5e4598abf2214ab601"
server_key_version: "encryptionkey@0"
I20260806 01:07:15.583854 30894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance:
uuid: "d414e19f8dd54fc89b0ff06f84686425"
format_stamp: "Formatted at 2026-08-06 01:07:15 on dist-test-slave-69rg"
server_key: "9920701e809cdbbf5c622307911d3a7f"
server_key_iv: "1cbe6cb0a2d1ee5e4598abf2214ab601"
server_key_version: "encryptionkey@0"
I20260806 01:07:15.585363 30894 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 01:07:15.586485 30908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:15.586766 30894 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 01:07:15.586894 30894 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "d414e19f8dd54fc89b0ff06f84686425"
format_stamp: "Formatted at 2026-08-06 01:07:15 on dist-test-slave-69rg"
server_key: "9920701e809cdbbf5c622307911d3a7f"
server_key_iv: "1cbe6cb0a2d1ee5e4598abf2214ab601"
server_key_version: "encryptionkey@0"
I20260806 01:07:15.587000 30894 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:15.607764 30894 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:15.608157 30894 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:15.608331 30894 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:15.608596 30894 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:07:15.608968 30894 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:07:15.609033 30894 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:15.609091 30894 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:07:15.609119 30894 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:15.615214 30894 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:45167
I20260806 01:07:15.615279 31024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:45167 every 8 connection(s)
I20260806 01:07:15.615626 30894 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
I20260806 01:07:15.617671 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 30894
I20260806 01:07:15.617843 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance
I20260806 01:07:15.618106 11617 external_mini_cluster.cc:1428] Setting key b30a5a34aab6f1957648092dbb371055
I20260806 01:07:15.619194 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:0
--local_ip_for_outbound_sockets=127.11.88.67
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:39767
--builtin_ntp_servers=127.11.88.84:45193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 01:07:15.621640 30739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:15.616378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:38187 (local address 127.11.88.126:39767)
0806 01:07:15.616429 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:15.616431 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:15.616686 (+ 255us) server_negotiation.cc:407] Connection header received
0806 01:07:15.617198 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:15.617199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:15.617210 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:15.617270 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:15.618059 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.618827 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.619950 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.620265 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.620343 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:15.621309 (+ 966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:15.621311 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:15.621311 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:15.621317 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:15.621337 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:15.621342 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:15.621407 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:15.621494 (+ 87us) server_negotiation.cc:299] Negotiation successful
0806 01:07:15.621527 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":36,"server-negotiator.queue_time_us":22}
I20260806 01:07:15.621872 31027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:15.616379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:39767 (local address 127.11.88.66:38187)
0806 01:07:15.616555 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:15.616592 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:15.617081 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:15.617317 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:15.617320 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:15.617328 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:15.617933 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:15.617941 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.618941 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.618942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:15.619860 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:15.619863 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.620383 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.620384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:15.620516 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:15.621158 (+ 642us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 01:07:15.621158 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:15.621190 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 01:07:15.621215 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:15.621415 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:15.621420 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:15.621422 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 01:07:15.621476 (+ 54us) client_negotiation.cc:240] Negotiation successful
0806 01:07:15.621563 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":90,"threads_started":1}
I20260806 01:07:15.622392 31025 heartbeater.cc:347] Connected to a master server at 127.11.88.126:39767
I20260806 01:07:15.622491 31025 heartbeater.cc:464] Registering TS with master...
I20260806 01:07:15.622716 31025 heartbeater.cc:511] Master 127.11.88.126:39767 requested a full tablet report, sending...
I20260806 01:07:15.623169 30698 ts_manager.cc:194] Registered new tserver with Master: d414e19f8dd54fc89b0ff06f84686425 (127.11.88.66:45167)
I20260806 01:07:15.623569 30698 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.88.66:38187
W20260806 01:07:15.705879 31028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:15.706136 31028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:15.706175 31028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:15.707396 31028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:15.707468 31028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:15.707512 31028 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:07:15.708992 31028 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:45193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:39767
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31028
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:15.709276 31028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:15.709596 31028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:15.715029 31036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:15.715029 31034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:15.715024 31033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:15.715371 31028 server_base.cc:1034] running on GCE node
I20260806 01:07:15.715631 31028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:15.715899 31028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:15.717111 31028 hybrid_clock.cc:648] HybridClock initialized: now 1785978435717110 us; error 47 us; skew 500 ppm
I20260806 01:07:15.718851 31028 webserver.cc:460] Webserver started at http://127.11.88.67:36085/ using document root <none> and password file <none>
I20260806 01:07:15.719156 31028 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:15.719282 31028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:15.719439 31028 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:15.720611 31028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-2/data/instance:
uuid: "b2d04a4fb4d540aaaf76fc35309034a1"
format_stamp: "Formatted at 2026-08-06 01:07:15 on dist-test-slave-69rg"
server_key: "82c81e63ab64e14b70da3230091f725d"
server_key_iv: "ad17d3d20bab7430b7135e8629c79148"
server_key_version: "encryptionkey@0"
I20260806 01:07:15.720990 31028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance:
uuid: "b2d04a4fb4d540aaaf76fc35309034a1"
format_stamp: "Formatted at 2026-08-06 01:07:15 on dist-test-slave-69rg"
server_key: "82c81e63ab64e14b70da3230091f725d"
server_key_iv: "ad17d3d20bab7430b7135e8629c79148"
server_key_version: "encryptionkey@0"
I20260806 01:07:15.722566 31028 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.002s
I20260806 01:07:15.723493 31042 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:15.723702 31028 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:15.723805 31028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "b2d04a4fb4d540aaaf76fc35309034a1"
format_stamp: "Formatted at 2026-08-06 01:07:15 on dist-test-slave-69rg"
server_key: "82c81e63ab64e14b70da3230091f725d"
server_key_iv: "ad17d3d20bab7430b7135e8629c79148"
server_key_version: "encryptionkey@0"
I20260806 01:07:15.723883 31028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:15.741086 31028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:15.741463 31028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:15.741612 31028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:15.741971 31028 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:07:15.742363 31028 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:07:15.742400 31028 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:15.742422 31028 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:07:15.742435 31028 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:15.748795 31028 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:42983
I20260806 01:07:15.748871 31158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:42983 every 8 connection(s)
I20260806 01:07:15.749213 31028 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
I20260806 01:07:15.755452 30739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:15.750134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:37271 (local address 127.11.88.126:39767)
0806 01:07:15.750248 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:15.750250 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:15.750507 (+ 257us) server_negotiation.cc:407] Connection header received
0806 01:07:15.751059 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:15.751061 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:15.751073 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:15.751146 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:15.752114 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.752655 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.753726 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.754024 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.754102 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:15.755199 (+ 1097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:15.755200 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:15.755200 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:15.755206 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:15.755222 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:15.755225 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:15.755273 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:15.755343 (+ 70us) server_negotiation.cc:299] Negotiation successful
0806 01:07:15.755372 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 01:07:15.755717 31161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:15.750147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:39767 (local address 127.11.88.67:37271)
0806 01:07:15.750369 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:15.750414 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:15.750932 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:15.751285 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:15.751289 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:15.751299 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:15.751991 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:15.751997 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.752777 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.752778 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:15.753619 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:15.753622 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.754142 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.754143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:15.754284 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:15.755043 (+ 759us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 01:07:15.755044 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:15.755077 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 01:07:15.755103 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:15.755276 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:15.755279 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:15.755282 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:07:15.755333 (+ 51us) client_negotiation.cc:240] Negotiation successful
0806 01:07:15.755425 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":110,"threads_started":1}
I20260806 01:07:15.755872 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 31028
I20260806 01:07:15.756001 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance
I20260806 01:07:15.756220 11617 external_mini_cluster.cc:1428] Setting key a8e23449814ecb615af0181a23355877
I20260806 01:07:15.756435 31159 heartbeater.cc:347] Connected to a master server at 127.11.88.126:39767
I20260806 01:07:15.756554 31159 heartbeater.cc:464] Registering TS with master...
I20260806 01:07:15.756790 31159 heartbeater.cc:511] Master 127.11.88.126:39767 requested a full tablet report, sending...
I20260806 01:07:15.757220 30699 ts_manager.cc:194] Registered new tserver with Master: b2d04a4fb4d540aaaf76fc35309034a1 (127.11.88.67:42983)
I20260806 01:07:15.757725 30699 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.88.67:37271
I20260806 01:07:15.768754 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 01:07:15.773957 30739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:15.770592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57030 (local address 127.11.88.126:39767)
0806 01:07:15.770667 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:15.770670 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:15.770793 (+ 123us) server_negotiation.cc:407] Connection header received
0806 01:07:15.770827 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:15.770828 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:15.770843 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:15.770904 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:15.771071 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.771630 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.772391 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.772649 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.772757 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:15.773578 (+ 821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:15.773579 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:15.773580 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:15.773585 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:15.773600 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:15.773604 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:15.773716 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:15.773846 (+ 130us) server_negotiation.cc:299] Negotiation successful
0806 01:07:15.773860 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 01:07:15.775818 30699 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57030:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 01:07:15.777741 30699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:07:15.785508 31169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:15.780895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47812 (local address 127.11.88.66:45167)
0806 01:07:15.781201 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:15.781206 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:15.781383 (+ 177us) server_negotiation.cc:407] Connection header received
0806 01:07:15.781442 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:15.781444 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:15.781461 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:15.781542 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:15.781854 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.782976 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.784421 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.785150 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.785214 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:15.785299 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:15.785359 (+ 60us) server_negotiation.cc:299] Negotiation successful
0806 01:07:15.785408 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":123,"threads_started":1}
I20260806 01:07:15.785507 31173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:15.781124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38720 (local address 127.11.88.67:42983)
0806 01:07:15.781507 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:15.781511 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:15.781522 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:07:15.781562 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:15.781564 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:15.781578 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:15.781671 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:15.781810 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.783056 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.784223 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.785028 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.785114 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:15.785224 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:15.785373 (+ 149us) server_negotiation.cc:299] Negotiation successful
0806 01:07:15.785413 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":101,"threads_started":1}
I20260806 01:07:15.785537 31167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:15.780997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:42983 (local address 127.0.0.1:38720)
0806 01:07:15.781322 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:15.781333 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:15.781397 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:15.781666 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:15.781667 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:15.781669 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:15.781714 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:15.781715 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.783122 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.783123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:15.784130 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:15.784133 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.785132 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.785133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:15.785243 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:15.785260 (+ 17us) client_negotiation.cc:769] Sending connection context
0806 01:07:15.785347 (+ 87us) client_negotiation.cc:240] Negotiation successful
0806 01:07:15.785428 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"mutex_wait_us":46,"thread_start_us":82,"threads_started":1}
I20260806 01:07:15.785537 31170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:15.780755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:45167 (local address 127.0.0.1:47812)
0806 01:07:15.781285 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:15.781297 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:15.781365 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:15.781717 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:15.781718 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:15.781719 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:15.781752 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:15.781753 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.783062 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.783063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:15.784327 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:15.784330 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.785235 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.785236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:15.785284 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:15.785288 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:07:15.785332 (+ 44us) client_negotiation.cc:240] Negotiation successful
0806 01:07:15.785417 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"mutex_wait_us":44,"thread_start_us":71,"threads_started":1}
I20260806 01:07:15.786523 31092 tablet_service.cc:1467] Processing CreateTablet for tablet 4561144a2a8840429c8d0ba4d18d4cbc (DEFAULT_TABLE table=test-table [id=32402b36a9084939808880a4a313b3ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:07:15.786957 31171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:15.781143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58946 (local address 127.11.88.65:35423)
0806 01:07:15.781324 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:15.781328 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:15.781339 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:07:15.781385 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:15.781388 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:15.781404 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:15.781757 (+ 353us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:15.781997 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.782873 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.785693 (+ 2820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.786503 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.786593 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:15.786688 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:15.786816 (+ 128us) server_negotiation.cc:299] Negotiation successful
0806 01:07:15.786859 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":79,"threads_started":1}
I20260806 01:07:15.786974 31092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4561144a2a8840429c8d0ba4d18d4cbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:15.786935 31168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:15.780754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:35423 (local address 127.0.0.1:58946)
0806 01:07:15.780905 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:15.780951 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:15.781027 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:15.781556 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:15.781559 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:15.781561 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:15.781640 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:15.781642 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.782974 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.782975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:15.784328 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:15.784330 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.786616 (+ 2286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.786617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:15.786682 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:15.786686 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:07:15.786798 (+ 112us) client_negotiation.cc:240] Negotiation successful
0806 01:07:15.786854 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"mutex_wait_us":57,"thread_start_us":95,"threads_started":1}
I20260806 01:07:15.790501 30824 tablet_service.cc:1467] Processing CreateTablet for tablet 4561144a2a8840429c8d0ba4d18d4cbc (DEFAULT_TABLE table=test-table [id=32402b36a9084939808880a4a313b3ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:07:15.790501 30958 tablet_service.cc:1467] Processing CreateTablet for tablet 4561144a2a8840429c8d0ba4d18d4cbc (DEFAULT_TABLE table=test-table [id=32402b36a9084939808880a4a313b3ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:07:15.791046 30824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4561144a2a8840429c8d0ba4d18d4cbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:15.791046 30958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4561144a2a8840429c8d0ba4d18d4cbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:15.793967 31174 tablet_bootstrap.cc:492] T 4561144a2a8840429c8d0ba4d18d4cbc P b2d04a4fb4d540aaaf76fc35309034a1: Bootstrap starting.
I20260806 01:07:15.794713 31174 tablet_bootstrap.cc:654] T 4561144a2a8840429c8d0ba4d18d4cbc P b2d04a4fb4d540aaaf76fc35309034a1: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:15.795042 31174 log.cc:824] T 4561144a2a8840429c8d0ba4d18d4cbc P b2d04a4fb4d540aaaf76fc35309034a1: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:15.795608 31177 tablet_bootstrap.cc:492] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead: Bootstrap starting.
I20260806 01:07:15.796074 31174 tablet_bootstrap.cc:492] T 4561144a2a8840429c8d0ba4d18d4cbc P b2d04a4fb4d540aaaf76fc35309034a1: No bootstrap required, opened a new log
I20260806 01:07:15.796144 31174 ts_tablet_manager.cc:1397] T 4561144a2a8840429c8d0ba4d18d4cbc P b2d04a4fb4d540aaaf76fc35309034a1: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260806 01:07:15.796379 31177 tablet_bootstrap.cc:654] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:15.796711 31177 log.cc:824] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:15.797116 31176 tablet_bootstrap.cc:492] T 4561144a2a8840429c8d0ba4d18d4cbc P d414e19f8dd54fc89b0ff06f84686425: Bootstrap starting.
I20260806 01:07:15.797755 31176 tablet_bootstrap.cc:654] T 4561144a2a8840429c8d0ba4d18d4cbc P d414e19f8dd54fc89b0ff06f84686425: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:15.798161 31176 log.cc:824] T 4561144a2a8840429c8d0ba4d18d4cbc P d414e19f8dd54fc89b0ff06f84686425: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:15.798786 31177 tablet_bootstrap.cc:492] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead: No bootstrap required, opened a new log
I20260806 01:07:15.798849 31177 ts_tablet_manager.cc:1397] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 01:07:15.798928 31174 raft_consensus.cc:348] T 4561144a2a8840429c8d0ba4d18d4cbc P b2d04a4fb4d540aaaf76fc35309034a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d414e19f8dd54fc89b0ff06f84686425" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 45167 } } peers { permanent_uuid: "b7468a26d9e94fa99a82de7f8f3abead" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35423 } } peers { permanent_uuid: "b2d04a4fb4d540aaaf76fc35309034a1" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42983 } }
I20260806 01:07:15.799113 31174 raft_consensus.cc:374] T 4561144a2a8840429c8d0ba4d18d4cbc P b2d04a4fb4d540aaaf76fc35309034a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:15.799165 31174 raft_consensus.cc:729] T 4561144a2a8840429c8d0ba4d18d4cbc P b2d04a4fb4d540aaaf76fc35309034a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2d04a4fb4d540aaaf76fc35309034a1, State: Initialized, Role: FOLLOWER
I20260806 01:07:15.799289 31174 consensus_queue.cc:260] T 4561144a2a8840429c8d0ba4d18d4cbc P b2d04a4fb4d540aaaf76fc35309034a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d414e19f8dd54fc89b0ff06f84686425" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 45167 } } peers { permanent_uuid: "b7468a26d9e94fa99a82de7f8f3abead" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35423 } } peers { permanent_uuid: "b2d04a4fb4d540aaaf76fc35309034a1" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42983 } }
I20260806 01:07:15.799607 31174 ts_tablet_manager.cc:1428] T 4561144a2a8840429c8d0ba4d18d4cbc P b2d04a4fb4d540aaaf76fc35309034a1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 01:07:15.799677 31159 heartbeater.cc:503] Master 127.11.88.126:39767 was elected leader, sending a full tablet report...
I20260806 01:07:15.801312 31177 raft_consensus.cc:348] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d414e19f8dd54fc89b0ff06f84686425" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 45167 } } peers { permanent_uuid: "b7468a26d9e94fa99a82de7f8f3abead" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35423 } } peers { permanent_uuid: "b2d04a4fb4d540aaaf76fc35309034a1" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42983 } }
I20260806 01:07:15.801460 31177 raft_consensus.cc:374] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:15.801482 31177 raft_consensus.cc:729] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7468a26d9e94fa99a82de7f8f3abead, State: Initialized, Role: FOLLOWER
I20260806 01:07:15.801599 31177 consensus_queue.cc:260] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d414e19f8dd54fc89b0ff06f84686425" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 45167 } } peers { permanent_uuid: "b7468a26d9e94fa99a82de7f8f3abead" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35423 } } peers { permanent_uuid: "b2d04a4fb4d540aaaf76fc35309034a1" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42983 } }
I20260806 01:07:15.801934 31177 ts_tablet_manager.cc:1428] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 01:07:15.802038 30891 heartbeater.cc:503] Master 127.11.88.126:39767 was elected leader, sending a full tablet report...
I20260806 01:07:15.802398 31176 tablet_bootstrap.cc:492] T 4561144a2a8840429c8d0ba4d18d4cbc P d414e19f8dd54fc89b0ff06f84686425: No bootstrap required, opened a new log
I20260806 01:07:15.802491 31176 ts_tablet_manager.cc:1397] T 4561144a2a8840429c8d0ba4d18d4cbc P d414e19f8dd54fc89b0ff06f84686425: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260806 01:07:15.804481 31176 raft_consensus.cc:348] T 4561144a2a8840429c8d0ba4d18d4cbc P d414e19f8dd54fc89b0ff06f84686425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d414e19f8dd54fc89b0ff06f84686425" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 45167 } } peers { permanent_uuid: "b7468a26d9e94fa99a82de7f8f3abead" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35423 } } peers { permanent_uuid: "b2d04a4fb4d540aaaf76fc35309034a1" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42983 } }
I20260806 01:07:15.804636 31176 raft_consensus.cc:374] T 4561144a2a8840429c8d0ba4d18d4cbc P d414e19f8dd54fc89b0ff06f84686425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:15.804685 31176 raft_consensus.cc:729] T 4561144a2a8840429c8d0ba4d18d4cbc P d414e19f8dd54fc89b0ff06f84686425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d414e19f8dd54fc89b0ff06f84686425, State: Initialized, Role: FOLLOWER
I20260806 01:07:15.804831 31176 consensus_queue.cc:260] T 4561144a2a8840429c8d0ba4d18d4cbc P d414e19f8dd54fc89b0ff06f84686425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d414e19f8dd54fc89b0ff06f84686425" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 45167 } } peers { permanent_uuid: "b7468a26d9e94fa99a82de7f8f3abead" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35423 } } peers { permanent_uuid: "b2d04a4fb4d540aaaf76fc35309034a1" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42983 } }
I20260806 01:07:15.805080 31176 ts_tablet_manager.cc:1428] T 4561144a2a8840429c8d0ba4d18d4cbc P d414e19f8dd54fc89b0ff06f84686425: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 01:07:15.805197 31025 heartbeater.cc:503] Master 127.11.88.126:39767 was elected leader, sending a full tablet report...
I20260806 01:07:15.831523 31181 raft_consensus.cc:482] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:07:15.831733 31181 raft_consensus.cc:504] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d414e19f8dd54fc89b0ff06f84686425" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 45167 } } peers { permanent_uuid: "b7468a26d9e94fa99a82de7f8f3abead" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35423 } } peers { permanent_uuid: "b2d04a4fb4d540aaaf76fc35309034a1" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42983 } }
I20260806 01:07:15.832098 31181 leader_election.cc:288] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d414e19f8dd54fc89b0ff06f84686425 (127.11.88.66:45167), b2d04a4fb4d540aaaf76fc35309034a1 (127.11.88.67:42983)
I20260806 01:07:15.835331 30893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:15.832291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:45167 (local address 127.11.88.65:45591)
0806 01:07:15.832388 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:15.832403 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:15.832463 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:15.832693 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:15.832694 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:15.832696 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:15.832772 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:15.832774 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.833491 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.833492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:15.834399 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:15.834402 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.835089 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.835090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:15.835156 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:15.835160 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:07:15.835216 (+ 56us) client_negotiation.cc:240] Negotiation successful
0806 01:07:15.835260 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260806 01:07:15.835355 31169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:15.832414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:45591 (local address 127.11.88.66:45167)
0806 01:07:15.832469 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:15.832471 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:15.832481 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:07:15.832594 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:15.832595 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:15.832611 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:15.832689 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:15.832859 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.833395 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.834500 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.834983 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.835065 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:15.835085 (+ 20us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:15.835234 (+ 149us) server_negotiation.cc:299] Negotiation successful
0806 01:07:15.835279 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260806 01:07:15.835850 31173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:15.832513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:36315 (local address 127.11.88.67:42983)
0806 01:07:15.832555 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:15.832557 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:15.832685 (+ 128us) server_negotiation.cc:407] Connection header received
0806 01:07:15.832757 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:15.832758 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:15.832768 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:15.832824 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:15.832989 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.833504 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.834873 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.835422 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.835500 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:15.835509 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:15.835738 (+ 229us) server_negotiation.cc:299] Negotiation successful
0806 01:07:15.835787 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260806 01:07:15.835860 31183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:15.832418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:42983 (local address 127.11.88.65:36315)
0806 01:07:15.832601 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:15.832612 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:15.832698 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:15.832836 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:15.832837 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:15.832838 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:15.832913 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:15.832917 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.833779 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.833780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:15.834757 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:15.834760 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.835546 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.835548 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:15.835649 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:15.835653 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:07:15.835732 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 01:07:15.835774 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":109,"threads_started":1}
I20260806 01:07:15.835794 30978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4561144a2a8840429c8d0ba4d18d4cbc" candidate_uuid: "b7468a26d9e94fa99a82de7f8f3abead" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d414e19f8dd54fc89b0ff06f84686425" is_pre_election: true
I20260806 01:07:15.836014 30978 raft_consensus.cc:2454] T 4561144a2a8840429c8d0ba4d18d4cbc P d414e19f8dd54fc89b0ff06f84686425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7468a26d9e94fa99a82de7f8f3abead in term 0.
I20260806 01:07:15.836346 30777 leader_election.cc:302] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7468a26d9e94fa99a82de7f8f3abead, d414e19f8dd54fc89b0ff06f84686425; no voters:
I20260806 01:07:15.836453 31112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4561144a2a8840429c8d0ba4d18d4cbc" candidate_uuid: "b7468a26d9e94fa99a82de7f8f3abead" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d04a4fb4d540aaaf76fc35309034a1" is_pre_election: true
I20260806 01:07:15.836585 31112 raft_consensus.cc:2454] T 4561144a2a8840429c8d0ba4d18d4cbc P b2d04a4fb4d540aaaf76fc35309034a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7468a26d9e94fa99a82de7f8f3abead in term 0.
I20260806 01:07:15.836683 31181 raft_consensus.cc:2781] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:07:15.836771 31181 raft_consensus.cc:482] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:07:15.836804 31181 raft_consensus.cc:3037] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:15.837611 31181 raft_consensus.cc:504] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d414e19f8dd54fc89b0ff06f84686425" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 45167 } } peers { permanent_uuid: "b7468a26d9e94fa99a82de7f8f3abead" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35423 } } peers { permanent_uuid: "b2d04a4fb4d540aaaf76fc35309034a1" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42983 } }
I20260806 01:07:15.837749 31181 leader_election.cc:288] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead [CANDIDATE]: Term 1 election: Requested vote from peers d414e19f8dd54fc89b0ff06f84686425 (127.11.88.66:45167), b2d04a4fb4d540aaaf76fc35309034a1 (127.11.88.67:42983)
I20260806 01:07:15.838011 30978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4561144a2a8840429c8d0ba4d18d4cbc" candidate_uuid: "b7468a26d9e94fa99a82de7f8f3abead" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d414e19f8dd54fc89b0ff06f84686425"
I20260806 01:07:15.838016 31112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4561144a2a8840429c8d0ba4d18d4cbc" candidate_uuid: "b7468a26d9e94fa99a82de7f8f3abead" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2d04a4fb4d540aaaf76fc35309034a1"
I20260806 01:07:15.838124 31112 raft_consensus.cc:3037] T 4561144a2a8840429c8d0ba4d18d4cbc P b2d04a4fb4d540aaaf76fc35309034a1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:15.838148 30978 raft_consensus.cc:3037] T 4561144a2a8840429c8d0ba4d18d4cbc P d414e19f8dd54fc89b0ff06f84686425 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:15.838948 31112 raft_consensus.cc:2454] T 4561144a2a8840429c8d0ba4d18d4cbc P b2d04a4fb4d540aaaf76fc35309034a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7468a26d9e94fa99a82de7f8f3abead in term 1.
I20260806 01:07:15.839027 30978 raft_consensus.cc:2454] T 4561144a2a8840429c8d0ba4d18d4cbc P d414e19f8dd54fc89b0ff06f84686425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7468a26d9e94fa99a82de7f8f3abead in term 1.
I20260806 01:07:15.839193 30777 leader_election.cc:302] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7468a26d9e94fa99a82de7f8f3abead, d414e19f8dd54fc89b0ff06f84686425; no voters:
I20260806 01:07:15.839365 31181 raft_consensus.cc:2781] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:15.839669 31181 raft_consensus.cc:686] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead [term 1 LEADER]: Becoming Leader. State: Replica: b7468a26d9e94fa99a82de7f8f3abead, State: Running, Role: LEADER
I20260806 01:07:15.839805 31181 consensus_queue.cc:237] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d414e19f8dd54fc89b0ff06f84686425" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 45167 } } peers { permanent_uuid: "b7468a26d9e94fa99a82de7f8f3abead" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35423 } } peers { permanent_uuid: "b2d04a4fb4d540aaaf76fc35309034a1" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42983 } }
I20260806 01:07:15.840854 30699 catalog_manager.cc:5495] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead reported cstate change: term changed from 0 to 1, leader changed from <none> to b7468a26d9e94fa99a82de7f8f3abead (127.11.88.65). New cstate: current_term: 1 leader_uuid: "b7468a26d9e94fa99a82de7f8f3abead" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d414e19f8dd54fc89b0ff06f84686425" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 45167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7468a26d9e94fa99a82de7f8f3abead" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 35423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2d04a4fb4d540aaaf76fc35309034a1" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42983 } health_report { overall_health: UNKNOWN } } }
I20260806 01:07:15.849180 31171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:15.846508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58960 (local address 127.11.88.65:35423)
0806 01:07:15.846576 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:15.846578 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:15.846588 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:07:15.846677 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:15.846678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:15.846702 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:15.846792 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:07:15.846946 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.847546 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.848343 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:15.848549 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:15.848642 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:15.848812 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:07:15.848907 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:07:15.849018 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:15.849050 (+ 32us) server_negotiation.cc:299] Negotiation successful
0806 01:07:15.849062 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 01:07:15.851320 31112 raft_consensus.cc:1261] T 4561144a2a8840429c8d0ba4d18d4cbc P b2d04a4fb4d540aaaf76fc35309034a1 [term 1 FOLLOWER]: Refusing update from remote peer b7468a26d9e94fa99a82de7f8f3abead: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:07:15.851490 30978 raft_consensus.cc:1261] T 4561144a2a8840429c8d0ba4d18d4cbc P d414e19f8dd54fc89b0ff06f84686425 [term 1 FOLLOWER]: Refusing update from remote peer b7468a26d9e94fa99a82de7f8f3abead: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:07:15.851974 31184 consensus_queue.cc:1035] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2d04a4fb4d540aaaf76fc35309034a1" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:07:15.852289 31181 consensus_queue.cc:1035] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead [LEADER]: Connected to new peer: Peer: permanent_uuid: "d414e19f8dd54fc89b0ff06f84686425" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:07:15.855949 31189 mvcc.cc:205] Tried to move back new op lower bound from 7315367673243627520 to 7315367673200783360. Current Snapshot: MvccSnapshot[applied={T|T < 7315367673243627520}]
I20260806 01:07:15.856389 31187 mvcc.cc:205] Tried to move back new op lower bound from 7315367673243627520 to 7315367673200783360. Current Snapshot: MvccSnapshot[applied={T|T < 7315367673243627520}]
I20260806 01:07:15.860316 30699 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:07:15.860476 30699 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:07:15.861415 30699 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3d00c4b5fa6d433e92b01c0ae23137ea: Sending DeleteTablet for 3 replicas of tablet 4561144a2a8840429c8d0ba4d18d4cbc
I20260806 01:07:15.861884 30824 tablet_service.cc:1514] Processing DeleteTablet for tablet 4561144a2a8840429c8d0ba4d18d4cbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:07:15 UTC) from {username='slave'} at 127.0.0.1:58946
I20260806 01:07:15.861984 31092 tablet_service.cc:1514] Processing DeleteTablet for tablet 4561144a2a8840429c8d0ba4d18d4cbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:07:15 UTC) from {username='slave'} at 127.0.0.1:38720
I20260806 01:07:15.862038 30958 tablet_service.cc:1514] Processing DeleteTablet for tablet 4561144a2a8840429c8d0ba4d18d4cbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:07:15 UTC) from {username='slave'} at 127.0.0.1:47812
I20260806 01:07:15.862277 31197 tablet_replica.cc:330] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead: stopping tablet replica
I20260806 01:07:15.862306 31198 tablet_replica.cc:330] T 4561144a2a8840429c8d0ba4d18d4cbc P b2d04a4fb4d540aaaf76fc35309034a1: stopping tablet replica
I20260806 01:07:15.862398 31197 raft_consensus.cc:2229] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead [term 1 LEADER]: Raft consensus shutting down.
I20260806 01:07:15.862430 31198 raft_consensus.cc:2229] T 4561144a2a8840429c8d0ba4d18d4cbc P b2d04a4fb4d540aaaf76fc35309034a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:07:15.862494 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 30759
I20260806 01:07:15.862556 31197 raft_consensus.cc:2258] T 4561144a2a8840429c8d0ba4d18d4cbc P b7468a26d9e94fa99a82de7f8f3abead [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:07:15.862565 31198 raft_consensus.cc:2258] T 4561144a2a8840429c8d0ba4d18d4cbc P b2d04a4fb4d540aaaf76fc35309034a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:07:15.864708 31198 ts_tablet_manager.cc:1905] T 4561144a2a8840429c8d0ba4d18d4cbc P b2d04a4fb4d540aaaf76fc35309034a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:07:15.867192 31199 tablet_replica.cc:330] T 4561144a2a8840429c8d0ba4d18d4cbc P d414e19f8dd54fc89b0ff06f84686425: stopping tablet replica
I20260806 01:07:15.867348 31199 raft_consensus.cc:2229] T 4561144a2a8840429c8d0ba4d18d4cbc P d414e19f8dd54fc89b0ff06f84686425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:07:15.867225 31198 ts_tablet_manager.cc:1918] T 4561144a2a8840429c8d0ba4d18d4cbc P b2d04a4fb4d540aaaf76fc35309034a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:07:15.867434 31198 log.cc:1196] T 4561144a2a8840429c8d0ba4d18d4cbc P b2d04a4fb4d540aaaf76fc35309034a1: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-2/wal/wals/4561144a2a8840429c8d0ba4d18d4cbc
I20260806 01:07:15.867465 31199 raft_consensus.cc:2258] T 4561144a2a8840429c8d0ba4d18d4cbc P d414e19f8dd54fc89b0ff06f84686425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:07:15.867782 31198 ts_tablet_manager.cc:1939] T 4561144a2a8840429c8d0ba4d18d4cbc P b2d04a4fb4d540aaaf76fc35309034a1: Deleting consensus metadata
I20260806 01:07:15.868129 31199 ts_tablet_manager.cc:1905] T 4561144a2a8840429c8d0ba4d18d4cbc P d414e19f8dd54fc89b0ff06f84686425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:07:15.868312 30686 catalog_manager.cc:4841] TS b2d04a4fb4d540aaaf76fc35309034a1 (127.11.88.67:42983): tablet 4561144a2a8840429c8d0ba4d18d4cbc (table test-table [id=32402b36a9084939808880a4a313b3ca]) successfully deleted
I20260806 01:07:15.870419 31199 ts_tablet_manager.cc:1918] T 4561144a2a8840429c8d0ba4d18d4cbc P d414e19f8dd54fc89b0ff06f84686425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:07:15.870514 31199 log.cc:1196] T 4561144a2a8840429c8d0ba4d18d4cbc P d414e19f8dd54fc89b0ff06f84686425: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785978186227899-11617-0/minicluster-data/ts-1/wal/wals/4561144a2a8840429c8d0ba4d18d4cbc
I20260806 01:07:15.870826 31199 ts_tablet_manager.cc:1939] T 4561144a2a8840429c8d0ba4d18d4cbc P d414e19f8dd54fc89b0ff06f84686425: Deleting consensus metadata
I20260806 01:07:15.871655 30686 catalog_manager.cc:4841] TS d414e19f8dd54fc89b0ff06f84686425 (127.11.88.66:45167): tablet 4561144a2a8840429c8d0ba4d18d4cbc (table test-table [id=32402b36a9084939808880a4a313b3ca]) successfully deleted
W20260806 01:07:15.873047 30685 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.88.65:35423 (error 108)
I20260806 01:07:15.873740 31168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:15.873535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:35423 (local address 127.0.0.1:58962)
0806 01:07:15.873589 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:15.873693 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.65:35423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260806 01:07:15.873769 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 30894
W20260806 01:07:15.878811 30685 catalog_manager.cc:4584] TS b7468a26d9e94fa99a82de7f8f3abead (127.11.88.65:35423): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4561144a2a8840429c8d0ba4d18d4cbc: Network error: Client connection negotiation failed: client connection to 127.11.88.65:35423: connect: Connection refused (error 111)
I20260806 01:07:15.882946 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 31028
I20260806 01:07:15.889537 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 30667
2026-08-06T01:07:15Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (751 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:07:15 dist-test-slave-69rg krb5kdc[31203](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:07:15 dist-test-slave-69rg krb5kdc[31203](info): set up 2 sockets
Aug 06 01:07:15 dist-test-slave-69rg krb5kdc[31203](info): commencing operation
krb5kdc: starting...
W20260806 01:07:17.007005 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.096s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:07:17 dist-test-slave-69rg krb5kdc[31203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:07:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:07:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:07:17.146636 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:46667
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:45333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:46667
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:17.232510 31216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:17.232790 31216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:17.232832 31216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:17.234127 31216 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:17.234210 31216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:17.234234 31216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:17.234254 31216 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:17.234287 31216 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:17.235932 31216 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:45333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:46667
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:46667
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31216
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:17.236267 31216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:17.236527 31216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:17.242269 31224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:17.242269 31221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:17.242301 31222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:17.242468 31216 server_base.cc:1034] running on GCE node
I20260806 01:07:17.242957 31216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:17.243326 31216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:17.244534 31216 hybrid_clock.cc:648] HybridClock initialized: now 1785978437244519 us; error 48 us; skew 500 ppm
Aug 06 01:07:17 dist-test-slave-69rg krb5kdc[31203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978437, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:17.247516 31216 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:07:17.248027 31216 webserver.cc:460] Webserver started at http://127.11.88.126:40029/ using document root <none> and password file <none>
I20260806 01:07:17.248294 31216 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:17.248345 31216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:17.248492 31216 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:17.249678 31216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "8e5c2aadab664f15997f0b27482a48ed"
format_stamp: "Formatted at 2026-08-06 01:07:17 on dist-test-slave-69rg"
server_key: "190e871b288d3c781178395e6f04ea73"
server_key_iv: "beea1a39fb2c239d4f81e5e983ebf27e"
server_key_version: "encryptionkey@0"
I20260806 01:07:17.250140 31216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "8e5c2aadab664f15997f0b27482a48ed"
format_stamp: "Formatted at 2026-08-06 01:07:17 on dist-test-slave-69rg"
server_key: "190e871b288d3c781178395e6f04ea73"
server_key_iv: "beea1a39fb2c239d4f81e5e983ebf27e"
server_key_version: "encryptionkey@0"
I20260806 01:07:17.251842 31216 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:07:17.252848 31232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:17.253125 31216 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:17.253254 31216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "8e5c2aadab664f15997f0b27482a48ed"
format_stamp: "Formatted at 2026-08-06 01:07:17 on dist-test-slave-69rg"
server_key: "190e871b288d3c781178395e6f04ea73"
server_key_iv: "beea1a39fb2c239d4f81e5e983ebf27e"
server_key_version: "encryptionkey@0"
I20260806 01:07:17.253355 31216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:17.264976 31216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:17.267606 31216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:17.267794 31216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:17.272214 31216 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:46667
I20260806 01:07:17.272344 31287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:46667 every 8 connection(s)
I20260806 01:07:17.272682 31216 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:07:17.272941 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 31216
I20260806 01:07:17.273094 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:07:17.273384 11617 external_mini_cluster.cc:1428] Setting key 3324ad3102a716523b521374452ec059
I20260806 01:07:17.273991 31288 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:17.277933 31288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e5c2aadab664f15997f0b27482a48ed: Bootstrap starting.
I20260806 01:07:17.278810 31288 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e5c2aadab664f15997f0b27482a48ed: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:17.279204 31288 log.cc:824] T 00000000000000000000000000000000 P 8e5c2aadab664f15997f0b27482a48ed: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:17.280063 31288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e5c2aadab664f15997f0b27482a48ed: No bootstrap required, opened a new log
Aug 06 01:07:17 dist-test-slave-69rg krb5kdc[31203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:07:17.282867 31288 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e5c2aadab664f15997f0b27482a48ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e5c2aadab664f15997f0b27482a48ed" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46667 } }
I20260806 01:07:17.283025 31288 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8e5c2aadab664f15997f0b27482a48ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:17.283120 31288 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e5c2aadab664f15997f0b27482a48ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e5c2aadab664f15997f0b27482a48ed, State: Initialized, Role: FOLLOWER
I20260806 01:07:17.283280 31288 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e5c2aadab664f15997f0b27482a48ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e5c2aadab664f15997f0b27482a48ed" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46667 } }
I20260806 01:07:17.283385 31288 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8e5c2aadab664f15997f0b27482a48ed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:07:17.283466 31288 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8e5c2aadab664f15997f0b27482a48ed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:07:17.283526 31288 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e5c2aadab664f15997f0b27482a48ed [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:17.284253 31288 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8e5c2aadab664f15997f0b27482a48ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e5c2aadab664f15997f0b27482a48ed" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46667 } }
I20260806 01:07:17.284380 31288 leader_election.cc:302] T 00000000000000000000000000000000 P 8e5c2aadab664f15997f0b27482a48ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e5c2aadab664f15997f0b27482a48ed; no voters:
I20260806 01:07:17.284610 31288 leader_election.cc:288] T 00000000000000000000000000000000 P 8e5c2aadab664f15997f0b27482a48ed [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:07:17.284669 31293 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8e5c2aadab664f15997f0b27482a48ed [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:17.284862 31293 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8e5c2aadab664f15997f0b27482a48ed [term 1 LEADER]: Becoming Leader. State: Replica: 8e5c2aadab664f15997f0b27482a48ed, State: Running, Role: LEADER
I20260806 01:07:17.284948 31288 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e5c2aadab664f15997f0b27482a48ed [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:17.284971 31293 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e5c2aadab664f15997f0b27482a48ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e5c2aadab664f15997f0b27482a48ed" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46667 } }
I20260806 01:07:17.285295 31293 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e5c2aadab664f15997f0b27482a48ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e5c2aadab664f15997f0b27482a48ed. Latest consensus state: current_term: 1 leader_uuid: "8e5c2aadab664f15997f0b27482a48ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e5c2aadab664f15997f0b27482a48ed" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46667 } } }
I20260806 01:07:17.285373 31293 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e5c2aadab664f15997f0b27482a48ed [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:17.285306 31295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e5c2aadab664f15997f0b27482a48ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8e5c2aadab664f15997f0b27482a48ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e5c2aadab664f15997f0b27482a48ed" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46667 } } }
I20260806 01:07:17.285435 31295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e5c2aadab664f15997f0b27482a48ed [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:17.286496 31298 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:07:17.286516 31291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:17.274033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56432 (local address 127.11.88.126:46667)
0806 01:07:17.274270 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:17.274280 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:17.274315 (+ 35us) server_negotiation.cc:407] Connection header received
0806 01:07:17.274925 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:17.274936 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:17.275009 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:17.275183 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:17.275856 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.277384 (+ 1528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.278372 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.279097 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.279227 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:17.282174 (+ 2947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:17.282179 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:17.282179 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:17.282192 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:17.284138 (+ 1946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:17.284626 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:17.284629 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:17.284630 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:17.284752 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:17.285047 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:17.285048 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:17.285049 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:17.285398 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:17.285545 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:17.286113 (+ 568us) server_negotiation.cc:299] Negotiation successful
0806 01:07:17.286269 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":110,"threads_started":1}
I20260806 01:07:17.287074 31298 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:07:17.288777 31298 catalog_manager.cc:1347] Generated new cluster ID: c2de12fd248341cd8d3f62a900345fdc
I20260806 01:07:17.288851 31298 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:07:17.303973 31298 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:07:17.304924 31298 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:07:17.307605 31298 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8e5c2aadab664f15997f0b27482a48ed: Generated new TSK 0
I20260806 01:07:17.307844 31298 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.88.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
Entry for principal kudu/127.11.88.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab.
I20260806 01:07:17.350515 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:0
--local_ip_for_outbound_sockets=127.11.88.65
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:46667
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:45333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:17.437650 31314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:17.437947 31314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:17.437979 31314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:17.439225 31314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:17.439270 31314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:17.439297 31314 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:07:17.440814 31314 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:45333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.65.keytab
--principal=kudu/127.11.88.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:46667
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31314
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:17.441092 31314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:17.441351 31314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:17.447260 31321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:17.447252 31323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:17.447341 31314 server_base.cc:1034] running on GCE node
W20260806 01:07:17.447273 31320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:17.447667 31314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:17.447901 31314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:17.449043 31314 hybrid_clock.cc:648] HybridClock initialized: now 1785978437449013 us; error 53 us; skew 500 ppm
Aug 06 01:07:17 dist-test-slave-69rg krb5kdc[31203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978437, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:17.451732 31314 init.cc:377] Logged in from keytab as kudu/127.11.88.65@KRBTEST.COM (short username kudu)
I20260806 01:07:17.452270 31314 webserver.cc:460] Webserver started at http://127.11.88.65:43859/ using document root <none> and password file <none>
I20260806 01:07:17.452466 31314 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:17.452507 31314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:17.452639 31314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:17.453732 31314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-0/data/instance:
uuid: "7914b07a530d4cfb8762c04b26100213"
format_stamp: "Formatted at 2026-08-06 01:07:17 on dist-test-slave-69rg"
server_key: "f8e39e226bd0836879baf5f78157f0ef"
server_key_iv: "58988d4a27d613645980abce90da5d27"
server_key_version: "encryptionkey@0"
I20260806 01:07:17.454118 31314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance:
uuid: "7914b07a530d4cfb8762c04b26100213"
format_stamp: "Formatted at 2026-08-06 01:07:17 on dist-test-slave-69rg"
server_key: "f8e39e226bd0836879baf5f78157f0ef"
server_key_iv: "58988d4a27d613645980abce90da5d27"
server_key_version: "encryptionkey@0"
I20260806 01:07:17.455420 31314 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:17.456271 31330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:17.456509 31314 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:17.456641 31314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "7914b07a530d4cfb8762c04b26100213"
format_stamp: "Formatted at 2026-08-06 01:07:17 on dist-test-slave-69rg"
server_key: "f8e39e226bd0836879baf5f78157f0ef"
server_key_iv: "58988d4a27d613645980abce90da5d27"
server_key_version: "encryptionkey@0"
I20260806 01:07:17.456722 31314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:17.468432 31314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:17.470976 31314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:17.471112 31314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:17.471323 31314 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:07:17.471671 31314 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:07:17.471712 31314 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:17.471735 31314 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:07:17.471748 31314 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:17.477953 31314 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:44973
I20260806 01:07:17.478068 31445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:44973 every 8 connection(s)
I20260806 01:07:17.478422 31314 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
Aug 06 01:07:17 dist-test-slave-69rg krb5kdc[31203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978437, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.65@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:07:17.486811 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 31314
I20260806 01:07:17.486974 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance
I20260806 01:07:17.487243 11617 external_mini_cluster.cc:1428] Setting key d2c9b40841faa9425390dfddab7ddac5
I20260806 01:07:17.489207 31291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:17.479373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:47513 (local address 127.11.88.126:46667)
0806 01:07:17.479452 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:17.479454 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:17.479675 (+ 221us) server_negotiation.cc:407] Connection header received
0806 01:07:17.480227 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:17.480229 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:17.480241 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:17.480313 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:17.481417 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.482032 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.483121 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.483372 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.483446 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:17.485964 (+ 2518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:17.485966 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:17.485966 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:17.485974 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:17.487675 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:17.488169 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:17.488170 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:17.488171 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:17.488241 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:17.488488 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:17.488489 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:17.488490 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:17.488643 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:17.488715 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:17.488969 (+ 254us) server_negotiation.cc:299] Negotiation successful
0806 01:07:17.489068 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 01:07:17.489223 31448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:17.479326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:46667 (local address 127.11.88.65:47513)
0806 01:07:17.479504 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:17.479552 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:17.480093 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:17.480391 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:17.480395 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:17.481066 (+ 671us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:17.481290 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:17.481296 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.482161 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.482162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:17.482998 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:17.483000 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.483470 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.483470 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:17.483578 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:17.484182 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:07:17.484192 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:17.485776 (+ 1584us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:17.487749 (+ 1973us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:17.487758 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:17.487761 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:17.488085 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:17.488313 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:17.488314 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:17.488314 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:17.488420 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:17.488708 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:17.488713 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:17.488836 (+ 123us) client_negotiation.cc:769] Sending connection context
0806 01:07:17.488919 (+ 83us) client_negotiation.cc:240] Negotiation successful
0806 01:07:17.489049 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":100,"threads_started":1}
I20260806 01:07:17.490468 31446 heartbeater.cc:347] Connected to a master server at 127.11.88.126:46667
I20260806 01:07:17.490595 31446 heartbeater.cc:464] Registering TS with master...
I20260806 01:07:17.490803 31446 heartbeater.cc:511] Master 127.11.88.126:46667 requested a full tablet report, sending...
I20260806 01:07:17.491389 31250 ts_manager.cc:194] Registered new tserver with Master: 7914b07a530d4cfb8762c04b26100213 (127.11.88.65:44973)
I20260806 01:07:17.492053 31250 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.65@KRBTEST.COM'} at 127.11.88.65:47513
WARNING: no policy specified for kudu/127.11.88.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
Entry for principal kudu/127.11.88.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab.
I20260806 01:07:17.518364 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:0
--local_ip_for_outbound_sockets=127.11.88.66
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:46667
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:45333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:17.608040 31451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:17.608300 31451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:17.608330 31451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:17.609570 31451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:17.609642 31451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:17.609673 31451 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:07:17.611430 31451 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:45333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.66.keytab
--principal=kudu/127.11.88.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:46667
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31451
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:17.611738 31451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:17.612018 31451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:17.618099 31456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:17.618158 31457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:17.618148 31459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:17.618346 31451 server_base.cc:1034] running on GCE node
I20260806 01:07:17.618592 31451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:17.618834 31451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:17.620012 31451 hybrid_clock.cc:648] HybridClock initialized: now 1785978437620008 us; error 42 us; skew 500 ppm
Aug 06 01:07:17 dist-test-slave-69rg krb5kdc[31203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978437, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:17.623160 31451 init.cc:377] Logged in from keytab as kudu/127.11.88.66@KRBTEST.COM (short username kudu)
I20260806 01:07:17.623782 31451 webserver.cc:460] Webserver started at http://127.11.88.66:35437/ using document root <none> and password file <none>
I20260806 01:07:17.624053 31451 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:17.624162 31451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:17.624333 31451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:17.625531 31451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-1/data/instance:
uuid: "a3ecfb2525014d4ba6d99d089e1e5050"
format_stamp: "Formatted at 2026-08-06 01:07:17 on dist-test-slave-69rg"
server_key: "45e5e2dd6a10ad4b80e0463ac8b91e57"
server_key_iv: "6267fcd4be4481054bdf9233e6e1c64b"
server_key_version: "encryptionkey@0"
I20260806 01:07:17.626017 31451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance:
uuid: "a3ecfb2525014d4ba6d99d089e1e5050"
format_stamp: "Formatted at 2026-08-06 01:07:17 on dist-test-slave-69rg"
server_key: "45e5e2dd6a10ad4b80e0463ac8b91e57"
server_key_iv: "6267fcd4be4481054bdf9233e6e1c64b"
server_key_version: "encryptionkey@0"
I20260806 01:07:17.627615 31451 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:17.628584 31467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:17.628829 31451 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:17.628944 31451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "a3ecfb2525014d4ba6d99d089e1e5050"
format_stamp: "Formatted at 2026-08-06 01:07:17 on dist-test-slave-69rg"
server_key: "45e5e2dd6a10ad4b80e0463ac8b91e57"
server_key_iv: "6267fcd4be4481054bdf9233e6e1c64b"
server_key_version: "encryptionkey@0"
I20260806 01:07:17.629033 31451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:17.638703 31451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:17.640694 31451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:17.640870 31451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:17.641134 31451 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:07:17.641484 31451 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:07:17.641543 31451 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:17.641587 31451 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:07:17.641611 31451 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:17.648317 31451 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:36049
I20260806 01:07:17.648355 31585 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:36049 every 8 connection(s)
I20260806 01:07:17.648768 31451 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
I20260806 01:07:17.654379 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 31451
I20260806 01:07:17.654516 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance
I20260806 01:07:17.654726 11617 external_mini_cluster.cc:1428] Setting key 6fcfc8f7403a8761aaca6c10e293347d
Aug 06 01:07:17 dist-test-slave-69rg krb5kdc[31203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978437, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.66@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:07:17.660110 31588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:17.649530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:46667 (local address 127.11.88.66:36699)
0806 01:07:17.649708 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:17.649751 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:17.650310 (+ 559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:17.650607 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:17.650611 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:17.651225 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:17.651433 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:17.651438 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.652139 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.652139 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:17.653058 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:17.653061 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.653464 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.653465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:17.653576 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:17.654181 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:07:17.654193 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:17.656184 (+ 1991us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:17.658325 (+ 2141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:17.658336 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:17.658339 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:17.658622 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:17.658894 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:17.658895 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:17.658896 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:17.659029 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:17.659337 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:17.659345 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:17.659508 (+ 163us) client_negotiation.cc:769] Sending connection context
0806 01:07:17.659684 (+ 176us) client_negotiation.cc:240] Negotiation successful
0806 01:07:17.659893 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":102,"threads_started":1}
I20260806 01:07:17.660499 31291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:17.649576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:36699 (local address 127.11.88.126:46667)
0806 01:07:17.649651 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:17.649653 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:17.649867 (+ 214us) server_negotiation.cc:407] Connection header received
0806 01:07:17.650445 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:17.650447 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:17.650458 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:17.650528 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:17.651547 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.652046 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.653148 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.653370 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.653454 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:17.656288 (+ 2834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:17.656289 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:17.656289 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:17.656296 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:17.658216 (+ 1920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:17.658716 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:17.658717 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:17.658718 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:17.658797 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:17.659124 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:17.659125 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:17.659125 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:17.659263 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:17.659348 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:17.660302 (+ 954us) server_negotiation.cc:299] Negotiation successful
0806 01:07:17.660397 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 01:07:17.660984 31586 heartbeater.cc:347] Connected to a master server at 127.11.88.126:46667
I20260806 01:07:17.661111 31586 heartbeater.cc:464] Registering TS with master...
I20260806 01:07:17.661331 31586 heartbeater.cc:511] Master 127.11.88.126:46667 requested a full tablet report, sending...
I20260806 01:07:17.661795 31250 ts_manager.cc:194] Registered new tserver with Master: a3ecfb2525014d4ba6d99d089e1e5050 (127.11.88.66:36049)
I20260806 01:07:17.662364 31250 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.66@KRBTEST.COM'} at 127.11.88.66:36699
WARNING: no policy specified for kudu/127.11.88.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
Entry for principal kudu/127.11.88.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab.
I20260806 01:07:17.685999 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:0
--local_ip_for_outbound_sockets=127.11.88.67
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:46667
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:45333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:17.770007 31591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:17.770248 31591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:17.770290 31591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:17.771492 31591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:17.771557 31591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:17.771607 31591 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:07:17.773137 31591 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:45333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.67.keytab
--principal=kudu/127.11.88.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:46667
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31591
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:17.773423 31591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:17.773669 31591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:17.779263 31597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:17.779242 31598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:17.779244 31600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:17.779275 31591 server_base.cc:1034] running on GCE node
I20260806 01:07:17.779753 31591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:17.780018 31591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:17.781158 31591 hybrid_clock.cc:648] HybridClock initialized: now 1785978437781145 us; error 28 us; skew 500 ppm
Aug 06 01:07:17 dist-test-slave-69rg krb5kdc[31203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978437, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:17.783784 31591 init.cc:377] Logged in from keytab as kudu/127.11.88.67@KRBTEST.COM (short username kudu)
I20260806 01:07:17.784231 31591 webserver.cc:460] Webserver started at http://127.11.88.67:36531/ using document root <none> and password file <none>
I20260806 01:07:17.784498 31591 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:17.784547 31591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:17.784687 31591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:17.785976 31591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-2/data/instance:
uuid: "748869fb46784c589d2c849550307956"
format_stamp: "Formatted at 2026-08-06 01:07:17 on dist-test-slave-69rg"
server_key: "786b424bf1b875056ab800f9d06bc0fb"
server_key_iv: "f6bd904bff3c73afa7818c1b5a3ddda0"
server_key_version: "encryptionkey@0"
I20260806 01:07:17.786342 31591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance:
uuid: "748869fb46784c589d2c849550307956"
format_stamp: "Formatted at 2026-08-06 01:07:17 on dist-test-slave-69rg"
server_key: "786b424bf1b875056ab800f9d06bc0fb"
server_key_iv: "f6bd904bff3c73afa7818c1b5a3ddda0"
server_key_version: "encryptionkey@0"
I20260806 01:07:17.787930 31591 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:17.788718 31607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:17.788914 31591 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:17.789018 31591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "748869fb46784c589d2c849550307956"
format_stamp: "Formatted at 2026-08-06 01:07:17 on dist-test-slave-69rg"
server_key: "786b424bf1b875056ab800f9d06bc0fb"
server_key_iv: "f6bd904bff3c73afa7818c1b5a3ddda0"
server_key_version: "encryptionkey@0"
I20260806 01:07:17.789103 31591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:17.805354 31591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:17.807925 31591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:17.808089 31591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:17.808359 31591 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:07:17.808692 31591 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:07:17.808727 31591 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:17.808750 31591 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:07:17.808795 31591 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:17.814953 31591 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:34543
I20260806 01:07:17.815045 31726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:34543 every 8 connection(s)
I20260806 01:07:17.815373 31591 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
Aug 06 01:07:17 dist-test-slave-69rg krb5kdc[31203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978437, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.67@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:07:17.821899 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 31591
I20260806 01:07:17.821991 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance
I20260806 01:07:17.822180 11617 external_mini_cluster.cc:1428] Setting key 52416861db925f2f40922ad3fa41ead1
I20260806 01:07:17.825476 31291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:17.816121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:40013 (local address 127.11.88.126:46667)
0806 01:07:17.816188 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:17.816190 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:17.816465 (+ 275us) server_negotiation.cc:407] Connection header received
0806 01:07:17.816963 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:17.816964 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:17.816975 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:17.817029 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:17.818057 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.818553 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.819672 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.819858 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.819914 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:17.822320 (+ 2406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:17.822321 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:17.822321 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:17.822329 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:17.823788 (+ 1459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:17.824243 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:17.824244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:17.824245 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:17.824309 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:17.824575 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:17.824576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:17.824577 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:17.824697 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:17.824768 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:17.825268 (+ 500us) server_negotiation.cc:299] Negotiation successful
0806 01:07:17.825366 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260806 01:07:17.825726 31729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:17.816102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:46667 (local address 127.11.88.67:40013)
0806 01:07:17.816318 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:17.816357 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:17.816873 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:17.817093 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:17.817096 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:17.817679 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:17.817963 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:17.817969 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.818670 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.818671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:17.819556 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:17.819559 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.819942 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.819942 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:17.820055 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:17.820554 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:07:17.820562 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:17.822185 (+ 1623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:17.823893 (+ 1708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:17.823901 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:17.823903 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:17.824162 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:17.824379 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:17.824380 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:17.824381 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:17.824500 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:17.824771 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:17.824779 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:17.824923 (+ 144us) client_negotiation.cc:769] Sending connection context
0806 01:07:17.825236 (+ 313us) client_negotiation.cc:240] Negotiation successful
0806 01:07:17.825440 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":125,"threads_started":1}
I20260806 01:07:17.826288 31727 heartbeater.cc:347] Connected to a master server at 127.11.88.126:46667
I20260806 01:07:17.826378 31727 heartbeater.cc:464] Registering TS with master...
I20260806 01:07:17.826588 31727 heartbeater.cc:511] Master 127.11.88.126:46667 requested a full tablet report, sending...
I20260806 01:07:17.827003 31250 ts_manager.cc:194] Registered new tserver with Master: 748869fb46784c589d2c849550307956 (127.11.88.67:34543)
I20260806 01:07:17.827415 31250 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.88.67@KRBTEST.COM'} at 127.11.88.67:40013
I20260806 01:07:17.834240 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 01:07:17.843267 31291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:17.835806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56448 (local address 127.11.88.126:46667)
0806 01:07:17.835890 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:17.835893 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:17.835993 (+ 100us) server_negotiation.cc:407] Connection header received
0806 01:07:17.836072 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:17.836073 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:17.836083 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:17.836135 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:17.836739 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.837300 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.838551 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.838779 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.838866 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:17.840323 (+ 1457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:17.840324 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:17.840324 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:17.840332 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:17.841978 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:17.842365 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:17.842367 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:17.842367 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:17.842433 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:17.842653 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:17.842654 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:17.842654 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:17.842831 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:17.842943 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:17.843055 (+ 112us) server_negotiation.cc:299] Negotiation successful
0806 01:07:17.843155 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 01:07:17.845561 31250 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56448:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 01:07:17.847357 31250 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:07:17.854838 31744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:17.850304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44746 (local address 127.11.88.65:44973)
0806 01:07:17.850496 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:17.850501 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:17.850962 (+ 461us) server_negotiation.cc:407] Connection header received
0806 01:07:17.851113 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:17.851115 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:17.851128 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:17.851185 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:17.851408 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.852384 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.853579 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.854383 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.854468 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:17.854534 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:17.854694 (+ 160us) server_negotiation.cc:299] Negotiation successful
0806 01:07:17.854744 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":113,"threads_started":1}
I20260806 01:07:17.854866 31739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:17.849933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:44973 (local address 127.0.0.1:44746)
0806 01:07:17.850821 (+ 888us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:17.850831 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:17.851011 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:17.851214 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:17.851215 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:17.851217 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:17.851309 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:17.851311 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.852485 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.852487 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:17.853489 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:17.853491 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.854480 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.854481 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:17.854569 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:17.854585 (+ 16us) client_negotiation.cc:769] Sending connection context
0806 01:07:17.854667 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 01:07:17.854744 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":863,"mutex_wait_us":37,"thread_start_us":68,"threads_started":1}
I20260806 01:07:17.855144 31741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:17.850162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:36049 (local address 127.0.0.1:47198)
0806 01:07:17.851276 (+ 1114us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:17.851284 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:17.851351 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:17.851509 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:17.851509 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:17.851511 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:17.851561 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:17.851563 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.852553 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.852554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:17.853979 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:17.853982 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.854838 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.854839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:17.854900 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:17.854904 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:07:17.855042 (+ 138us) client_negotiation.cc:240] Negotiation successful
0806 01:07:17.855083 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1097,"thread_start_us":104,"threads_started":1}
I20260806 01:07:17.854887 31738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:17.849932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:34543 (local address 127.0.0.1:33888)
0806 01:07:17.850119 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:17.850165 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:17.850234 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:17.850726 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:17.850730 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:17.850732 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:17.850809 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:17.850811 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.852170 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.852172 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:17.853607 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:17.853610 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.854571 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.854572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:17.854662 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:17.854669 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 01:07:17.854723 (+ 54us) client_negotiation.cc:240] Negotiation successful
0806 01:07:17.854777 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"mutex_wait_us":29,"thread_start_us":103,"threads_started":1}
I20260806 01:07:17.855386 31740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:17.850081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33888 (local address 127.11.88.67:34543)
0806 01:07:17.850549 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:17.850553 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:17.850562 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:07:17.850605 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:17.850606 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:17.850619 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:17.850711 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:17.850884 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.852053 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.853703 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.854414 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.854476 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:17.854534 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:17.855105 (+ 571us) server_negotiation.cc:299] Negotiation successful
0806 01:07:17.855158 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":91,"threads_started":1}
I20260806 01:07:17.855408 31743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:17.850280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47198 (local address 127.11.88.66:36049)
0806 01:07:17.850457 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:17.850462 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:17.851357 (+ 895us) server_negotiation.cc:407] Connection header received
0806 01:07:17.851412 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:17.851415 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:17.851429 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:17.851503 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:17.851621 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.852436 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.854062 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.854684 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.854747 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:17.854801 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:17.855256 (+ 455us) server_negotiation.cc:299] Negotiation successful
0806 01:07:17.855312 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":100,"threads_started":1}
I20260806 01:07:17.856222 31658 tablet_service.cc:1467] Processing CreateTablet for tablet 224d48634334485db95eacf236b7f4d8 (DEFAULT_TABLE table=test-table [id=49d92d409a774a3fafb4a4f850fbea18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:07:17.856303 31379 tablet_service.cc:1467] Processing CreateTablet for tablet 224d48634334485db95eacf236b7f4d8 (DEFAULT_TABLE table=test-table [id=49d92d409a774a3fafb4a4f850fbea18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:07:17.856321 31517 tablet_service.cc:1467] Processing CreateTablet for tablet 224d48634334485db95eacf236b7f4d8 (DEFAULT_TABLE table=test-table [id=49d92d409a774a3fafb4a4f850fbea18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:07:17.856647 31379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 224d48634334485db95eacf236b7f4d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:17.856644 31658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 224d48634334485db95eacf236b7f4d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:17.856644 31517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 224d48634334485db95eacf236b7f4d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:17.860709 31745 tablet_bootstrap.cc:492] T 224d48634334485db95eacf236b7f4d8 P 7914b07a530d4cfb8762c04b26100213: Bootstrap starting.
I20260806 01:07:17.861209 31746 tablet_bootstrap.cc:492] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050: Bootstrap starting.
I20260806 01:07:17.861596 31745 tablet_bootstrap.cc:654] T 224d48634334485db95eacf236b7f4d8 P 7914b07a530d4cfb8762c04b26100213: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:17.861986 31746 tablet_bootstrap.cc:654] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:17.861985 31747 tablet_bootstrap.cc:492] T 224d48634334485db95eacf236b7f4d8 P 748869fb46784c589d2c849550307956: Bootstrap starting.
I20260806 01:07:17.862267 31745 log.cc:824] T 224d48634334485db95eacf236b7f4d8 P 7914b07a530d4cfb8762c04b26100213: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:17.862684 31746 log.cc:824] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:17.862756 31747 tablet_bootstrap.cc:654] T 224d48634334485db95eacf236b7f4d8 P 748869fb46784c589d2c849550307956: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:17.863320 31745 tablet_bootstrap.cc:492] T 224d48634334485db95eacf236b7f4d8 P 7914b07a530d4cfb8762c04b26100213: No bootstrap required, opened a new log
I20260806 01:07:17.863416 31745 ts_tablet_manager.cc:1397] T 224d48634334485db95eacf236b7f4d8 P 7914b07a530d4cfb8762c04b26100213: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 01:07:17.863410 31747 log.cc:824] T 224d48634334485db95eacf236b7f4d8 P 748869fb46784c589d2c849550307956: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:17.863608 31746 tablet_bootstrap.cc:492] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050: No bootstrap required, opened a new log
I20260806 01:07:17.863691 31746 ts_tablet_manager.cc:1397] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260806 01:07:17.864253 31747 tablet_bootstrap.cc:492] T 224d48634334485db95eacf236b7f4d8 P 748869fb46784c589d2c849550307956: No bootstrap required, opened a new log
I20260806 01:07:17.864383 31747 ts_tablet_manager.cc:1397] T 224d48634334485db95eacf236b7f4d8 P 748869fb46784c589d2c849550307956: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 01:07:17.865285 31745 raft_consensus.cc:348] T 224d48634334485db95eacf236b7f4d8 P 7914b07a530d4cfb8762c04b26100213 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7914b07a530d4cfb8762c04b26100213" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 44973 } } peers { permanent_uuid: "748869fb46784c589d2c849550307956" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34543 } } peers { permanent_uuid: "a3ecfb2525014d4ba6d99d089e1e5050" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36049 } }
I20260806 01:07:17.865465 31745 raft_consensus.cc:374] T 224d48634334485db95eacf236b7f4d8 P 7914b07a530d4cfb8762c04b26100213 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:17.865509 31745 raft_consensus.cc:729] T 224d48634334485db95eacf236b7f4d8 P 7914b07a530d4cfb8762c04b26100213 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7914b07a530d4cfb8762c04b26100213, State: Initialized, Role: FOLLOWER
I20260806 01:07:17.865649 31745 consensus_queue.cc:260] T 224d48634334485db95eacf236b7f4d8 P 7914b07a530d4cfb8762c04b26100213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7914b07a530d4cfb8762c04b26100213" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 44973 } } peers { permanent_uuid: "748869fb46784c589d2c849550307956" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34543 } } peers { permanent_uuid: "a3ecfb2525014d4ba6d99d089e1e5050" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36049 } }
I20260806 01:07:17.865988 31745 ts_tablet_manager.cc:1428] T 224d48634334485db95eacf236b7f4d8 P 7914b07a530d4cfb8762c04b26100213: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 01:07:17.866149 31446 heartbeater.cc:503] Master 127.11.88.126:46667 was elected leader, sending a full tablet report...
I20260806 01:07:17.866040 31746 raft_consensus.cc:348] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7914b07a530d4cfb8762c04b26100213" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 44973 } } peers { permanent_uuid: "748869fb46784c589d2c849550307956" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34543 } } peers { permanent_uuid: "a3ecfb2525014d4ba6d99d089e1e5050" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36049 } }
I20260806 01:07:17.866237 31746 raft_consensus.cc:374] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:17.866293 31746 raft_consensus.cc:729] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3ecfb2525014d4ba6d99d089e1e5050, State: Initialized, Role: FOLLOWER
I20260806 01:07:17.866451 31746 consensus_queue.cc:260] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7914b07a530d4cfb8762c04b26100213" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 44973 } } peers { permanent_uuid: "748869fb46784c589d2c849550307956" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34543 } } peers { permanent_uuid: "a3ecfb2525014d4ba6d99d089e1e5050" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36049 } }
I20260806 01:07:17.866803 31586 heartbeater.cc:503] Master 127.11.88.126:46667 was elected leader, sending a full tablet report...
I20260806 01:07:17.866789 31746 ts_tablet_manager.cc:1428] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260806 01:07:17.866743 31747 raft_consensus.cc:348] T 224d48634334485db95eacf236b7f4d8 P 748869fb46784c589d2c849550307956 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7914b07a530d4cfb8762c04b26100213" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 44973 } } peers { permanent_uuid: "748869fb46784c589d2c849550307956" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34543 } } peers { permanent_uuid: "a3ecfb2525014d4ba6d99d089e1e5050" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36049 } }
I20260806 01:07:17.866915 31747 raft_consensus.cc:374] T 224d48634334485db95eacf236b7f4d8 P 748869fb46784c589d2c849550307956 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:17.866956 31747 raft_consensus.cc:729] T 224d48634334485db95eacf236b7f4d8 P 748869fb46784c589d2c849550307956 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 748869fb46784c589d2c849550307956, State: Initialized, Role: FOLLOWER
I20260806 01:07:17.867111 31747 consensus_queue.cc:260] T 224d48634334485db95eacf236b7f4d8 P 748869fb46784c589d2c849550307956 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7914b07a530d4cfb8762c04b26100213" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 44973 } } peers { permanent_uuid: "748869fb46784c589d2c849550307956" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34543 } } peers { permanent_uuid: "a3ecfb2525014d4ba6d99d089e1e5050" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36049 } }
I20260806 01:07:17.867436 31747 ts_tablet_manager.cc:1428] T 224d48634334485db95eacf236b7f4d8 P 748869fb46784c589d2c849550307956: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 01:07:17.867466 31727 heartbeater.cc:503] Master 127.11.88.126:46667 was elected leader, sending a full tablet report...
W20260806 01:07:17.899467 31587 tablet.cc:2369] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 01:07:17.946165 31752 raft_consensus.cc:482] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:07:17.946367 31752 raft_consensus.cc:504] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7914b07a530d4cfb8762c04b26100213" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 44973 } } peers { permanent_uuid: "748869fb46784c589d2c849550307956" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34543 } } peers { permanent_uuid: "a3ecfb2525014d4ba6d99d089e1e5050" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36049 } }
I20260806 01:07:17.946831 31752 leader_election.cc:288] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7914b07a530d4cfb8762c04b26100213 (127.11.88.65:44973), 748869fb46784c589d2c849550307956 (127.11.88.67:34543)
I20260806 01:07:17.950183 31588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:17.947048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:34543 (local address 127.11.88.66:59371)
0806 01:07:17.947116 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:17.947128 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:17.947172 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:17.947326 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:17.947327 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:17.947328 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:17.947411 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:17.947413 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.948175 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.948176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:17.949021 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:17.949023 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.949870 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.949871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:17.949962 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:17.949967 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 01:07:17.950035 (+ 68us) client_negotiation.cc:240] Negotiation successful
0806 01:07:17.950094 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260806 01:07:17.950371 31740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:17.947147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:59371 (local address 127.11.88.67:34543)
0806 01:07:17.947199 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:17.947201 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:17.947211 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:07:17.947241 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:17.947242 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:17.947251 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:17.947311 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:17.947521 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.948078 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.949141 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.949671 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.949736 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:17.949744 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:17.950129 (+ 385us) server_negotiation.cc:299] Negotiation successful
0806 01:07:17.950244 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260806 01:07:17.950510 31744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:17.947112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:38781 (local address 127.11.88.65:44973)
0806 01:07:17.947220 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:17.947223 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:17.947371 (+ 148us) server_negotiation.cc:407] Connection header received
0806 01:07:17.947425 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:17.947426 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:17.947437 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:17.947497 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:17.947715 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.948229 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.949424 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.950029 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.950101 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:17.950110 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:17.950361 (+ 251us) server_negotiation.cc:299] Negotiation successful
0806 01:07:17.950423 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 01:07:17.950790 31754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:17.947057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:44973 (local address 127.11.88.66:38781)
0806 01:07:17.947282 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:17.947318 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:17.947373 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:17.947524 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:17.947525 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:17.947527 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:17.947612 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:17.947614 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.948346 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.948347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:17.949277 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:17.949280 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.950145 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.950146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:17.950236 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:17.950241 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 01:07:17.950615 (+ 374us) client_negotiation.cc:240] Negotiation successful
0806 01:07:17.950686 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"mutex_wait_us":3,"thread_start_us":135,"threads_started":1}
I20260806 01:07:17.950747 31679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "224d48634334485db95eacf236b7f4d8" candidate_uuid: "a3ecfb2525014d4ba6d99d089e1e5050" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "748869fb46784c589d2c849550307956" is_pre_election: true
I20260806 01:07:17.950960 31679 raft_consensus.cc:2454] T 224d48634334485db95eacf236b7f4d8 P 748869fb46784c589d2c849550307956 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ecfb2525014d4ba6d99d089e1e5050 in term 0.
I20260806 01:07:17.951241 31469 leader_election.cc:302] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 748869fb46784c589d2c849550307956, a3ecfb2525014d4ba6d99d089e1e5050; no voters:
I20260806 01:07:17.951188 31399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "224d48634334485db95eacf236b7f4d8" candidate_uuid: "a3ecfb2525014d4ba6d99d089e1e5050" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7914b07a530d4cfb8762c04b26100213" is_pre_election: true
I20260806 01:07:17.951356 31399 raft_consensus.cc:2454] T 224d48634334485db95eacf236b7f4d8 P 7914b07a530d4cfb8762c04b26100213 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3ecfb2525014d4ba6d99d089e1e5050 in term 0.
I20260806 01:07:17.951426 31752 raft_consensus.cc:2781] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:07:17.951507 31752 raft_consensus.cc:482] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:07:17.951542 31752 raft_consensus.cc:3037] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:17.952332 31752 raft_consensus.cc:504] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7914b07a530d4cfb8762c04b26100213" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 44973 } } peers { permanent_uuid: "748869fb46784c589d2c849550307956" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34543 } } peers { permanent_uuid: "a3ecfb2525014d4ba6d99d089e1e5050" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36049 } }
I20260806 01:07:17.952502 31752 leader_election.cc:288] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050 [CANDIDATE]: Term 1 election: Requested vote from peers 7914b07a530d4cfb8762c04b26100213 (127.11.88.65:44973), 748869fb46784c589d2c849550307956 (127.11.88.67:34543)
I20260806 01:07:17.952728 31399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "224d48634334485db95eacf236b7f4d8" candidate_uuid: "a3ecfb2525014d4ba6d99d089e1e5050" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7914b07a530d4cfb8762c04b26100213"
I20260806 01:07:17.952700 31679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "224d48634334485db95eacf236b7f4d8" candidate_uuid: "a3ecfb2525014d4ba6d99d089e1e5050" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "748869fb46784c589d2c849550307956"
I20260806 01:07:17.952838 31399 raft_consensus.cc:3037] T 224d48634334485db95eacf236b7f4d8 P 7914b07a530d4cfb8762c04b26100213 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:17.952834 31679 raft_consensus.cc:3037] T 224d48634334485db95eacf236b7f4d8 P 748869fb46784c589d2c849550307956 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:17.953737 31399 raft_consensus.cc:2454] T 224d48634334485db95eacf236b7f4d8 P 7914b07a530d4cfb8762c04b26100213 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ecfb2525014d4ba6d99d089e1e5050 in term 1.
I20260806 01:07:17.953773 31679 raft_consensus.cc:2454] T 224d48634334485db95eacf236b7f4d8 P 748869fb46784c589d2c849550307956 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3ecfb2525014d4ba6d99d089e1e5050 in term 1.
I20260806 01:07:17.953975 31468 leader_election.cc:302] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7914b07a530d4cfb8762c04b26100213, a3ecfb2525014d4ba6d99d089e1e5050; no voters:
I20260806 01:07:17.954095 31752 raft_consensus.cc:2781] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:17.954314 31752 raft_consensus.cc:686] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050 [term 1 LEADER]: Becoming Leader. State: Replica: a3ecfb2525014d4ba6d99d089e1e5050, State: Running, Role: LEADER
I20260806 01:07:17.954438 31752 consensus_queue.cc:237] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7914b07a530d4cfb8762c04b26100213" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 44973 } } peers { permanent_uuid: "748869fb46784c589d2c849550307956" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34543 } } peers { permanent_uuid: "a3ecfb2525014d4ba6d99d089e1e5050" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36049 } }
I20260806 01:07:17.955384 31250 catalog_manager.cc:5495] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3ecfb2525014d4ba6d99d089e1e5050 (127.11.88.66). New cstate: current_term: 1 leader_uuid: "a3ecfb2525014d4ba6d99d089e1e5050" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7914b07a530d4cfb8762c04b26100213" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 44973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "748869fb46784c589d2c849550307956" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3ecfb2525014d4ba6d99d089e1e5050" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 36049 } health_report { overall_health: HEALTHY } } }
I20260806 01:07:17.974852 31743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:17.972187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47214 (local address 127.11.88.66:36049)
0806 01:07:17.972270 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:17.972272 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:17.972282 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:07:17.972340 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:17.972341 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:17.972363 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:17.972453 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:07:17.972604 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.973118 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.973976 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:17.974178 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:17.974256 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:17.974449 (+ 193us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:07:17.974557 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:07:17.974670 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:17.974698 (+ 28us) server_negotiation.cc:299] Negotiation successful
0806 01:07:17.974734 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 01:07:17.976869 31679 raft_consensus.cc:1261] T 224d48634334485db95eacf236b7f4d8 P 748869fb46784c589d2c849550307956 [term 1 FOLLOWER]: Refusing update from remote peer a3ecfb2525014d4ba6d99d089e1e5050: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:07:17.976869 31399 raft_consensus.cc:1261] T 224d48634334485db95eacf236b7f4d8 P 7914b07a530d4cfb8762c04b26100213 [term 1 FOLLOWER]: Refusing update from remote peer a3ecfb2525014d4ba6d99d089e1e5050: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:07:17.977290 31752 consensus_queue.cc:1035] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050 [LEADER]: Connected to new peer: Peer: permanent_uuid: "748869fb46784c589d2c849550307956" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 34543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:07:17.977437 31755 consensus_queue.cc:1035] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7914b07a530d4cfb8762c04b26100213" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 44973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 01:07:17.979290 31447 tablet.cc:2369] T 224d48634334485db95eacf236b7f4d8 P 7914b07a530d4cfb8762c04b26100213: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 01:07:17.980283 31760 mvcc.cc:205] Tried to move back new op lower bound from 7315367681950191616 to 7315367681862299648. Current Snapshot: MvccSnapshot[applied={T|T < 7315367681950191616}]
I20260806 01:07:17.981070 31759 mvcc.cc:205] Tried to move back new op lower bound from 7315367681950191616 to 7315367681862299648. Current Snapshot: MvccSnapshot[applied={T|T < 7315367681950191616}]
I20260806 01:07:17.982757 31249 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56448:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:07:17.982882 31249 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56448:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:07:17.983820 31249 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8e5c2aadab664f15997f0b27482a48ed: Sending DeleteTablet for 3 replicas of tablet 224d48634334485db95eacf236b7f4d8
I20260806 01:07:17.984216 31379 tablet_service.cc:1514] Processing DeleteTablet for tablet 224d48634334485db95eacf236b7f4d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:07:17 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:44746
I20260806 01:07:17.984234 31658 tablet_service.cc:1514] Processing DeleteTablet for tablet 224d48634334485db95eacf236b7f4d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:07:17 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:33888
I20260806 01:07:17.984508 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 31314
I20260806 01:07:17.985687 31517 tablet_service.cc:1514] Processing DeleteTablet for tablet 224d48634334485db95eacf236b7f4d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:07:17 UTC) from {username='kudu', principal='kudu/127.11.88.126@KRBTEST.COM'} at 127.0.0.1:47198
I20260806 01:07:17.985960 31769 tablet_replica.cc:330] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050: stopping tablet replica
I20260806 01:07:17.986101 31769 raft_consensus.cc:2229] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050 [term 1 LEADER]: Raft consensus shutting down.
I20260806 01:07:17.986225 31769 raft_consensus.cc:2258] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:07:17.986724 31769 ts_tablet_manager.cc:1905] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:07:17.988752 31769 ts_tablet_manager.cc:1918] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:07:17.988849 31769 log.cc:1196] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-1/wal/wals/224d48634334485db95eacf236b7f4d8
I20260806 01:07:17.989159 31769 ts_tablet_manager.cc:1939] T 224d48634334485db95eacf236b7f4d8 P a3ecfb2525014d4ba6d99d089e1e5050: Deleting consensus metadata
I20260806 01:07:17.989660 31233 catalog_manager.cc:4841] TS a3ecfb2525014d4ba6d99d089e1e5050 (127.11.88.66:36049): tablet 224d48634334485db95eacf236b7f4d8 (table test-table [id=49d92d409a774a3fafb4a4f850fbea18]) successfully deleted
I20260806 01:07:17.993423 31768 tablet_replica.cc:330] T 224d48634334485db95eacf236b7f4d8 P 748869fb46784c589d2c849550307956: stopping tablet replica
W20260806 01:07:17.993422 31233 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.88.65:44973 (error 108)
I20260806 01:07:17.993605 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 31451
I20260806 01:07:17.995517 31768 raft_consensus.cc:2229] T 224d48634334485db95eacf236b7f4d8 P 748869fb46784c589d2c849550307956 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:07:17.995721 31768 raft_consensus.cc:2258] T 224d48634334485db95eacf236b7f4d8 P 748869fb46784c589d2c849550307956 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:07:17.996554 31768 ts_tablet_manager.cc:1905] T 224d48634334485db95eacf236b7f4d8 P 748869fb46784c589d2c849550307956: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:07:17.996706 31739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:17.996482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:44973 (local address 127.0.0.1:44750)
0806 01:07:17.996568 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:17.996628 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.65:44973: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260806 01:07:17.996918 31233 catalog_manager.cc:4584] TS 7914b07a530d4cfb8762c04b26100213 (127.11.88.65:44973): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 224d48634334485db95eacf236b7f4d8: Network error: Client connection negotiation failed: client connection to 127.11.88.65:44973: connect: Connection refused (error 111)
I20260806 01:07:17.999441 31768 ts_tablet_manager.cc:1918] T 224d48634334485db95eacf236b7f4d8 P 748869fb46784c589d2c849550307956: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:07:17.999575 31768 log.cc:1196] T 224d48634334485db95eacf236b7f4d8 P 748869fb46784c589d2c849550307956: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785978186227899-11617-0/minicluster-data/ts-2/wal/wals/224d48634334485db95eacf236b7f4d8
I20260806 01:07:18.000113 31768 ts_tablet_manager.cc:1939] T 224d48634334485db95eacf236b7f4d8 P 748869fb46784c589d2c849550307956: Deleting consensus metadata
I20260806 01:07:18.001225 31234 catalog_manager.cc:4841] TS 748869fb46784c589d2c849550307956 (127.11.88.67:34543): tablet 224d48634334485db95eacf236b7f4d8 (table test-table [id=49d92d409a774a3fafb4a4f850fbea18]) successfully deleted
I20260806 01:07:18.002089 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 31591
I20260806 01:07:18.009469 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 31216
2026-08-06T01:07:18Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2122 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-06T01:07:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:07:18Z Disabled control of system clock
I20260806 01:07:18.043525 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:32947
--webserver_interface=127.11.88.126
--webserver_port=0
--builtin_ntp_servers=127.11.88.84:45149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:32947
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 01:07:18.133493 31774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:18.133723 31774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:18.133798 31774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:18.134996 31774 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:18.135043 31774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:18.135062 31774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:18.135075 31774 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:18.135087 31774 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:18.136413 31774 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:45149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:32947
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:32947
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31774
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:18.136621 31774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:18.136870 31774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:18.142024 31779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:18.142079 31781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:18.142141 31774 server_base.cc:1034] running on GCE node
W20260806 01:07:18.142004 31783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:18.142649 31774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:18.142982 31774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:18.144199 31774 hybrid_clock.cc:648] HybridClock initialized: now 1785978438144184 us; error 32 us; skew 500 ppm
I20260806 01:07:18.145574 31774 webserver.cc:460] Webserver started at http://127.11.88.126:43309/ using document root <none> and password file <none>
I20260806 01:07:18.145910 31774 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:18.145963 31774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:18.146122 31774 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:18.147236 31774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "1d7486bdfe9a4ec8af09d6402403f705"
format_stamp: "Formatted at 2026-08-06 01:07:18 on dist-test-slave-69rg"
server_key: "7f3a406509cbe5544a23d41d48e0e88d"
server_key_iv: "76db9c2568670471d84cba99b10a298f"
server_key_version: "encryptionkey@0"
I20260806 01:07:18.147604 31774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "1d7486bdfe9a4ec8af09d6402403f705"
format_stamp: "Formatted at 2026-08-06 01:07:18 on dist-test-slave-69rg"
server_key: "7f3a406509cbe5544a23d41d48e0e88d"
server_key_iv: "76db9c2568670471d84cba99b10a298f"
server_key_version: "encryptionkey@0"
I20260806 01:07:18.149053 31774 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:07:18.149997 31789 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:18.150215 31774 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:18.150332 31774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "1d7486bdfe9a4ec8af09d6402403f705"
format_stamp: "Formatted at 2026-08-06 01:07:18 on dist-test-slave-69rg"
server_key: "7f3a406509cbe5544a23d41d48e0e88d"
server_key_iv: "76db9c2568670471d84cba99b10a298f"
server_key_version: "encryptionkey@0"
I20260806 01:07:18.150426 31774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:18.176781 31774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:18.177201 31774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:18.177390 31774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:18.182163 31774 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:32947
I20260806 01:07:18.182226 31846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:32947 every 8 connection(s)
I20260806 01:07:18.182636 31774 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:07:18.183670 31847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:18.186199 31847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d7486bdfe9a4ec8af09d6402403f705: Bootstrap starting.
I20260806 01:07:18.186853 31847 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d7486bdfe9a4ec8af09d6402403f705: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:18.187202 31847 log.cc:824] T 00000000000000000000000000000000 P 1d7486bdfe9a4ec8af09d6402403f705: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:18.188069 31847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d7486bdfe9a4ec8af09d6402403f705: No bootstrap required, opened a new log
I20260806 01:07:18.189844 31847 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d7486bdfe9a4ec8af09d6402403f705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d7486bdfe9a4ec8af09d6402403f705" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 32947 } }
I20260806 01:07:18.190042 31847 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1d7486bdfe9a4ec8af09d6402403f705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:18.190066 31847 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d7486bdfe9a4ec8af09d6402403f705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d7486bdfe9a4ec8af09d6402403f705, State: Initialized, Role: FOLLOWER
I20260806 01:07:18.190251 31847 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d7486bdfe9a4ec8af09d6402403f705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d7486bdfe9a4ec8af09d6402403f705" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 32947 } }
I20260806 01:07:18.190322 31847 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d7486bdfe9a4ec8af09d6402403f705 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:07:18.190346 31847 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d7486bdfe9a4ec8af09d6402403f705 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:07:18.190413 31847 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d7486bdfe9a4ec8af09d6402403f705 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:18.191010 31847 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d7486bdfe9a4ec8af09d6402403f705 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d7486bdfe9a4ec8af09d6402403f705" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 32947 } }
I20260806 01:07:18.191103 31847 leader_election.cc:302] T 00000000000000000000000000000000 P 1d7486bdfe9a4ec8af09d6402403f705 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d7486bdfe9a4ec8af09d6402403f705; no voters:
I20260806 01:07:18.191310 31847 leader_election.cc:288] T 00000000000000000000000000000000 P 1d7486bdfe9a4ec8af09d6402403f705 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:07:18.191435 31851 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d7486bdfe9a4ec8af09d6402403f705 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:18.191639 31847 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d7486bdfe9a4ec8af09d6402403f705 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:18.191687 31851 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d7486bdfe9a4ec8af09d6402403f705 [term 1 LEADER]: Becoming Leader. State: Replica: 1d7486bdfe9a4ec8af09d6402403f705, State: Running, Role: LEADER
I20260806 01:07:18.191803 31851 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d7486bdfe9a4ec8af09d6402403f705 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d7486bdfe9a4ec8af09d6402403f705" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 32947 } }
I20260806 01:07:18.192230 31853 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d7486bdfe9a4ec8af09d6402403f705 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d7486bdfe9a4ec8af09d6402403f705. Latest consensus state: current_term: 1 leader_uuid: "1d7486bdfe9a4ec8af09d6402403f705" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d7486bdfe9a4ec8af09d6402403f705" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 32947 } } }
I20260806 01:07:18.192346 31853 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d7486bdfe9a4ec8af09d6402403f705 [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:18.192387 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 31774
I20260806 01:07:18.192492 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:07:18.192337 31852 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d7486bdfe9a4ec8af09d6402403f705 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d7486bdfe9a4ec8af09d6402403f705" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d7486bdfe9a4ec8af09d6402403f705" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 32947 } } }
I20260806 01:07:18.192611 31852 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d7486bdfe9a4ec8af09d6402403f705 [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:18.192755 11617 external_mini_cluster.cc:1428] Setting key 55106a4f23e1cf7e6009fe3762cac2a7
I20260806 01:07:18.192773 31860 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:07:18.193351 31860 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:07:18.195333 31860 catalog_manager.cc:1347] Generated new cluster ID: 684250a4c7384e6ba157eea80e491f5b
I20260806 01:07:18.195387 31860 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:07:18.199596 31870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:18.193444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33024 (local address 127.11.88.126:32947)
0806 01:07:18.193741 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:18.193751 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:18.193884 (+ 133us) server_negotiation.cc:407] Connection header received
0806 01:07:18.194190 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:18.194200 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:18.194278 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:18.194437 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:18.194788 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.196109 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.197244 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.197894 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.198360 (+ 466us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:18.198822 (+ 462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:18.198826 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:18.198827 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:18.199062 (+ 235us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:18.199107 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:18.199124 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:18.199204 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:18.199289 (+ 85us) server_negotiation.cc:299] Negotiation successful
0806 01:07:18.199378 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":76,"threads_started":1}
I20260806 01:07:18.201465 31860 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:07:18.202173 31860 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:07:18.207672 31860 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1d7486bdfe9a4ec8af09d6402403f705: Generated new TSK 0
I20260806 01:07:18.207898 31860 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:07:18.211766 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.65:0
--local_ip_for_outbound_sockets=127.11.88.65
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:32947
--builtin_ntp_servers=127.11.88.84:45149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 01:07:18.299974 31872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:18.300195 31872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:18.300220 31872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:18.301493 31872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:18.301545 31872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:18.301570 31872 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.65
I20260806 01:07:18.303092 31872 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:45149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.88.65
--webserver_port=0
--tserver_master_addrs=127.11.88.126:32947
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31872
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.65
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:18.303391 31872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:18.303733 31872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:18.309211 31878 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:18.309211 31877 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:18.309423 31880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:18.309526 31872 server_base.cc:1034] running on GCE node
I20260806 01:07:18.309756 31872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:18.310040 31872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:18.311190 31872 hybrid_clock.cc:648] HybridClock initialized: now 1785978438311177 us; error 32 us; skew 500 ppm
I20260806 01:07:18.312533 31872 webserver.cc:460] Webserver started at http://127.11.88.65:32987/ using document root <none> and password file <none>
I20260806 01:07:18.312829 31872 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:18.312878 31872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:18.313035 31872 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:18.314277 31872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-0/data/instance:
uuid: "6e42c7d14ed9422b9d95140953105140"
format_stamp: "Formatted at 2026-08-06 01:07:18 on dist-test-slave-69rg"
server_key: "b252fb5aad4387340d08e3845d0869e4"
server_key_iv: "77b77c2d0b3e1dd93b126e724a9aef13"
server_key_version: "encryptionkey@0"
I20260806 01:07:18.314651 31872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance:
uuid: "6e42c7d14ed9422b9d95140953105140"
format_stamp: "Formatted at 2026-08-06 01:07:18 on dist-test-slave-69rg"
server_key: "b252fb5aad4387340d08e3845d0869e4"
server_key_iv: "77b77c2d0b3e1dd93b126e724a9aef13"
server_key_version: "encryptionkey@0"
I20260806 01:07:18.316102 31872 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 01:07:18.316969 31886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:18.317167 31872 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:18.317296 31872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-0/wal
uuid: "6e42c7d14ed9422b9d95140953105140"
format_stamp: "Formatted at 2026-08-06 01:07:18 on dist-test-slave-69rg"
server_key: "b252fb5aad4387340d08e3845d0869e4"
server_key_iv: "77b77c2d0b3e1dd93b126e724a9aef13"
server_key_version: "encryptionkey@0"
I20260806 01:07:18.317387 31872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:18.329396 31872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:18.329739 31872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:18.329942 31872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:18.330191 31872 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:07:18.330555 31872 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:07:18.330614 31872 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:18.330658 31872 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:07:18.330683 31872 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:18.337028 31872 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.65:36691
I20260806 01:07:18.337080 32000 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.65:36691 every 8 connection(s)
I20260806 01:07:18.337432 31872 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-0/data/info.pb
I20260806 01:07:18.338075 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 31872
I20260806 01:07:18.338219 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-0/wal/instance
I20260806 01:07:18.338461 11617 external_mini_cluster.cc:1428] Setting key 9878d1708769ad1e2722c9ae772243ce
I20260806 01:07:18.339579 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.66:0
--local_ip_for_outbound_sockets=127.11.88.66
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:32947
--builtin_ntp_servers=127.11.88.84:45149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 01:07:18.344209 31870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:18.338347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.65:38067 (local address 127.11.88.126:32947)
0806 01:07:18.338403 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:18.338405 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:18.338799 (+ 394us) server_negotiation.cc:407] Connection header received
0806 01:07:18.339392 (+ 593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:18.339394 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:18.339409 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:18.339477 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:18.340245 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.341008 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.342586 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.342926 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.343004 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:18.343851 (+ 847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:18.343853 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:18.343853 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:18.343859 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:18.343879 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:18.343884 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:18.343950 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:18.344037 (+ 87us) server_negotiation.cc:299] Negotiation successful
0806 01:07:18.344071 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 01:07:18.344300 32003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:18.338261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:32947 (local address 127.11.88.65:38067)
0806 01:07:18.338649 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:18.338706 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:18.339272 (+ 566us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:18.339550 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:18.339554 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:18.339562 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:18.340150 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:18.340155 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.341127 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.341128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:18.342499 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:18.342503 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.343019 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.343020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:18.343126 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:18.343708 (+ 582us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 01:07:18.343708 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:18.343737 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 01:07:18.343766 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:18.343958 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:18.343962 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:18.343965 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:07:18.344019 (+ 54us) client_negotiation.cc:240] Negotiation successful
0806 01:07:18.344103 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":96,"threads_started":1}
I20260806 01:07:18.344898 32001 heartbeater.cc:347] Connected to a master server at 127.11.88.126:32947
I20260806 01:07:18.345001 32001 heartbeater.cc:464] Registering TS with master...
I20260806 01:07:18.345189 32001 heartbeater.cc:511] Master 127.11.88.126:32947 requested a full tablet report, sending...
I20260806 01:07:18.345783 31807 ts_manager.cc:194] Registered new tserver with Master: 6e42c7d14ed9422b9d95140953105140 (127.11.88.65:36691)
I20260806 01:07:18.346817 31807 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.88.65:38067
W20260806 01:07:18.426563 32004 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:18.426829 32004 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:18.426870 32004 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:18.428119 32004 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:18.428192 32004 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:18.428241 32004 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.66
I20260806 01:07:18.429688 32004 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:45149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.88.66
--webserver_port=0
--tserver_master_addrs=127.11.88.126:32947
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32004
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.66
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:18.429996 32004 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:18.430320 32004 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:18.435635 32009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:18.435649 32012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:18.435644 32010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:18.435681 32004 server_base.cc:1034] running on GCE node
I20260806 01:07:18.436033 32004 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:18.436345 32004 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:18.437526 32004 hybrid_clock.cc:648] HybridClock initialized: now 1785978438437511 us; error 31 us; skew 500 ppm
I20260806 01:07:18.439035 32004 webserver.cc:460] Webserver started at http://127.11.88.66:42945/ using document root <none> and password file <none>
I20260806 01:07:18.439318 32004 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:18.439363 32004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:18.439460 32004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:18.440536 32004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-1/data/instance:
uuid: "e4d3609176f94806aafeaab895bb3f47"
format_stamp: "Formatted at 2026-08-06 01:07:18 on dist-test-slave-69rg"
server_key: "5b0a6861b025ba06f9c7a410af96266f"
server_key_iv: "f0acfbadbecc5f21b27eae0446256b81"
server_key_version: "encryptionkey@0"
I20260806 01:07:18.440860 32004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance:
uuid: "e4d3609176f94806aafeaab895bb3f47"
format_stamp: "Formatted at 2026-08-06 01:07:18 on dist-test-slave-69rg"
server_key: "5b0a6861b025ba06f9c7a410af96266f"
server_key_iv: "f0acfbadbecc5f21b27eae0446256b81"
server_key_version: "encryptionkey@0"
I20260806 01:07:18.442539 32004 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 01:07:18.443485 32018 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:18.443725 32004 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:18.443849 32004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-1/wal
uuid: "e4d3609176f94806aafeaab895bb3f47"
format_stamp: "Formatted at 2026-08-06 01:07:18 on dist-test-slave-69rg"
server_key: "5b0a6861b025ba06f9c7a410af96266f"
server_key_iv: "f0acfbadbecc5f21b27eae0446256b81"
server_key_version: "encryptionkey@0"
I20260806 01:07:18.443935 32004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:18.468624 32004 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:18.469017 32004 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:18.469192 32004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:18.469465 32004 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:07:18.469885 32004 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:07:18.469944 32004 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:18.469987 32004 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:07:18.470029 32004 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:18.476372 32004 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.66:43179
I20260806 01:07:18.476433 32134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.66:43179 every 8 connection(s)
I20260806 01:07:18.476861 32004 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-1/data/info.pb
I20260806 01:07:18.482287 31870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:18.477869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:58415 (local address 127.11.88.126:32947)
0806 01:07:18.477931 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:18.477934 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:18.478182 (+ 248us) server_negotiation.cc:407] Connection header received
0806 01:07:18.478726 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:18.478727 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:18.478739 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:18.478789 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:18.479453 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.479946 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.480927 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.481123 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.481184 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:18.482025 (+ 841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:18.482026 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:18.482026 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:18.482031 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:18.482045 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:18.482049 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:18.482095 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:18.482188 (+ 93us) server_negotiation.cc:299] Negotiation successful
0806 01:07:18.482214 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 01:07:18.482494 32137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:18.477829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:32947 (local address 127.11.88.66:58415)
0806 01:07:18.478050 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:18.478086 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:18.478589 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:18.478854 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:18.478858 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:18.478866 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:18.479375 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:18.479379 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.480034 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.480035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:18.480834 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:18.480837 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.481205 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.481206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:18.481315 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:18.481873 (+ 558us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 01:07:18.481874 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:18.481904 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 01:07:18.481929 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:18.482109 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:18.482114 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:18.482116 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 01:07:18.482170 (+ 54us) client_negotiation.cc:240] Negotiation successful
0806 01:07:18.482254 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":92,"threads_started":1}
I20260806 01:07:18.483119 32135 heartbeater.cc:347] Connected to a master server at 127.11.88.126:32947
I20260806 01:07:18.483234 32135 heartbeater.cc:464] Registering TS with master...
I20260806 01:07:18.483459 32135 heartbeater.cc:511] Master 127.11.88.126:32947 requested a full tablet report, sending...
I20260806 01:07:18.483938 31807 ts_manager.cc:194] Registered new tserver with Master: e4d3609176f94806aafeaab895bb3f47 (127.11.88.66:43179)
I20260806 01:07:18.484344 31807 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.88.66:58415
I20260806 01:07:18.486095 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 32004
I20260806 01:07:18.486217 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-1/wal/instance
I20260806 01:07:18.486485 11617 external_mini_cluster.cc:1428] Setting key 7120424b9a0f902cd3ed8e3a85bc0c45
I20260806 01:07:18.487495 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.88.67:0
--local_ip_for_outbound_sockets=127.11.88.67
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:32947
--builtin_ntp_servers=127.11.88.84:45149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 01:07:18.573947 32139 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:18.574287 32139 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:18.574328 32139 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:18.575570 32139 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:18.575651 32139 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:18.575692 32139 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.88.67
I20260806 01:07:18.577167 32139 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:45149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.88.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.88.67
--webserver_port=0
--tserver_master_addrs=127.11.88.126:32947
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32139
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.88.67
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:18.577481 32139 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:18.577854 32139 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:18.583923 32147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:18.583969 32145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:18.583963 32144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:18.584172 32139 server_base.cc:1034] running on GCE node
I20260806 01:07:18.584479 32139 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:18.584894 32139 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:18.586117 32139 hybrid_clock.cc:648] HybridClock initialized: now 1785978438586101 us; error 29 us; skew 500 ppm
I20260806 01:07:18.588047 32139 webserver.cc:460] Webserver started at http://127.11.88.67:38531/ using document root <none> and password file <none>
I20260806 01:07:18.588292 32139 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:18.588341 32139 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:18.588445 32139 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:18.589740 32139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-2/data/instance:
uuid: "3688ead6cedd4d91b133491e3ca8302c"
format_stamp: "Formatted at 2026-08-06 01:07:18 on dist-test-slave-69rg"
server_key: "cc45e3d8d6a44ee92bba2a738afe57d6"
server_key_iv: "485b64b2117b8f0a3e9fa1f60c91c5ff"
server_key_version: "encryptionkey@0"
I20260806 01:07:18.590185 32139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance:
uuid: "3688ead6cedd4d91b133491e3ca8302c"
format_stamp: "Formatted at 2026-08-06 01:07:18 on dist-test-slave-69rg"
server_key: "cc45e3d8d6a44ee92bba2a738afe57d6"
server_key_iv: "485b64b2117b8f0a3e9fa1f60c91c5ff"
server_key_version: "encryptionkey@0"
I20260806 01:07:18.591765 32139 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 01:07:18.592887 32154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:18.593197 32139 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:18.593290 32139 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-2/wal
uuid: "3688ead6cedd4d91b133491e3ca8302c"
format_stamp: "Formatted at 2026-08-06 01:07:18 on dist-test-slave-69rg"
server_key: "cc45e3d8d6a44ee92bba2a738afe57d6"
server_key_iv: "485b64b2117b8f0a3e9fa1f60c91c5ff"
server_key_version: "encryptionkey@0"
I20260806 01:07:18.593371 32139 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:18.604524 32139 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:18.604841 32139 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:18.604955 32139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:18.605173 32139 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 01:07:18.605547 32139 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 01:07:18.605581 32139 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:18.605643 32139 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 01:07:18.605669 32139 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:18.611845 32139 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.67:42985
I20260806 01:07:18.611936 32273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.67:42985 every 8 connection(s)
I20260806 01:07:18.612288 32139 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-2/data/info.pb
I20260806 01:07:18.613407 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 32139
I20260806 01:07:18.613538 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-2/wal/instance
I20260806 01:07:18.613778 11617 external_mini_cluster.cc:1428] Setting key e66fc9f2fc8e64c301900059a0d47dfc
I20260806 01:07:18.618135 31870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:18.613110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.67:59873 (local address 127.11.88.126:32947)
0806 01:07:18.613185 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:18.613187 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:18.613432 (+ 245us) server_negotiation.cc:407] Connection header received
0806 01:07:18.614227 (+ 795us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:18.614229 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:18.614242 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:18.614307 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:18.615135 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.615651 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.616673 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.616881 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.616959 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:18.617809 (+ 850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:18.617811 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:18.617811 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:18.617836 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:18.617852 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:18.617856 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:18.617905 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:18.618011 (+ 106us) server_negotiation.cc:299] Negotiation successful
0806 01:07:18.618056 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 01:07:18.618364 32276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:18.613078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:32947 (local address 127.11.88.67:59873)
0806 01:07:18.613275 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:18.613320 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:18.614110 (+ 790us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:18.614385 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:18.614389 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:18.614400 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:18.615036 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:18.615043 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.615756 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.615758 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:18.616572 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:18.616574 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.616981 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.616982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:18.617123 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:18.617650 (+ 527us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 01:07:18.617650 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:18.617679 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 01:07:18.617702 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:18.617905 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:18.617913 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:18.617916 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:07:18.618000 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 01:07:18.618121 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":94,"threads_started":1}
I20260806 01:07:18.618813 32274 heartbeater.cc:347] Connected to a master server at 127.11.88.126:32947
I20260806 01:07:18.618907 32274 heartbeater.cc:464] Registering TS with master...
I20260806 01:07:18.619056 32274 heartbeater.cc:511] Master 127.11.88.126:32947 requested a full tablet report, sending...
I20260806 01:07:18.619390 31807 ts_manager.cc:194] Registered new tserver with Master: 3688ead6cedd4d91b133491e3ca8302c (127.11.88.67:42985)
I20260806 01:07:18.619871 31807 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.88.67:59873
I20260806 01:07:18.626236 11617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 01:07:18.631115 31870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:18.627830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33026 (local address 127.11.88.126:32947)
0806 01:07:18.627925 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:18.627927 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:18.628092 (+ 165us) server_negotiation.cc:407] Connection header received
0806 01:07:18.628119 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:18.628120 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:18.628134 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:18.628178 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:18.628388 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.628955 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.629743 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.630041 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.630153 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:18.630872 (+ 719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:18.630874 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:18.630874 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:18.630880 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:18.630897 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:18.630902 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:18.630962 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:18.631015 (+ 53us) server_negotiation.cc:299] Negotiation successful
0806 01:07:18.631045 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 01:07:18.633308 31807 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33026:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 01:07:18.635138 31807 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 01:07:18.642201 32287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:18.637943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55820 (local address 127.11.88.67:42985)
0806 01:07:18.638461 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:18.638468 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:18.638482 (+ 14us) server_negotiation.cc:407] Connection header received
0806 01:07:18.638527 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:18.638529 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:18.638548 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:18.638633 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:18.638759 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.640007 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.641203 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.641704 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.641797 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:18.641918 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:18.642055 (+ 137us) server_negotiation.cc:299] Negotiation successful
0806 01:07:18.642098 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":477,"thread_start_us":149,"threads_started":1}
I20260806 01:07:18.642189 32282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:18.637560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:42985 (local address 127.0.0.1:55820)
0806 01:07:18.638152 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:18.638163 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:18.638211 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:18.638638 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:18.638639 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:18.638642 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:18.638677 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:18.638678 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.640121 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.640122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:18.641110 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:18.641112 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.641798 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.641799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:18.641921 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:18.641935 (+ 14us) client_negotiation.cc:769] Sending connection context
0806 01:07:18.642036 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 01:07:18.642105 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":187,"threads_started":1}
I20260806 01:07:18.642871 32283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:18.637553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:43179 (local address 127.0.0.1:56422)
0806 01:07:18.637758 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:18.637800 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:18.637893 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:18.638940 (+ 1047us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:18.638941 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:18.638943 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:18.638979 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:18.638980 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.640313 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.640314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:18.641482 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:18.641486 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.642564 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.642566 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:18.642698 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:18.642702 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:07:18.642738 (+ 36us) client_negotiation.cc:240] Negotiation successful
0806 01:07:18.642781 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":131,"threads_started":1}
I20260806 01:07:18.643016 32286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:18.637908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52248 (local address 127.11.88.65:36691)
0806 01:07:18.638130 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:18.638135 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:18.638148 (+ 13us) server_negotiation.cc:407] Connection header received
0806 01:07:18.638195 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:18.638197 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:18.638214 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:18.638291 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:18.638538 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.639529 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.640902 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.641762 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.641860 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:18.641959 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:18.642238 (+ 279us) server_negotiation.cc:299] Negotiation successful
0806 01:07:18.642451 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":136,"threads_started":1}
I20260806 01:07:18.642925 32205 tablet_service.cc:1467] Processing CreateTablet for tablet ffadd69badd742e29a5d982e9a9a0d72 (DEFAULT_TABLE table=test-table [id=9f472596e1704282a30fbc6620c22aad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:07:18.643404 32205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffadd69badd742e29a5d982e9a9a0d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:18.643414 32288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:18.638221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56422 (local address 127.11.88.66:43179)
0806 01:07:18.638765 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:18.638770 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:18.638780 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:07:18.638822 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:18.638824 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:18.638839 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:18.638928 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:18.639038 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.640188 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.641601 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.642456 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.643007 (+ 551us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:18.643124 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:18.643214 (+ 90us) server_negotiation.cc:299] Negotiation successful
0806 01:07:18.643320 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":482,"thread_start_us":103,"threads_started":1}
I20260806 01:07:18.644048 32066 tablet_service.cc:1467] Processing CreateTablet for tablet ffadd69badd742e29a5d982e9a9a0d72 (DEFAULT_TABLE table=test-table [id=9f472596e1704282a30fbc6620c22aad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:07:18.644366 32066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffadd69badd742e29a5d982e9a9a0d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:18.645964 32284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:18.637553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:36691 (local address 127.0.0.1:52248)
0806 01:07:18.637942 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:18.637954 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:18.638013 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:18.638380 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:18.638383 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:18.638385 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:18.638456 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:18.638458 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.639629 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.639630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:18.640797 (+ 1167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:18.640800 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.641998 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.641999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:18.642071 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:18.642075 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 01:07:18.642141 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 01:07:18.642188 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"mutex_wait_us":3,"thread_start_us":126,"threads_started":1}
I20260806 01:07:18.646675 32289 tablet_bootstrap.cc:492] T ffadd69badd742e29a5d982e9a9a0d72 P 3688ead6cedd4d91b133491e3ca8302c: Bootstrap starting.
I20260806 01:07:18.646802 31934 tablet_service.cc:1467] Processing CreateTablet for tablet ffadd69badd742e29a5d982e9a9a0d72 (DEFAULT_TABLE table=test-table [id=9f472596e1704282a30fbc6620c22aad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 01:07:18.647141 31934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffadd69badd742e29a5d982e9a9a0d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:18.647411 32289 tablet_bootstrap.cc:654] T ffadd69badd742e29a5d982e9a9a0d72 P 3688ead6cedd4d91b133491e3ca8302c: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:18.647627 32290 tablet_bootstrap.cc:492] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47: Bootstrap starting.
I20260806 01:07:18.647759 32289 log.cc:824] T ffadd69badd742e29a5d982e9a9a0d72 P 3688ead6cedd4d91b133491e3ca8302c: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:18.648267 32290 tablet_bootstrap.cc:654] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:18.648613 32290 log.cc:824] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:18.648679 32289 tablet_bootstrap.cc:492] T ffadd69badd742e29a5d982e9a9a0d72 P 3688ead6cedd4d91b133491e3ca8302c: No bootstrap required, opened a new log
I20260806 01:07:18.648737 32289 ts_tablet_manager.cc:1397] T ffadd69badd742e29a5d982e9a9a0d72 P 3688ead6cedd4d91b133491e3ca8302c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 01:07:18.649453 32290 tablet_bootstrap.cc:492] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47: No bootstrap required, opened a new log
I20260806 01:07:18.649521 32290 ts_tablet_manager.cc:1397] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 01:07:18.650527 32293 tablet_bootstrap.cc:492] T ffadd69badd742e29a5d982e9a9a0d72 P 6e42c7d14ed9422b9d95140953105140: Bootstrap starting.
I20260806 01:07:18.651101 32293 tablet_bootstrap.cc:654] T ffadd69badd742e29a5d982e9a9a0d72 P 6e42c7d14ed9422b9d95140953105140: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:18.651405 32293 log.cc:824] T ffadd69badd742e29a5d982e9a9a0d72 P 6e42c7d14ed9422b9d95140953105140: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:18.651757 32289 raft_consensus.cc:348] T ffadd69badd742e29a5d982e9a9a0d72 P 3688ead6cedd4d91b133491e3ca8302c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3688ead6cedd4d91b133491e3ca8302c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42985 } } peers { permanent_uuid: "6e42c7d14ed9422b9d95140953105140" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 36691 } } peers { permanent_uuid: "e4d3609176f94806aafeaab895bb3f47" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 43179 } }
I20260806 01:07:18.651960 32289 raft_consensus.cc:374] T ffadd69badd742e29a5d982e9a9a0d72 P 3688ead6cedd4d91b133491e3ca8302c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:18.652009 32289 raft_consensus.cc:729] T ffadd69badd742e29a5d982e9a9a0d72 P 3688ead6cedd4d91b133491e3ca8302c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3688ead6cedd4d91b133491e3ca8302c, State: Initialized, Role: FOLLOWER
I20260806 01:07:18.652173 32293 tablet_bootstrap.cc:492] T ffadd69badd742e29a5d982e9a9a0d72 P 6e42c7d14ed9422b9d95140953105140: No bootstrap required, opened a new log
I20260806 01:07:18.652148 32289 consensus_queue.cc:260] T ffadd69badd742e29a5d982e9a9a0d72 P 3688ead6cedd4d91b133491e3ca8302c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3688ead6cedd4d91b133491e3ca8302c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42985 } } peers { permanent_uuid: "6e42c7d14ed9422b9d95140953105140" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 36691 } } peers { permanent_uuid: "e4d3609176f94806aafeaab895bb3f47" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 43179 } }
I20260806 01:07:18.652273 32293 ts_tablet_manager.cc:1397] T ffadd69badd742e29a5d982e9a9a0d72 P 6e42c7d14ed9422b9d95140953105140: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 01:07:18.652454 32289 ts_tablet_manager.cc:1428] T ffadd69badd742e29a5d982e9a9a0d72 P 3688ead6cedd4d91b133491e3ca8302c: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260806 01:07:18.652599 32274 heartbeater.cc:503] Master 127.11.88.126:32947 was elected leader, sending a full tablet report...
I20260806 01:07:18.653007 32290 raft_consensus.cc:348] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3688ead6cedd4d91b133491e3ca8302c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42985 } } peers { permanent_uuid: "6e42c7d14ed9422b9d95140953105140" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 36691 } } peers { permanent_uuid: "e4d3609176f94806aafeaab895bb3f47" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 43179 } }
I20260806 01:07:18.653188 32290 raft_consensus.cc:374] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:18.653237 32290 raft_consensus.cc:729] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4d3609176f94806aafeaab895bb3f47, State: Initialized, Role: FOLLOWER
I20260806 01:07:18.653362 32290 consensus_queue.cc:260] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3688ead6cedd4d91b133491e3ca8302c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42985 } } peers { permanent_uuid: "6e42c7d14ed9422b9d95140953105140" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 36691 } } peers { permanent_uuid: "e4d3609176f94806aafeaab895bb3f47" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 43179 } }
I20260806 01:07:18.653693 32290 ts_tablet_manager.cc:1428] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260806 01:07:18.653748 32135 heartbeater.cc:503] Master 127.11.88.126:32947 was elected leader, sending a full tablet report...
I20260806 01:07:18.655104 32293 raft_consensus.cc:348] T ffadd69badd742e29a5d982e9a9a0d72 P 6e42c7d14ed9422b9d95140953105140 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3688ead6cedd4d91b133491e3ca8302c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42985 } } peers { permanent_uuid: "6e42c7d14ed9422b9d95140953105140" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 36691 } } peers { permanent_uuid: "e4d3609176f94806aafeaab895bb3f47" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 43179 } }
I20260806 01:07:18.655226 32293 raft_consensus.cc:374] T ffadd69badd742e29a5d982e9a9a0d72 P 6e42c7d14ed9422b9d95140953105140 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:18.655246 32293 raft_consensus.cc:729] T ffadd69badd742e29a5d982e9a9a0d72 P 6e42c7d14ed9422b9d95140953105140 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e42c7d14ed9422b9d95140953105140, State: Initialized, Role: FOLLOWER
I20260806 01:07:18.655360 32293 consensus_queue.cc:260] T ffadd69badd742e29a5d982e9a9a0d72 P 6e42c7d14ed9422b9d95140953105140 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3688ead6cedd4d91b133491e3ca8302c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42985 } } peers { permanent_uuid: "6e42c7d14ed9422b9d95140953105140" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 36691 } } peers { permanent_uuid: "e4d3609176f94806aafeaab895bb3f47" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 43179 } }
I20260806 01:07:18.655628 32293 ts_tablet_manager.cc:1428] T ffadd69badd742e29a5d982e9a9a0d72 P 6e42c7d14ed9422b9d95140953105140: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260806 01:07:18.655712 32001 heartbeater.cc:503] Master 127.11.88.126:32947 was elected leader, sending a full tablet report...
I20260806 01:07:18.656602 32296 raft_consensus.cc:482] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 01:07:18.656710 32296 raft_consensus.cc:504] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3688ead6cedd4d91b133491e3ca8302c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42985 } } peers { permanent_uuid: "6e42c7d14ed9422b9d95140953105140" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 36691 } } peers { permanent_uuid: "e4d3609176f94806aafeaab895bb3f47" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 43179 } }
I20260806 01:07:18.657088 32296 leader_election.cc:288] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3688ead6cedd4d91b133491e3ca8302c (127.11.88.67:42985), 6e42c7d14ed9422b9d95140953105140 (127.11.88.65:36691)
I20260806 01:07:18.660023 32287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:18.657330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:43827 (local address 127.11.88.67:42985)
0806 01:07:18.657391 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:18.657394 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:18.657405 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:07:18.657432 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:18.657433 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:18.657443 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:18.657510 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:18.657712 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.658278 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.659228 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.659666 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.659758 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:18.659767 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:18.659913 (+ 146us) server_negotiation.cc:299] Negotiation successful
0806 01:07:18.659953 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260806 01:07:18.660024 32137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:18.657229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.67:42985 (local address 127.11.88.66:43827)
0806 01:07:18.657275 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:18.657288 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:18.657330 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:18.657527 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:18.657528 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:18.657530 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:18.657602 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:18.657604 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.658378 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.658379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:18.659133 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:18.659135 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.659761 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.659762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:18.659836 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:18.659839 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 01:07:18.659907 (+ 68us) client_negotiation.cc:240] Negotiation successful
0806 01:07:18.659952 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260806 01:07:18.660320 32286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:18.657334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.88.66:47627 (local address 127.11.88.65:36691)
0806 01:07:18.657561 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:18.657563 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:18.657569 (+ 6us) server_negotiation.cc:407] Connection header received
0806 01:07:18.657587 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:18.657589 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:18.657597 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:18.657647 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 01:07:18.657806 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.658365 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.659413 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.659903 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.659992 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:18.660000 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:18.660205 (+ 205us) server_negotiation.cc:299] Negotiation successful
0806 01:07:18.660252 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206}
I20260806 01:07:18.660467 32227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffadd69badd742e29a5d982e9a9a0d72" candidate_uuid: "e4d3609176f94806aafeaab895bb3f47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3688ead6cedd4d91b133491e3ca8302c" is_pre_election: true
I20260806 01:07:18.660550 32298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:18.657283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:36691 (local address 127.11.88.66:47627)
0806 01:07:18.657430 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:18.657440 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:18.657508 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:18.657667 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:18.657668 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:18.657670 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 01:07:18.657729 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:18.657731 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.658464 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.658465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:18.659304 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:18.659306 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.659990 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.659992 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:18.660084 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:18.660089 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 01:07:18.660412 (+ 323us) client_negotiation.cc:240] Negotiation successful
0806 01:07:18.660459 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":105,"threads_started":1}
I20260806 01:07:18.660621 32227 raft_consensus.cc:2454] T ffadd69badd742e29a5d982e9a9a0d72 P 3688ead6cedd4d91b133491e3ca8302c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4d3609176f94806aafeaab895bb3f47 in term 0.
I20260806 01:07:18.660856 32020 leader_election.cc:302] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3688ead6cedd4d91b133491e3ca8302c, e4d3609176f94806aafeaab895bb3f47; no voters:
I20260806 01:07:18.660907 31955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffadd69badd742e29a5d982e9a9a0d72" candidate_uuid: "e4d3609176f94806aafeaab895bb3f47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e42c7d14ed9422b9d95140953105140" is_pre_election: true
I20260806 01:07:18.661041 32296 raft_consensus.cc:2781] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 01:07:18.661069 31955 raft_consensus.cc:2454] T ffadd69badd742e29a5d982e9a9a0d72 P 6e42c7d14ed9422b9d95140953105140 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4d3609176f94806aafeaab895bb3f47 in term 0.
I20260806 01:07:18.661116 32296 raft_consensus.cc:482] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 01:07:18.661152 32296 raft_consensus.cc:3037] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:18.662148 32296 raft_consensus.cc:504] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3688ead6cedd4d91b133491e3ca8302c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42985 } } peers { permanent_uuid: "6e42c7d14ed9422b9d95140953105140" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 36691 } } peers { permanent_uuid: "e4d3609176f94806aafeaab895bb3f47" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 43179 } }
I20260806 01:07:18.662307 32296 leader_election.cc:288] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47 [CANDIDATE]: Term 1 election: Requested vote from peers 3688ead6cedd4d91b133491e3ca8302c (127.11.88.67:42985), 6e42c7d14ed9422b9d95140953105140 (127.11.88.65:36691)
I20260806 01:07:18.662479 32227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffadd69badd742e29a5d982e9a9a0d72" candidate_uuid: "e4d3609176f94806aafeaab895bb3f47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3688ead6cedd4d91b133491e3ca8302c"
I20260806 01:07:18.662564 32227 raft_consensus.cc:3037] T ffadd69badd742e29a5d982e9a9a0d72 P 3688ead6cedd4d91b133491e3ca8302c [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:18.663347 32227 raft_consensus.cc:2454] T ffadd69badd742e29a5d982e9a9a0d72 P 3688ead6cedd4d91b133491e3ca8302c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4d3609176f94806aafeaab895bb3f47 in term 1.
I20260806 01:07:18.663481 31955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffadd69badd742e29a5d982e9a9a0d72" candidate_uuid: "e4d3609176f94806aafeaab895bb3f47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e42c7d14ed9422b9d95140953105140"
I20260806 01:07:18.663537 32020 leader_election.cc:302] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3688ead6cedd4d91b133491e3ca8302c, e4d3609176f94806aafeaab895bb3f47; no voters:
I20260806 01:07:18.663573 31955 raft_consensus.cc:3037] T ffadd69badd742e29a5d982e9a9a0d72 P 6e42c7d14ed9422b9d95140953105140 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:18.663648 32296 raft_consensus.cc:2781] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:18.663836 32296 raft_consensus.cc:686] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47 [term 1 LEADER]: Becoming Leader. State: Replica: e4d3609176f94806aafeaab895bb3f47, State: Running, Role: LEADER
I20260806 01:07:18.663941 32296 consensus_queue.cc:237] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3688ead6cedd4d91b133491e3ca8302c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42985 } } peers { permanent_uuid: "6e42c7d14ed9422b9d95140953105140" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 36691 } } peers { permanent_uuid: "e4d3609176f94806aafeaab895bb3f47" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 43179 } }
I20260806 01:07:18.664515 31955 raft_consensus.cc:2454] T ffadd69badd742e29a5d982e9a9a0d72 P 6e42c7d14ed9422b9d95140953105140 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4d3609176f94806aafeaab895bb3f47 in term 1.
I20260806 01:07:18.664915 31806 catalog_manager.cc:5495] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4d3609176f94806aafeaab895bb3f47 (127.11.88.66). New cstate: current_term: 1 leader_uuid: "e4d3609176f94806aafeaab895bb3f47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3688ead6cedd4d91b133491e3ca8302c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e42c7d14ed9422b9d95140953105140" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4d3609176f94806aafeaab895bb3f47" member_type: VOTER last_known_addr { host: "127.11.88.66" port: 43179 } health_report { overall_health: HEALTHY } } }
I20260806 01:07:18.671227 32288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:18.668610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56434 (local address 127.11.88.66:43179)
0806 01:07:18.668667 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:18.668669 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:18.668679 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:07:18.668750 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:18.668751 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:18.668771 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:18.668873 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:07:18.669018 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.669503 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.670353 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:18.670574 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:18.670654 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:18.670842 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:07:18.670958 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:07:18.671071 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:18.671091 (+ 20us) server_negotiation.cc:299] Negotiation successful
0806 01:07:18.671114 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260806 01:07:18.673143 32227 raft_consensus.cc:1261] T ffadd69badd742e29a5d982e9a9a0d72 P 3688ead6cedd4d91b133491e3ca8302c [term 1 FOLLOWER]: Refusing update from remote peer e4d3609176f94806aafeaab895bb3f47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:07:18.673143 31955 raft_consensus.cc:1261] T ffadd69badd742e29a5d982e9a9a0d72 P 6e42c7d14ed9422b9d95140953105140 [term 1 FOLLOWER]: Refusing update from remote peer e4d3609176f94806aafeaab895bb3f47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:07:18.673542 32299 consensus_queue.cc:1035] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3688ead6cedd4d91b133491e3ca8302c" member_type: VOTER last_known_addr { host: "127.11.88.67" port: 42985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:07:18.673718 32296 consensus_queue.cc:1035] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e42c7d14ed9422b9d95140953105140" member_type: VOTER last_known_addr { host: "127.11.88.65" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:07:18.676221 32302 mvcc.cc:205] Tried to move back new op lower bound from 7315367684802453504 to 7315367684768509952. Current Snapshot: MvccSnapshot[applied={T|T < 7315367684802453504}]
I20260806 01:07:18.677448 32303 mvcc.cc:205] Tried to move back new op lower bound from 7315367684802453504 to 7315367684768509952. Current Snapshot: MvccSnapshot[applied={T|T < 7315367684802453504}]
I20260806 01:07:18.677577 32304 mvcc.cc:205] Tried to move back new op lower bound from 7315367684802453504 to 7315367684768509952. Current Snapshot: MvccSnapshot[applied={T|T < 7315367684802453504}]
I20260806 01:07:18.679025 31807 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33026:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:07:18.679124 31807 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33026:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 01:07:18.679979 31807 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1d7486bdfe9a4ec8af09d6402403f705: Sending DeleteTablet for 3 replicas of tablet ffadd69badd742e29a5d982e9a9a0d72
I20260806 01:07:18.680333 32205 tablet_service.cc:1514] Processing DeleteTablet for tablet ffadd69badd742e29a5d982e9a9a0d72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:07:18 UTC) from {username='slave'} at 127.0.0.1:55820
I20260806 01:07:18.680579 32311 tablet_replica.cc:330] T ffadd69badd742e29a5d982e9a9a0d72 P 3688ead6cedd4d91b133491e3ca8302c: stopping tablet replica
I20260806 01:07:18.680647 32066 tablet_service.cc:1514] Processing DeleteTablet for tablet ffadd69badd742e29a5d982e9a9a0d72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:07:18 UTC) from {username='slave'} at 127.0.0.1:56422
I20260806 01:07:18.680816 32311 raft_consensus.cc:2229] T ffadd69badd742e29a5d982e9a9a0d72 P 3688ead6cedd4d91b133491e3ca8302c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 01:07:18.680814 31934 tablet_service.cc:1514] Processing DeleteTablet for tablet ffadd69badd742e29a5d982e9a9a0d72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 01:07:18 UTC) from {username='slave'} at 127.0.0.1:52248
I20260806 01:07:18.681001 32311 raft_consensus.cc:2258] T ffadd69badd742e29a5d982e9a9a0d72 P 3688ead6cedd4d91b133491e3ca8302c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 01:07:18.681061 32313 tablet_replica.cc:330] T ffadd69badd742e29a5d982e9a9a0d72 P 6e42c7d14ed9422b9d95140953105140: stopping tablet replica
I20260806 01:07:18.681213 32312 tablet_replica.cc:330] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47: stopping tablet replica
I20260806 01:07:18.681324 32312 raft_consensus.cc:2229] T ffadd69badd742e29a5d982e9a9a0d72 P e4d3609176f94806aafeaab895bb3f47 [term 1 LEADER]: Raft consensus shutting down.
I20260806 01:07:18.681409 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 31872
I20260806 01:07:18.682579 32311 ts_tablet_manager.cc:1905] T ffadd69badd742e29a5d982e9a9a0d72 P 3688ead6cedd4d91b133491e3ca8302c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 01:07:18.684756 32311 ts_tablet_manager.cc:1918] T ffadd69badd742e29a5d982e9a9a0d72 P 3688ead6cedd4d91b133491e3ca8302c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 01:07:18.684844 32311 log.cc:1196] T ffadd69badd742e29a5d982e9a9a0d72 P 3688ead6cedd4d91b133491e3ca8302c: Deleting WAL directory at /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785978186227899-11617-0/minicluster-data/ts-2/wal/wals/ffadd69badd742e29a5d982e9a9a0d72
I20260806 01:07:18.685108 32311 ts_tablet_manager.cc:1939] T ffadd69badd742e29a5d982e9a9a0d72 P 3688ead6cedd4d91b133491e3ca8302c: Deleting consensus metadata
I20260806 01:07:18.685590 31791 catalog_manager.cc:4841] TS 3688ead6cedd4d91b133491e3ca8302c (127.11.88.67:42985): tablet ffadd69badd742e29a5d982e9a9a0d72 (table test-table [id=9f472596e1704282a30fbc6620c22aad]) successfully deleted
I20260806 01:07:18.690533 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 32004
W20260806 01:07:18.690557 31793 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.88.65:36691 (error 108)
I20260806 01:07:18.693092 32284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:18.691619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.65:36691 (local address 127.0.0.1:52252)
0806 01:07:18.693003 (+ 1384us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:18.693056 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.65:36691: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1361}
W20260806 01:07:18.693241 31793 catalog_manager.cc:4584] TS 6e42c7d14ed9422b9d95140953105140 (127.11.88.65:36691): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ffadd69badd742e29a5d982e9a9a0d72: Network error: Client connection negotiation failed: client connection to 127.11.88.65:36691: connect: Connection refused (error 111)
I20260806 01:07:18.697285 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 32139
I20260806 01:07:18.697423 32284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:18.697255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.66:43179 (local address 127.0.0.1:56446)
0806 01:07:18.697325 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:18.697355 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.66:43179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260806 01:07:18.703502 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 31774
2026-08-06T01:07:18Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (691 ms)
[----------] 6 tests from EncryptionPolicyTest (8957 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:07:18 dist-test-slave-69rg krb5kdc[32317](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:07:18 dist-test-slave-69rg krb5kdc[32317](info): set up 2 sockets
Aug 06 01:07:18 dist-test-slave-69rg krb5kdc[32317](info): commencing operation
krb5kdc: starting...
W20260806 01:07:19.846910 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.122s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:07:19 dist-test-slave-69rg krb5kdc[32317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:07:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:07:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 01:07:19.982245 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43737
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43737
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:20.076228 32330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:20.076519 32330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:20.076562 32330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:20.077895 32330 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:20.077963 32330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:20.077988 32330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:20.078022 32330 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:20.078145 32330 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:20.079857 32330 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43737
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:20.080171 32330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:20.080438 32330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:20.085796 32335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:20.085796 32336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:20.085796 32339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:20.086203 32330 server_base.cc:1034] running on GCE node
I20260806 01:07:20.086457 32330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:20.086789 32330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:20.087984 32330 hybrid_clock.cc:648] HybridClock initialized: now 1785978440087969 us; error 32 us; skew 500 ppm
Aug 06 01:07:20 dist-test-slave-69rg krb5kdc[32317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978440, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:20.096612 32330 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 01:07:20.097227 32330 webserver.cc:460] Webserver started at http://127.0.0.1:32937/ using document root <none> and password file <none>
I20260806 01:07:20.097479 32330 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:20.097525 32330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:20.097627 32330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:20.099082 32330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "47dec4f93e7f42a7943fb3139be0705d"
format_stamp: "Formatted at 2026-08-06 01:07:20 on dist-test-slave-69rg"
server_key: "639a23c1e13c85f6999245be419df775"
server_key_iv: "21e41dd976e7cf545288840e0069238b"
server_key_version: "encryptionkey@0"
I20260806 01:07:20.099560 32330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "47dec4f93e7f42a7943fb3139be0705d"
format_stamp: "Formatted at 2026-08-06 01:07:20 on dist-test-slave-69rg"
server_key: "639a23c1e13c85f6999245be419df775"
server_key_iv: "21e41dd976e7cf545288840e0069238b"
server_key_version: "encryptionkey@0"
I20260806 01:07:20.101141 32330 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 01:07:20.102159 32347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:20.102415 32330 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:07:20.102528 32330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "47dec4f93e7f42a7943fb3139be0705d"
format_stamp: "Formatted at 2026-08-06 01:07:20 on dist-test-slave-69rg"
server_key: "639a23c1e13c85f6999245be419df775"
server_key_iv: "21e41dd976e7cf545288840e0069238b"
server_key_version: "encryptionkey@0"
I20260806 01:07:20.102622 32330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:20.114517 32330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:20.116806 32330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:20.116926 32330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:20.121313 32330 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43737
I20260806 01:07:20.121378 32399 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43737 every 8 connection(s)
I20260806 01:07:20.121726 32330 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:07:20.122735 32400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:20.125005 32400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47dec4f93e7f42a7943fb3139be0705d: Bootstrap starting.
I20260806 01:07:20.125558 32400 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 47dec4f93e7f42a7943fb3139be0705d: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:20.125835 32400 log.cc:824] T 00000000000000000000000000000000 P 47dec4f93e7f42a7943fb3139be0705d: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:20.126562 32400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47dec4f93e7f42a7943fb3139be0705d: No bootstrap required, opened a new log
I20260806 01:07:20.128104 32400 raft_consensus.cc:348] T 00000000000000000000000000000000 P 47dec4f93e7f42a7943fb3139be0705d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47dec4f93e7f42a7943fb3139be0705d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43737 } }
I20260806 01:07:20.128278 32400 raft_consensus.cc:374] T 00000000000000000000000000000000 P 47dec4f93e7f42a7943fb3139be0705d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:20.128353 32400 raft_consensus.cc:729] T 00000000000000000000000000000000 P 47dec4f93e7f42a7943fb3139be0705d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47dec4f93e7f42a7943fb3139be0705d, State: Initialized, Role: FOLLOWER
I20260806 01:07:20.128522 32400 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47dec4f93e7f42a7943fb3139be0705d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47dec4f93e7f42a7943fb3139be0705d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43737 } }
I20260806 01:07:20.128556 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 32330
I20260806 01:07:20.128615 32400 raft_consensus.cc:388] T 00000000000000000000000000000000 P 47dec4f93e7f42a7943fb3139be0705d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:07:20.128655 32400 raft_consensus.cc:482] T 00000000000000000000000000000000 P 47dec4f93e7f42a7943fb3139be0705d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:07:20.128679 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:07:20.128700 32400 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 47dec4f93e7f42a7943fb3139be0705d [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:20.128909 11617 external_mini_cluster.cc:1428] Setting key 49b009ebcb16afdcb3b86f946bb7dd5f
I20260806 01:07:20.129432 32400 raft_consensus.cc:504] T 00000000000000000000000000000000 P 47dec4f93e7f42a7943fb3139be0705d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47dec4f93e7f42a7943fb3139be0705d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43737 } }
I20260806 01:07:20.129573 32400 leader_election.cc:302] T 00000000000000000000000000000000 P 47dec4f93e7f42a7943fb3139be0705d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47dec4f93e7f42a7943fb3139be0705d; no voters:
I20260806 01:07:20.129765 32400 leader_election.cc:288] T 00000000000000000000000000000000 P 47dec4f93e7f42a7943fb3139be0705d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:07:20.129873 32405 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 47dec4f93e7f42a7943fb3139be0705d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:20.130055 32400 sys_catalog.cc:564] T 00000000000000000000000000000000 P 47dec4f93e7f42a7943fb3139be0705d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:20.130064 32405 raft_consensus.cc:686] T 00000000000000000000000000000000 P 47dec4f93e7f42a7943fb3139be0705d [term 1 LEADER]: Becoming Leader. State: Replica: 47dec4f93e7f42a7943fb3139be0705d, State: Running, Role: LEADER
I20260806 01:07:20.130182 32405 consensus_queue.cc:237] T 00000000000000000000000000000000 P 47dec4f93e7f42a7943fb3139be0705d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47dec4f93e7f42a7943fb3139be0705d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43737 } }
I20260806 01:07:20.130713 32406 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47dec4f93e7f42a7943fb3139be0705d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "47dec4f93e7f42a7943fb3139be0705d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47dec4f93e7f42a7943fb3139be0705d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43737 } } }
I20260806 01:07:20.130831 32406 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47dec4f93e7f42a7943fb3139be0705d [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:20.131529 32407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47dec4f93e7f42a7943fb3139be0705d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47dec4f93e7f42a7943fb3139be0705d. Latest consensus state: current_term: 1 leader_uuid: "47dec4f93e7f42a7943fb3139be0705d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47dec4f93e7f42a7943fb3139be0705d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43737 } } }
I20260806 01:07:20.131659 32414 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:07:20.131683 32407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47dec4f93e7f42a7943fb3139be0705d [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:20.132205 32414 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:07:20.134552 32414 catalog_manager.cc:1347] Generated new cluster ID: f1f91d20aaa04e278a16c284c2f1d6e8
I20260806 01:07:20.134621 32414 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 01:07:20 dist-test-slave-69rg krb5kdc[32317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 01:07:20.142099 32404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:20.129485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49141 (local address 127.0.0.1:43737)
0806 01:07:20.129785 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:20.129795 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:20.129864 (+ 69us) server_negotiation.cc:407] Connection header received
0806 01:07:20.129989 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:20.129996 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:20.130051 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:20.131108 (+ 1057us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:20.131245 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:20.132840 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:20.134068 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:20.134716 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:20.134858 (+ 142us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:20.138176 (+ 3318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:20.138181 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:20.138181 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:20.138197 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:20.140240 (+ 2043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:20.140723 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:20.140726 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:20.140727 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:20.140846 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:20.141127 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:20.141128 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:20.141128 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:20.141423 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:20.141634 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:20.141735 (+ 101us) server_negotiation.cc:299] Negotiation successful
0806 01:07:20.141904 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246,"thread_start_us":104,"threads_started":1}
I20260806 01:07:20.143185 11617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 01:07:20.148440 32414 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:07:20.149063 32414 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:07:20.152468 32404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:20.144805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60437 (local address 127.0.0.1:43737)
0806 01:07:20.144853 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:20.144855 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:20.144997 (+ 142us) server_negotiation.cc:407] Connection header received
0806 01:07:20.145080 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:20.145081 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:20.145092 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:20.145142 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:20.145767 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:20.146388 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:20.147200 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:20.147473 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:20.147564 (+ 91us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:20.149243 (+ 1679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:20.149244 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:20.149245 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:20.149253 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:20.151154 (+ 1901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:20.151617 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:20.151618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:20.151619 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:20.151684 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:20.151936 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:20.151937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:20.151937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:20.152074 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:20.152185 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:20.152300 (+ 115us) server_negotiation.cc:299] Negotiation successful
0806 01:07:20.152369 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 01:07:20.156018 32414 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 47dec4f93e7f42a7943fb3139be0705d: Generated new TSK 0
I20260806 01:07:20.156234 32414 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:07:20.159273 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 32330
W20260806 01:07:20.164875 32315 connection.cc:535] client connection to 127.0.0.1:43737 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43737): Connection reset by peer (error 104)
2026-08-06T01:07:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1454 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:07:20 dist-test-slave-69rg krb5kdc[32431](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:07:20 dist-test-slave-69rg krb5kdc[32431](info): set up 2 sockets
Aug 06 01:07:20 dist-test-slave-69rg krb5kdc[32431](info): commencing operation
krb5kdc: starting...
W20260806 01:07:21.243314 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:07:21 dist-test-slave-69rg krb5kdc[32431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:07:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:07:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 01:07:21.402719 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43349
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43349
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:21.490731 32444 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:21.490970 32444 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:21.490998 32444 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:21.492340 32444 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:21.492394 32444 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:21.492408 32444 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:21.492421 32444 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:21.492434 32444 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:21.494139 32444 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43349
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43349
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32444
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:21.494436 32444 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:21.494707 32444 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:21.500116 32449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:21.500116 32450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:21.500159 32452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:21.500393 32444 server_base.cc:1034] running on GCE node
I20260806 01:07:21.500746 32444 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:21.501089 32444 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:21.502291 32444 hybrid_clock.cc:648] HybridClock initialized: now 1785978441502277 us; error 50 us; skew 500 ppm
Aug 06 01:07:21 dist-test-slave-69rg krb5kdc[32431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978441, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:21.505151 32444 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 01:07:21.505646 32444 webserver.cc:460] Webserver started at http://127.0.0.1:41937/ using document root <none> and password file <none>
I20260806 01:07:21.505995 32444 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:21.506071 32444 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:21.506240 32444 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:21.507392 32444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "66afb606588e4bc191ee8d4982a217de"
format_stamp: "Formatted at 2026-08-06 01:07:21 on dist-test-slave-69rg"
server_key: "7007de476d8d71884657a85e394d18a9"
server_key_iv: "a3c540fc4ff889f2689164b06be2de7d"
server_key_version: "encryptionkey@0"
I20260806 01:07:21.507894 32444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "66afb606588e4bc191ee8d4982a217de"
format_stamp: "Formatted at 2026-08-06 01:07:21 on dist-test-slave-69rg"
server_key: "7007de476d8d71884657a85e394d18a9"
server_key_iv: "a3c540fc4ff889f2689164b06be2de7d"
server_key_version: "encryptionkey@0"
I20260806 01:07:21.509466 32444 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:07:21.510401 32459 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:21.510664 32444 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 01:07:21.510836 32444 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "66afb606588e4bc191ee8d4982a217de"
format_stamp: "Formatted at 2026-08-06 01:07:21 on dist-test-slave-69rg"
server_key: "7007de476d8d71884657a85e394d18a9"
server_key_iv: "a3c540fc4ff889f2689164b06be2de7d"
server_key_version: "encryptionkey@0"
I20260806 01:07:21.510936 32444 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:21.542330 32444 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:21.545233 32444 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:21.545441 32444 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:21.550112 32444 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43349
I20260806 01:07:21.550180 32513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43349 every 8 connection(s)
I20260806 01:07:21.550576 32444 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:07:21.551602 32514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:21.554059 32514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66afb606588e4bc191ee8d4982a217de: Bootstrap starting.
I20260806 01:07:21.554659 32514 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66afb606588e4bc191ee8d4982a217de: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:21.554913 32514 log.cc:824] T 00000000000000000000000000000000 P 66afb606588e4bc191ee8d4982a217de: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:21.555841 32514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66afb606588e4bc191ee8d4982a217de: No bootstrap required, opened a new log
I20260806 01:07:21.557520 32514 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66afb606588e4bc191ee8d4982a217de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66afb606588e4bc191ee8d4982a217de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43349 } }
I20260806 01:07:21.557673 32514 raft_consensus.cc:374] T 00000000000000000000000000000000 P 66afb606588e4bc191ee8d4982a217de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:21.557696 32514 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66afb606588e4bc191ee8d4982a217de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66afb606588e4bc191ee8d4982a217de, State: Initialized, Role: FOLLOWER
I20260806 01:07:21.557889 32514 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66afb606588e4bc191ee8d4982a217de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66afb606588e4bc191ee8d4982a217de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43349 } }
I20260806 01:07:21.557986 32514 raft_consensus.cc:388] T 00000000000000000000000000000000 P 66afb606588e4bc191ee8d4982a217de [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:07:21.558017 32514 raft_consensus.cc:482] T 00000000000000000000000000000000 P 66afb606588e4bc191ee8d4982a217de [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:07:21.558066 32514 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66afb606588e4bc191ee8d4982a217de [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:21.558614 32514 raft_consensus.cc:504] T 00000000000000000000000000000000 P 66afb606588e4bc191ee8d4982a217de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66afb606588e4bc191ee8d4982a217de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43349 } }
I20260806 01:07:21.558705 32514 leader_election.cc:302] T 00000000000000000000000000000000 P 66afb606588e4bc191ee8d4982a217de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66afb606588e4bc191ee8d4982a217de; no voters:
I20260806 01:07:21.558876 32514 leader_election.cc:288] T 00000000000000000000000000000000 P 66afb606588e4bc191ee8d4982a217de [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:07:21.558995 32518 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 66afb606588e4bc191ee8d4982a217de [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:21.559206 32514 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66afb606588e4bc191ee8d4982a217de [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:21.559239 32518 raft_consensus.cc:686] T 00000000000000000000000000000000 P 66afb606588e4bc191ee8d4982a217de [term 1 LEADER]: Becoming Leader. State: Replica: 66afb606588e4bc191ee8d4982a217de, State: Running, Role: LEADER
I20260806 01:07:21.559619 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 32444
I20260806 01:07:21.559772 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:07:21.560006 11617 external_mini_cluster.cc:1428] Setting key 5a2df46d47a75ba26c7d827413673283
I20260806 01:07:21.559363 32518 consensus_queue.cc:237] T 00000000000000000000000000000000 P 66afb606588e4bc191ee8d4982a217de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66afb606588e4bc191ee8d4982a217de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43349 } }
W20260806 01:07:21.561600 32535 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 66afb606588e4bc191ee8d4982a217de: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 01:07:21.561661 32535 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 01:07:21.561084 32519 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66afb606588e4bc191ee8d4982a217de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "66afb606588e4bc191ee8d4982a217de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66afb606588e4bc191ee8d4982a217de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43349 } } }
I20260806 01:07:21.561774 32519 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66afb606588e4bc191ee8d4982a217de [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:21.561290 32520 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66afb606588e4bc191ee8d4982a217de [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66afb606588e4bc191ee8d4982a217de. Latest consensus state: current_term: 1 leader_uuid: "66afb606588e4bc191ee8d4982a217de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66afb606588e4bc191ee8d4982a217de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43349 } } }
I20260806 01:07:21.561991 32520 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66afb606588e4bc191ee8d4982a217de [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:21.562126 32539 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:07:21.562328 32539 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:07:21.564311 32539 catalog_manager.cc:1347] Generated new cluster ID: 97fd84132c9e4a70b1ce344595ab6d9d
I20260806 01:07:21.564379 32539 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:07:21.566955 32531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:21.560568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54649 (local address 127.0.0.1:43349)
0806 01:07:21.560780 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:21.560793 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:21.560834 (+ 41us) server_negotiation.cc:407] Connection header received
0806 01:07:21.560982 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:21.560994 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:21.561090 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:21.561782 (+ 692us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:21.561939 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:21.563342 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:21.564684 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:21.565152 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:21.565321 (+ 169us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:21.566237 (+ 916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:21.566242 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:21.566242 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:21.566450 (+ 208us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:21.566488 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:21.566502 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:21.566610 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:21.566705 (+ 95us) server_negotiation.cc:299] Negotiation successful
0806 01:07:21.566738 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":113,"threads_started":1}
I20260806 01:07:21.568032 11617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 01:07:21.573048 32539 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:07:21.573202 32531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:21.569665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48545 (local address 127.0.0.1:43349)
0806 01:07:21.569711 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:21.569713 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:21.569889 (+ 176us) server_negotiation.cc:407] Connection header received
0806 01:07:21.570001 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:21.570002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:21.570013 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:21.570076 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:21.570255 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:21.570806 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:21.571645 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:21.571901 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:21.571988 (+ 87us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:21.572857 (+ 869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:21.572859 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:21.572859 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:21.572865 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:21.572882 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:21.572888 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:21.572952 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:21.573026 (+ 74us) server_negotiation.cc:299] Negotiation successful
0806 01:07:21.573040 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 01:07:21.573788 32539 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:07:21.578811 32539 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 66afb606588e4bc191ee8d4982a217de: Generated new TSK 0
I20260806 01:07:21.579073 32539 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:07:21.582052 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 32444
W20260806 01:07:21.588140 32429 connection.cc:535] client connection to 127.0.0.1:43349 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43349): Connection reset by peer (error 104)
2026-08-06T01:07:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1423 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:07:21 dist-test-slave-69rg krb5kdc[32549](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:07:21 dist-test-slave-69rg krb5kdc[32549](info): set up 2 sockets
Aug 06 01:07:21 dist-test-slave-69rg krb5kdc[32549](info): commencing operation
krb5kdc: starting...
W20260806 01:07:22.654924 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.052s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:07:22 dist-test-slave-69rg krb5kdc[32549](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:07:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:07:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 01:07:22.801605 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42857
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42857
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:22.886646 32563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:22.886905 32563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:22.886951 32563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:22.888121 32563 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:22.888161 32563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:22.888175 32563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:22.888188 32563 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:22.888201 32563 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:22.889659 32563 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42857
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42857
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32563
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:22.889932 32563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:22.890172 32563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:22.895193 32569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:22.895201 32571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:22.895201 32568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:22.895542 32563 server_base.cc:1034] running on GCE node
I20260806 01:07:22.896001 32563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:22.896359 32563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:22.897539 32563 hybrid_clock.cc:648] HybridClock initialized: now 1785978442897518 us; error 50 us; skew 500 ppm
Aug 06 01:07:22 dist-test-slave-69rg krb5kdc[32549](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978442, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:22.900274 32563 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 01:07:22.900893 32563 webserver.cc:460] Webserver started at http://127.0.0.1:41003/ using document root <none> and password file <none>
I20260806 01:07:22.901173 32563 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:22.901252 32563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:22.901429 32563 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:22.902645 32563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "1c1052e5075548ef9ef675929d65c495"
format_stamp: "Formatted at 2026-08-06 01:07:22 on dist-test-slave-69rg"
server_key: "2e77e49316efd5735e2b107f64dd8472"
server_key_iv: "fa4857878b6f6feff384c9c20e06e6b9"
server_key_version: "encryptionkey@0"
I20260806 01:07:22.903026 32563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "1c1052e5075548ef9ef675929d65c495"
format_stamp: "Formatted at 2026-08-06 01:07:22 on dist-test-slave-69rg"
server_key: "2e77e49316efd5735e2b107f64dd8472"
server_key_iv: "fa4857878b6f6feff384c9c20e06e6b9"
server_key_version: "encryptionkey@0"
I20260806 01:07:22.904428 32563 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 01:07:22.905256 32579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:22.905447 32563 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:22.905541 32563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "1c1052e5075548ef9ef675929d65c495"
format_stamp: "Formatted at 2026-08-06 01:07:22 on dist-test-slave-69rg"
server_key: "2e77e49316efd5735e2b107f64dd8472"
server_key_iv: "fa4857878b6f6feff384c9c20e06e6b9"
server_key_version: "encryptionkey@0"
I20260806 01:07:22.905654 32563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:22.909206 32563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:22.911612 32563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:22.911775 32563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:22.916085 32563 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42857
I20260806 01:07:22.916146 32632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42857 every 8 connection(s)
I20260806 01:07:22.916486 32563 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:07:22.917471 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 32563
I20260806 01:07:22.917529 32633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:22.917610 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:07:22.917851 11617 external_mini_cluster.cc:1428] Setting key 045dceb93cc5ff5974013a554ef7ae58
I20260806 01:07:22.920518 32636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:22.918457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53411 (local address 127.0.0.1:42857)
0806 01:07:22.918640 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:22.918651 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:22.918736 (+ 85us) server_negotiation.cc:407] Connection header received
0806 01:07:22.919243 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:22.919249 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:22.919275 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:22.919425 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:22.920099 (+ 674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:22.920102 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:22.920103 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:22.920107 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:22.920155 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:22.920165 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:22.920244 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:22.920313 (+ 69us) server_negotiation.cc:299] Negotiation successful
0806 01:07:22.920352 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":86,"threads_started":1}
I20260806 01:07:22.921027 32633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c1052e5075548ef9ef675929d65c495: Bootstrap starting.
I20260806 01:07:22.921526 11617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 01:07:22.921798 32633 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c1052e5075548ef9ef675929d65c495: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:22.922142 32633 log.cc:824] T 00000000000000000000000000000000 P 1c1052e5075548ef9ef675929d65c495: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:22.922820 32633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c1052e5075548ef9ef675929d65c495: No bootstrap required, opened a new log
I20260806 01:07:22.924109 32636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:22.923136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50557 (local address 127.0.0.1:42857)
0806 01:07:22.923180 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:22.923181 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:22.923278 (+ 97us) server_negotiation.cc:407] Connection header received
0806 01:07:22.923352 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:22.923353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:22.923356 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:22.923397 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:22.923890 (+ 493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:22.923891 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:22.923892 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:22.923895 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:22.923907 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:22.923910 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:22.923943 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:22.924004 (+ 61us) server_negotiation.cc:299] Negotiation successful
0806 01:07:22.924015 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 01:07:22.925284 32633 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c1052e5075548ef9ef675929d65c495 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c1052e5075548ef9ef675929d65c495" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42857 } }
I20260806 01:07:22.925414 32633 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1c1052e5075548ef9ef675929d65c495 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:22.925437 32633 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c1052e5075548ef9ef675929d65c495 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c1052e5075548ef9ef675929d65c495, State: Initialized, Role: FOLLOWER
I20260806 01:07:22.925570 32633 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c1052e5075548ef9ef675929d65c495 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c1052e5075548ef9ef675929d65c495" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42857 } }
I20260806 01:07:22.925657 32633 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1c1052e5075548ef9ef675929d65c495 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:07:22.925698 32633 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c1052e5075548ef9ef675929d65c495 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:07:22.925748 32633 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c1052e5075548ef9ef675929d65c495 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:22.926333 32633 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c1052e5075548ef9ef675929d65c495 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c1052e5075548ef9ef675929d65c495" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42857 } }
I20260806 01:07:22.926419 32633 leader_election.cc:302] T 00000000000000000000000000000000 P 1c1052e5075548ef9ef675929d65c495 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c1052e5075548ef9ef675929d65c495; no voters:
I20260806 01:07:22.926609 32633 leader_election.cc:288] T 00000000000000000000000000000000 P 1c1052e5075548ef9ef675929d65c495 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:07:22.926654 32643 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c1052e5075548ef9ef675929d65c495 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:22.926846 32643 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c1052e5075548ef9ef675929d65c495 [term 1 LEADER]: Becoming Leader. State: Replica: 1c1052e5075548ef9ef675929d65c495, State: Running, Role: LEADER
I20260806 01:07:22.926864 32633 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c1052e5075548ef9ef675929d65c495 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:22.926939 32643 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c1052e5075548ef9ef675929d65c495 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c1052e5075548ef9ef675929d65c495" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42857 } }
I20260806 01:07:22.927300 32644 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c1052e5075548ef9ef675929d65c495 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1c1052e5075548ef9ef675929d65c495" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c1052e5075548ef9ef675929d65c495" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42857 } } }
I20260806 01:07:22.927335 32645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c1052e5075548ef9ef675929d65c495 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c1052e5075548ef9ef675929d65c495. Latest consensus state: current_term: 1 leader_uuid: "1c1052e5075548ef9ef675929d65c495" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c1052e5075548ef9ef675929d65c495" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42857 } } }
I20260806 01:07:22.927464 32644 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c1052e5075548ef9ef675929d65c495 [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:22.927476 32645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c1052e5075548ef9ef675929d65c495 [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:22.927903 32652 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:07:22.928386 32652 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:07:22.930011 32652 catalog_manager.cc:1347] Generated new cluster ID: f6c5fba745fe4d79ac0135fe1ff45744
I20260806 01:07:22.930063 32652 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:07:22.941169 32652 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:07:22.941366 32652 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:07:22.950127 32652 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1c1052e5075548ef9ef675929d65c495: Generated new TSK 0
I20260806 01:07:22.950407 32652 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:07:22.952816 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 32563
2026-08-06T01:07:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1369 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:07:23 dist-test-slave-69rg krb5kdc[32664](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:07:23 dist-test-slave-69rg krb5kdc[32664](info): set up 2 sockets
Aug 06 01:07:23 dist-test-slave-69rg krb5kdc[32664](info): commencing operation
krb5kdc: starting...
W20260806 01:07:24.024489 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.053s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:07:24 dist-test-slave-69rg krb5kdc[32664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978444, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:07:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:07:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 01:07:24.165871 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41153
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41153
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:24.252638 32677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:24.252908 32677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:24.252954 32677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:24.254285 32677 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:24.254359 32677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:24.254382 32677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:24.254405 32677 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:24.254432 32677 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:24.256006 32677 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41153
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41153
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32677
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:24.256311 32677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:24.256559 32677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:24.261952 32685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:24.261899 32682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:24.262229 32677 server_base.cc:1034] running on GCE node
W20260806 01:07:24.261904 32683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:24.262533 32677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:24.262928 32677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:24.264135 32677 hybrid_clock.cc:648] HybridClock initialized: now 1785978444264106 us; error 48 us; skew 500 ppm
Aug 06 01:07:24 dist-test-slave-69rg krb5kdc[32664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978444, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:24.267484 32677 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 01:07:24.268450 32677 webserver.cc:460] Webserver started at http://127.0.0.1:38143/ using document root <none> and password file <none>
I20260806 01:07:24.268728 32677 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:24.268805 32677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:24.268968 32677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:24.270813 32677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "97ec3dc71f7c401392a0e0a66cbf2c04"
format_stamp: "Formatted at 2026-08-06 01:07:24 on dist-test-slave-69rg"
server_key: "5a82f9d8efa9fe0e1c7f8e413a771fd4"
server_key_iv: "9a6c5e7a3b0c81e7361216b584afb12a"
server_key_version: "encryptionkey@0"
I20260806 01:07:24.271258 32677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "97ec3dc71f7c401392a0e0a66cbf2c04"
format_stamp: "Formatted at 2026-08-06 01:07:24 on dist-test-slave-69rg"
server_key: "5a82f9d8efa9fe0e1c7f8e413a771fd4"
server_key_iv: "9a6c5e7a3b0c81e7361216b584afb12a"
server_key_version: "encryptionkey@0"
I20260806 01:07:24.272920 32677 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:07:24.273950 32693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:24.274227 32677 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:24.274325 32677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "97ec3dc71f7c401392a0e0a66cbf2c04"
format_stamp: "Formatted at 2026-08-06 01:07:24 on dist-test-slave-69rg"
server_key: "5a82f9d8efa9fe0e1c7f8e413a771fd4"
server_key_iv: "9a6c5e7a3b0c81e7361216b584afb12a"
server_key_version: "encryptionkey@0"
I20260806 01:07:24.274528 32677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:24.291256 32677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:24.293910 32677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:24.294087 32677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:24.298801 32677 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41153
I20260806 01:07:24.298843 32745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41153 every 8 connection(s)
I20260806 01:07:24.299227 32677 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:07:24.300200 32746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:24.302388 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 32677
I20260806 01:07:24.302518 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:07:24.302742 11617 external_mini_cluster.cc:1428] Setting key 70a8d3f2c583d4243655a46b105d35fe
I20260806 01:07:24.302904 32746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97ec3dc71f7c401392a0e0a66cbf2c04: Bootstrap starting.
I20260806 01:07:24.303717 32746 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 97ec3dc71f7c401392a0e0a66cbf2c04: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:24.304046 32746 log.cc:824] T 00000000000000000000000000000000 P 97ec3dc71f7c401392a0e0a66cbf2c04: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:24.304924 32746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97ec3dc71f7c401392a0e0a66cbf2c04: No bootstrap required, opened a new log
I20260806 01:07:24.307368 32746 raft_consensus.cc:348] T 00000000000000000000000000000000 P 97ec3dc71f7c401392a0e0a66cbf2c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97ec3dc71f7c401392a0e0a66cbf2c04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41153 } }
I20260806 01:07:24.307546 32746 raft_consensus.cc:374] T 00000000000000000000000000000000 P 97ec3dc71f7c401392a0e0a66cbf2c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:24.307580 32746 raft_consensus.cc:729] T 00000000000000000000000000000000 P 97ec3dc71f7c401392a0e0a66cbf2c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97ec3dc71f7c401392a0e0a66cbf2c04, State: Initialized, Role: FOLLOWER
I20260806 01:07:24.307699 32746 consensus_queue.cc:260] T 00000000000000000000000000000000 P 97ec3dc71f7c401392a0e0a66cbf2c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97ec3dc71f7c401392a0e0a66cbf2c04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41153 } }
I20260806 01:07:24.307777 32746 raft_consensus.cc:388] T 00000000000000000000000000000000 P 97ec3dc71f7c401392a0e0a66cbf2c04 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:07:24.307807 32746 raft_consensus.cc:482] T 00000000000000000000000000000000 P 97ec3dc71f7c401392a0e0a66cbf2c04 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:07:24.307852 32746 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 97ec3dc71f7c401392a0e0a66cbf2c04 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:24.308669 32746 raft_consensus.cc:504] T 00000000000000000000000000000000 P 97ec3dc71f7c401392a0e0a66cbf2c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97ec3dc71f7c401392a0e0a66cbf2c04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41153 } }
I20260806 01:07:24.308795 32746 leader_election.cc:302] T 00000000000000000000000000000000 P 97ec3dc71f7c401392a0e0a66cbf2c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 97ec3dc71f7c401392a0e0a66cbf2c04; no voters:
I20260806 01:07:24.308977 32746 leader_election.cc:288] T 00000000000000000000000000000000 P 97ec3dc71f7c401392a0e0a66cbf2c04 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:07:24.309036 32751 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 97ec3dc71f7c401392a0e0a66cbf2c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:24.309223 32751 raft_consensus.cc:686] T 00000000000000000000000000000000 P 97ec3dc71f7c401392a0e0a66cbf2c04 [term 1 LEADER]: Becoming Leader. State: Replica: 97ec3dc71f7c401392a0e0a66cbf2c04, State: Running, Role: LEADER
I20260806 01:07:24.309288 32746 sys_catalog.cc:564] T 00000000000000000000000000000000 P 97ec3dc71f7c401392a0e0a66cbf2c04 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:24.309346 32751 consensus_queue.cc:237] T 00000000000000000000000000000000 P 97ec3dc71f7c401392a0e0a66cbf2c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97ec3dc71f7c401392a0e0a66cbf2c04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41153 } }
I20260806 01:07:24.309679 32752 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97ec3dc71f7c401392a0e0a66cbf2c04 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "97ec3dc71f7c401392a0e0a66cbf2c04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97ec3dc71f7c401392a0e0a66cbf2c04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41153 } } }
I20260806 01:07:24.309782 32752 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97ec3dc71f7c401392a0e0a66cbf2c04 [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:24.309957 32753 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97ec3dc71f7c401392a0e0a66cbf2c04 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 97ec3dc71f7c401392a0e0a66cbf2c04. Latest consensus state: current_term: 1 leader_uuid: "97ec3dc71f7c401392a0e0a66cbf2c04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97ec3dc71f7c401392a0e0a66cbf2c04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41153 } } }
I20260806 01:07:24.310026 32753 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97ec3dc71f7c401392a0e0a66cbf2c04 [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:24.310266 32758 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 06 01:07:24 dist-test-slave-69rg krb5kdc[32664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978444, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 01:07:24.310873 32758 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:07:24.315343 32749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:24.303323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33917 (local address 127.0.0.1:41153)
0806 01:07:24.303519 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:24.303531 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:24.303580 (+ 49us) server_negotiation.cc:407] Connection header received
0806 01:07:24.304083 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:24.304090 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:24.304169 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:24.304336 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:24.305106 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:24.306514 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:24.307318 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:24.307939 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:24.308050 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:24.311132 (+ 3082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:24.311136 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:24.311136 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:24.311149 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:24.313406 (+ 2257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:24.314042 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:24.314046 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:24.314046 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:24.314151 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:24.314385 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:24.314386 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:24.314387 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:24.314644 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:24.314833 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:24.314963 (+ 130us) server_negotiation.cc:299] Negotiation successful
0806 01:07:24.315115 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":105,"threads_started":1}
I20260806 01:07:24.316388 11617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 01:07:24.323505 32758 catalog_manager.cc:1347] Generated new cluster ID: b30c59e94ad2493e834b6bc1a8da18cc
I20260806 01:07:24.323585 32758 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:07:24.328037 32749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:24.317902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35177 (local address 127.0.0.1:41153)
0806 01:07:24.317946 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:24.317948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:24.318064 (+ 116us) server_negotiation.cc:407] Connection header received
0806 01:07:24.318137 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:24.318138 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:24.318147 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:24.318195 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:24.318900 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:24.319381 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:24.320454 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:24.320730 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:24.320801 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:24.322379 (+ 1578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:24.322380 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:24.322380 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:24.322387 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:24.326639 (+ 4252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:24.327137 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:24.327138 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:24.327138 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:24.327218 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:24.327440 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:24.327441 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:24.327441 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:24.327583 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:24.327690 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:24.327842 (+ 152us) server_negotiation.cc:299] Negotiation successful
0806 01:07:24.327930 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 01:07:24.343104 32758 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:07:24.343693 32758 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:07:24.346782 32758 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 97ec3dc71f7c401392a0e0a66cbf2c04: Generated new TSK 0
I20260806 01:07:24.347034 32758 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:07:24.355480 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 32677
2026-08-06T01:07:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1403 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:07:24 dist-test-slave-69rg krb5kdc[309](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:07:24 dist-test-slave-69rg krb5kdc[309](info): set up 2 sockets
Aug 06 01:07:24 dist-test-slave-69rg krb5kdc[309](info): commencing operation
krb5kdc: starting...
W20260806 01:07:25.422886 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.047s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:07:25 dist-test-slave-69rg krb5kdc[309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:07:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:07:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 01:07:25.552850 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39759
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39759
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:25.638625 322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:25.638883 322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:25.638926 322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:25.640141 322 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:25.640223 322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:25.640249 322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:25.640277 322 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:25.640311 322 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:25.641959 322 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39759
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39759
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.322
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:25.642262 322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:25.642516 322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:25.647473 330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:25.647588 328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:25.647662 327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:25.647965 322 server_base.cc:1034] running on GCE node
I20260806 01:07:25.648332 322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:25.648676 322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:25.649890 322 hybrid_clock.cc:648] HybridClock initialized: now 1785978445649860 us; error 38 us; skew 500 ppm
Aug 06 01:07:25 dist-test-slave-69rg krb5kdc[309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978445, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:25.659236 322 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 01:07:25.659772 322 webserver.cc:460] Webserver started at http://127.0.0.1:42477/ using document root <none> and password file <none>
I20260806 01:07:25.660023 322 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:25.660094 322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:25.660290 322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:25.661458 322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "2b0cfb0d81d248f89bfe102185fc1f5a"
format_stamp: "Formatted at 2026-08-06 01:07:25 on dist-test-slave-69rg"
server_key: "b1b42d6b41c557b8ef34decebff80e81"
server_key_iv: "e45d5bcbc9bc122e26a3fb6a9e63ad51"
server_key_version: "encryptionkey@0"
I20260806 01:07:25.661901 322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "2b0cfb0d81d248f89bfe102185fc1f5a"
format_stamp: "Formatted at 2026-08-06 01:07:25 on dist-test-slave-69rg"
server_key: "b1b42d6b41c557b8ef34decebff80e81"
server_key_iv: "e45d5bcbc9bc122e26a3fb6a9e63ad51"
server_key_version: "encryptionkey@0"
I20260806 01:07:25.663340 322 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:07:25.664124 337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:25.664356 322 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:25.664472 322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "2b0cfb0d81d248f89bfe102185fc1f5a"
format_stamp: "Formatted at 2026-08-06 01:07:25 on dist-test-slave-69rg"
server_key: "b1b42d6b41c557b8ef34decebff80e81"
server_key_iv: "e45d5bcbc9bc122e26a3fb6a9e63ad51"
server_key_version: "encryptionkey@0"
I20260806 01:07:25.664561 322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:25.699070 322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:25.701560 322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:25.701747 322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:25.705853 322 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39759
I20260806 01:07:25.705907 390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39759 every 8 connection(s)
I20260806 01:07:25.706310 322 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:07:25.707267 391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:25.708758 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 322
I20260806 01:07:25.708900 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:07:25.709110 11617 external_mini_cluster.cc:1428] Setting key 9b9e07416bef7d92c51ef4e495d224ab
I20260806 01:07:25.711328 391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b0cfb0d81d248f89bfe102185fc1f5a: Bootstrap starting.
I20260806 01:07:25.712013 391 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2b0cfb0d81d248f89bfe102185fc1f5a: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:25.712378 391 log.cc:824] T 00000000000000000000000000000000 P 2b0cfb0d81d248f89bfe102185fc1f5a: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:25.713155 391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b0cfb0d81d248f89bfe102185fc1f5a: No bootstrap required, opened a new log
I20260806 01:07:25.715057 394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:25.709738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48645 (local address 127.0.0.1:39759)
0806 01:07:25.709939 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:25.709948 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:25.709983 (+ 35us) server_negotiation.cc:407] Connection header received
0806 01:07:25.710440 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:25.710446 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:25.710492 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:25.710607 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:25.710876 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:25.711927 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:25.712948 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:25.713433 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:25.713518 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:25.714366 (+ 848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:25.714369 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:25.714369 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:25.714535 (+ 166us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:25.714571 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:25.714581 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:25.714641 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:25.714754 (+ 113us) server_negotiation.cc:299] Negotiation successful
0806 01:07:25.714842 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":107,"threads_started":1}
I20260806 01:07:25.715703 391 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2b0cfb0d81d248f89bfe102185fc1f5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b0cfb0d81d248f89bfe102185fc1f5a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39759 } }
I20260806 01:07:25.715914 391 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2b0cfb0d81d248f89bfe102185fc1f5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:25.715969 391 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2b0cfb0d81d248f89bfe102185fc1f5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b0cfb0d81d248f89bfe102185fc1f5a, State: Initialized, Role: FOLLOWER
I20260806 01:07:25.716097 391 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b0cfb0d81d248f89bfe102185fc1f5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b0cfb0d81d248f89bfe102185fc1f5a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39759 } }
I20260806 01:07:25.716158 11617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 01:07:25.716199 391 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2b0cfb0d81d248f89bfe102185fc1f5a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:07:25.716233 391 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b0cfb0d81d248f89bfe102185fc1f5a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:07:25.716279 391 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b0cfb0d81d248f89bfe102185fc1f5a [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:25.717078 391 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b0cfb0d81d248f89bfe102185fc1f5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b0cfb0d81d248f89bfe102185fc1f5a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39759 } }
I20260806 01:07:25.717208 391 leader_election.cc:302] T 00000000000000000000000000000000 P 2b0cfb0d81d248f89bfe102185fc1f5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2b0cfb0d81d248f89bfe102185fc1f5a; no voters:
I20260806 01:07:25.717382 391 leader_election.cc:288] T 00000000000000000000000000000000 P 2b0cfb0d81d248f89bfe102185fc1f5a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:07:25.717450 398 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2b0cfb0d81d248f89bfe102185fc1f5a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:25.717674 398 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2b0cfb0d81d248f89bfe102185fc1f5a [term 1 LEADER]: Becoming Leader. State: Replica: 2b0cfb0d81d248f89bfe102185fc1f5a, State: Running, Role: LEADER
I20260806 01:07:25.717712 391 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2b0cfb0d81d248f89bfe102185fc1f5a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:25.719309 398 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b0cfb0d81d248f89bfe102185fc1f5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b0cfb0d81d248f89bfe102185fc1f5a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39759 } }
I20260806 01:07:25.719982 401 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b0cfb0d81d248f89bfe102185fc1f5a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b0cfb0d81d248f89bfe102185fc1f5a. Latest consensus state: current_term: 1 leader_uuid: "2b0cfb0d81d248f89bfe102185fc1f5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b0cfb0d81d248f89bfe102185fc1f5a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39759 } } }
I20260806 01:07:25.720109 402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b0cfb0d81d248f89bfe102185fc1f5a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2b0cfb0d81d248f89bfe102185fc1f5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b0cfb0d81d248f89bfe102185fc1f5a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39759 } } }
I20260806 01:07:25.720150 401 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b0cfb0d81d248f89bfe102185fc1f5a [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:25.720152 402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b0cfb0d81d248f89bfe102185fc1f5a [sys.catalog]: This master's current role is: LEADER
W20260806 01:07:25.720954 415 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2b0cfb0d81d248f89bfe102185fc1f5a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 01:07:25.721010 415 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 01:07:25.721086 416 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:07:25.721258 416 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:07:25.721475 394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:25.717913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35209 (local address 127.0.0.1:39759)
0806 01:07:25.717949 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:25.717951 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:25.718113 (+ 162us) server_negotiation.cc:407] Connection header received
0806 01:07:25.718138 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:25.718139 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:25.718150 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:25.718216 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:25.718449 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:25.718949 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:25.719885 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:25.720233 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:25.720280 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:25.721118 (+ 838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:25.721119 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:25.721120 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:25.721124 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:25.721139 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:25.721144 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:25.721185 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:25.721377 (+ 192us) server_negotiation.cc:299] Negotiation successful
0806 01:07:25.721398 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260806 01:07:25.723160 416 catalog_manager.cc:1347] Generated new cluster ID: d0e7d255ab8745fe89e8a422f998a712
I20260806 01:07:25.723213 416 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:07:25.742300 416 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:07:25.742884 416 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:07:25.753720 416 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2b0cfb0d81d248f89bfe102185fc1f5a: Generated new TSK 0
I20260806 01:07:25.753994 416 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:07:25.764427 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 322
2026-08-06T01:07:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1409 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:07:25 dist-test-slave-69rg krb5kdc[422](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:07:25 dist-test-slave-69rg krb5kdc[422](info): set up 2 sockets
Aug 06 01:07:25 dist-test-slave-69rg krb5kdc[422](info): commencing operation
krb5kdc: starting...
W20260806 01:07:26.830844 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:07:26 dist-test-slave-69rg krb5kdc[422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978446, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:07:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:07:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 01:07:26.970584 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44815
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44815
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:27.055703 435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:27.056026 435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:27.056075 435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:27.057694 435 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:27.057749 435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:27.057765 435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:27.057777 435 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:27.057789 435 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:27.059535 435 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44815
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44815
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:27.059754 435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:27.059942 435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:27.065068 440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:27.065284 435 server_base.cc:1034] running on GCE node
W20260806 01:07:27.065181 443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:27.065096 441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:27.065696 435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:27.066074 435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:27.067301 435 hybrid_clock.cc:648] HybridClock initialized: now 1785978447067278 us; error 42 us; skew 500 ppm
Aug 06 01:07:27 dist-test-slave-69rg krb5kdc[422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978447, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:27.070150 435 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 01:07:27.070704 435 webserver.cc:460] Webserver started at http://127.0.0.1:42971/ using document root <none> and password file <none>
I20260806 01:07:27.070948 435 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:27.071017 435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:27.071177 435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:27.072315 435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "09ae355a03ca4af781eece68eb9b855e"
format_stamp: "Formatted at 2026-08-06 01:07:27 on dist-test-slave-69rg"
server_key: "4be9d12a2c7ababc8dede8050469624c"
server_key_iv: "0bce28b6c4994e7f2c6c587d56c7f5e7"
server_key_version: "encryptionkey@0"
I20260806 01:07:27.072705 435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "09ae355a03ca4af781eece68eb9b855e"
format_stamp: "Formatted at 2026-08-06 01:07:27 on dist-test-slave-69rg"
server_key: "4be9d12a2c7ababc8dede8050469624c"
server_key_iv: "0bce28b6c4994e7f2c6c587d56c7f5e7"
server_key_version: "encryptionkey@0"
I20260806 01:07:27.074206 435 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260806 01:07:27.075064 450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:27.075299 435 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:27.075415 435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "09ae355a03ca4af781eece68eb9b855e"
format_stamp: "Formatted at 2026-08-06 01:07:27 on dist-test-slave-69rg"
server_key: "4be9d12a2c7ababc8dede8050469624c"
server_key_iv: "0bce28b6c4994e7f2c6c587d56c7f5e7"
server_key_version: "encryptionkey@0"
I20260806 01:07:27.075493 435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:27.079320 435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:27.082047 435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:27.082223 435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:27.086650 435 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44815
I20260806 01:07:27.086687 503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44815 every 8 connection(s)
I20260806 01:07:27.087040 435 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:07:27.087931 504 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:27.090459 504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09ae355a03ca4af781eece68eb9b855e: Bootstrap starting.
I20260806 01:07:27.091058 504 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 09ae355a03ca4af781eece68eb9b855e: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:27.091359 504 log.cc:824] T 00000000000000000000000000000000 P 09ae355a03ca4af781eece68eb9b855e: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:27.092121 504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09ae355a03ca4af781eece68eb9b855e: No bootstrap required, opened a new log
I20260806 01:07:27.093799 504 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09ae355a03ca4af781eece68eb9b855e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09ae355a03ca4af781eece68eb9b855e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44815 } }
I20260806 01:07:27.094012 504 raft_consensus.cc:374] T 00000000000000000000000000000000 P 09ae355a03ca4af781eece68eb9b855e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:27.094034 504 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09ae355a03ca4af781eece68eb9b855e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09ae355a03ca4af781eece68eb9b855e, State: Initialized, Role: FOLLOWER
I20260806 01:07:27.094215 504 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09ae355a03ca4af781eece68eb9b855e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09ae355a03ca4af781eece68eb9b855e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44815 } }
I20260806 01:07:27.094278 504 raft_consensus.cc:388] T 00000000000000000000000000000000 P 09ae355a03ca4af781eece68eb9b855e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:07:27.094319 504 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09ae355a03ca4af781eece68eb9b855e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:07:27.094368 504 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09ae355a03ca4af781eece68eb9b855e [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:27.094919 504 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09ae355a03ca4af781eece68eb9b855e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09ae355a03ca4af781eece68eb9b855e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44815 } }
I20260806 01:07:27.095031 504 leader_election.cc:302] T 00000000000000000000000000000000 P 09ae355a03ca4af781eece68eb9b855e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09ae355a03ca4af781eece68eb9b855e; no voters:
I20260806 01:07:27.095227 504 leader_election.cc:288] T 00000000000000000000000000000000 P 09ae355a03ca4af781eece68eb9b855e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:07:27.095305 507 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09ae355a03ca4af781eece68eb9b855e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:27.095489 504 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09ae355a03ca4af781eece68eb9b855e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:27.095499 507 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09ae355a03ca4af781eece68eb9b855e [term 1 LEADER]: Becoming Leader. State: Replica: 09ae355a03ca4af781eece68eb9b855e, State: Running, Role: LEADER
I20260806 01:07:27.095685 507 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09ae355a03ca4af781eece68eb9b855e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09ae355a03ca4af781eece68eb9b855e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44815 } }
I20260806 01:07:27.096436 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 435
I20260806 01:07:27.096577 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:07:27.096789 11617 external_mini_cluster.cc:1428] Setting key 61c3fb0006509096a7c7c22f2e434866
I20260806 01:07:27.097239 509 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09ae355a03ca4af781eece68eb9b855e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09ae355a03ca4af781eece68eb9b855e. Latest consensus state: current_term: 1 leader_uuid: "09ae355a03ca4af781eece68eb9b855e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09ae355a03ca4af781eece68eb9b855e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44815 } } }
I20260806 01:07:27.097885 509 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09ae355a03ca4af781eece68eb9b855e [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:27.097235 508 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09ae355a03ca4af781eece68eb9b855e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "09ae355a03ca4af781eece68eb9b855e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09ae355a03ca4af781eece68eb9b855e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44815 } } }
I20260806 01:07:27.098097 508 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09ae355a03ca4af781eece68eb9b855e [sys.catalog]: This master's current role is: LEADER
W20260806 01:07:27.097442 522 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 09ae355a03ca4af781eece68eb9b855e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 01:07:27.098193 522 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 01:07:27.098259 527 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:07:27.098448 527 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:07:27.100046 525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:27.097585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52837 (local address 127.0.0.1:44815)
0806 01:07:27.098252 (+ 667us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:27.098262 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:27.098298 (+ 36us) server_negotiation.cc:407] Connection header received
0806 01:07:27.098418 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:27.098430 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:27.098453 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:27.098601 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:27.099545 (+ 944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:27.099548 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:27.099549 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:27.099553 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:27.099594 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:27.099610 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:27.099670 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:27.099809 (+ 139us) server_negotiation.cc:299] Negotiation successful
0806 01:07:27.099860 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608,"thread_start_us":71,"threads_started":1}
I20260806 01:07:27.100307 527 catalog_manager.cc:1347] Generated new cluster ID: 29ae2ab78e6a4110b4a0e54db1960af5
I20260806 01:07:27.100364 527 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:07:27.101083 11617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 01:07:27.103892 525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:27.102852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57149 (local address 127.0.0.1:44815)
0806 01:07:27.102882 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:27.102884 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:27.102897 (+ 13us) server_negotiation.cc:407] Connection header received
0806 01:07:27.102975 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:27.102975 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:27.102980 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:27.103025 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:27.103671 (+ 646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:27.103672 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:27.103672 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:27.103676 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:27.103692 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:27.103696 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:27.103750 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:27.103817 (+ 67us) server_negotiation.cc:299] Negotiation successful
0806 01:07:27.103829 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260806 01:07:27.124215 527 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:07:27.124478 527 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:07:27.134666 527 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 09ae355a03ca4af781eece68eb9b855e: Generated new TSK 0
I20260806 01:07:27.134975 527 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:07:27.145048 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 435
2026-08-06T01:07:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1380 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:07:27 dist-test-slave-69rg krb5kdc[536](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:07:27 dist-test-slave-69rg krb5kdc[536](info): set up 2 sockets
Aug 06 01:07:27 dist-test-slave-69rg krb5kdc[536](info): commencing operation
krb5kdc: starting...
W20260806 01:07:28.246142 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.080s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:07:28 dist-test-slave-69rg krb5kdc[536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978448, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:07:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:07:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 01:07:28.381763 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45469
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45469
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:28.470425 549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:28.470659 549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:28.470685 549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:28.471860 549 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:28.471905 549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:28.471920 549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:28.471933 549 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:28.471946 549 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:28.473456 549 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45469
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45469
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.549
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:28.473680 549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:28.473901 549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:28.479147 557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:28.479121 554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:28.479117 555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:28.479252 549 server_base.cc:1034] running on GCE node
I20260806 01:07:28.479734 549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:28.480078 549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:28.481276 549 hybrid_clock.cc:648] HybridClock initialized: now 1785978448481239 us; error 55 us; skew 500 ppm
Aug 06 01:07:28 dist-test-slave-69rg krb5kdc[536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978448, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:28.484189 549 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 01:07:28.484772 549 webserver.cc:460] Webserver started at http://127.0.0.1:39987/ using document root <none> and password file <none>
I20260806 01:07:28.485025 549 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:28.485102 549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:28.485260 549 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:28.486521 549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "a629b5b0cc4849f4b1035cbb1a76c527"
format_stamp: "Formatted at 2026-08-06 01:07:28 on dist-test-slave-69rg"
server_key: "9de9d825dca52c137b74fa9abad4cf0b"
server_key_iv: "819e411fb30b29fea70ee327ddec0050"
server_key_version: "encryptionkey@0"
I20260806 01:07:28.486937 549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "a629b5b0cc4849f4b1035cbb1a76c527"
format_stamp: "Formatted at 2026-08-06 01:07:28 on dist-test-slave-69rg"
server_key: "9de9d825dca52c137b74fa9abad4cf0b"
server_key_iv: "819e411fb30b29fea70ee327ddec0050"
server_key_version: "encryptionkey@0"
I20260806 01:07:28.488530 549 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 01:07:28.489575 564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:28.489908 549 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:28.490024 549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "a629b5b0cc4849f4b1035cbb1a76c527"
format_stamp: "Formatted at 2026-08-06 01:07:28 on dist-test-slave-69rg"
server_key: "9de9d825dca52c137b74fa9abad4cf0b"
server_key_iv: "819e411fb30b29fea70ee327ddec0050"
server_key_version: "encryptionkey@0"
I20260806 01:07:28.490123 549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:28.506680 549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:28.509282 549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:28.509467 549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:28.513764 549 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45469
I20260806 01:07:28.513911 616 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45469 every 8 connection(s)
I20260806 01:07:28.514235 549 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:07:28.515172 617 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:28.517779 617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a629b5b0cc4849f4b1035cbb1a76c527: Bootstrap starting.
I20260806 01:07:28.518010 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 549
I20260806 01:07:28.518194 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:07:28.518432 11617 external_mini_cluster.cc:1428] Setting key b7c3f20ff68f0639515ed0b090fee521
I20260806 01:07:28.518628 617 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a629b5b0cc4849f4b1035cbb1a76c527: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:28.518983 617 log.cc:824] T 00000000000000000000000000000000 P a629b5b0cc4849f4b1035cbb1a76c527: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:28.519806 617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a629b5b0cc4849f4b1035cbb1a76c527: No bootstrap required, opened a new log
I20260806 01:07:28.522385 617 raft_consensus.cc:348] T 00000000000000000000000000000000 P a629b5b0cc4849f4b1035cbb1a76c527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a629b5b0cc4849f4b1035cbb1a76c527" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45469 } }
I20260806 01:07:28.522578 617 raft_consensus.cc:374] T 00000000000000000000000000000000 P a629b5b0cc4849f4b1035cbb1a76c527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:28.522610 617 raft_consensus.cc:729] T 00000000000000000000000000000000 P a629b5b0cc4849f4b1035cbb1a76c527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a629b5b0cc4849f4b1035cbb1a76c527, State: Initialized, Role: FOLLOWER
I20260806 01:07:28.522732 617 consensus_queue.cc:260] T 00000000000000000000000000000000 P a629b5b0cc4849f4b1035cbb1a76c527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a629b5b0cc4849f4b1035cbb1a76c527" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45469 } }
I20260806 01:07:28.522809 617 raft_consensus.cc:388] T 00000000000000000000000000000000 P a629b5b0cc4849f4b1035cbb1a76c527 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:07:28.522840 617 raft_consensus.cc:482] T 00000000000000000000000000000000 P a629b5b0cc4849f4b1035cbb1a76c527 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:07:28.522888 617 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a629b5b0cc4849f4b1035cbb1a76c527 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:28.523586 617 raft_consensus.cc:504] T 00000000000000000000000000000000 P a629b5b0cc4849f4b1035cbb1a76c527 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a629b5b0cc4849f4b1035cbb1a76c527" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45469 } }
I20260806 01:07:28.523715 617 leader_election.cc:302] T 00000000000000000000000000000000 P a629b5b0cc4849f4b1035cbb1a76c527 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a629b5b0cc4849f4b1035cbb1a76c527; no voters:
I20260806 01:07:28.523926 617 leader_election.cc:288] T 00000000000000000000000000000000 P a629b5b0cc4849f4b1035cbb1a76c527 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:07:28.523986 623 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a629b5b0cc4849f4b1035cbb1a76c527 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:28.524210 623 raft_consensus.cc:686] T 00000000000000000000000000000000 P a629b5b0cc4849f4b1035cbb1a76c527 [term 1 LEADER]: Becoming Leader. State: Replica: a629b5b0cc4849f4b1035cbb1a76c527, State: Running, Role: LEADER
I20260806 01:07:28.524272 617 sys_catalog.cc:564] T 00000000000000000000000000000000 P a629b5b0cc4849f4b1035cbb1a76c527 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:28.524390 623 consensus_queue.cc:237] T 00000000000000000000000000000000 P a629b5b0cc4849f4b1035cbb1a76c527 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a629b5b0cc4849f4b1035cbb1a76c527" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45469 } }
I20260806 01:07:28.524874 623 sys_catalog.cc:455] T 00000000000000000000000000000000 P a629b5b0cc4849f4b1035cbb1a76c527 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a629b5b0cc4849f4b1035cbb1a76c527. Latest consensus state: current_term: 1 leader_uuid: "a629b5b0cc4849f4b1035cbb1a76c527" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a629b5b0cc4849f4b1035cbb1a76c527" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45469 } } }
I20260806 01:07:28.524886 624 sys_catalog.cc:455] T 00000000000000000000000000000000 P a629b5b0cc4849f4b1035cbb1a76c527 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a629b5b0cc4849f4b1035cbb1a76c527" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a629b5b0cc4849f4b1035cbb1a76c527" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45469 } } }
I20260806 01:07:28.525039 624 sys_catalog.cc:458] T 00000000000000000000000000000000 P a629b5b0cc4849f4b1035cbb1a76c527 [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:28.525209 623 sys_catalog.cc:458] T 00000000000000000000000000000000 P a629b5b0cc4849f4b1035cbb1a76c527 [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:28.526080 629 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 06 01:07:28 dist-test-slave-69rg krb5kdc[536](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978448, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 01:07:28.526636 629 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:07:28.528587 629 catalog_manager.cc:1347] Generated new cluster ID: 25a71d39e9ad497380927ea5ac88b491
I20260806 01:07:28.528643 629 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:07:28.531512 621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:28.519014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.162:45877 (local address 127.0.0.1:45469)
0806 01:07:28.519244 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:28.519255 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:28.519296 (+ 41us) server_negotiation.cc:407] Connection header received
0806 01:07:28.519831 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:28.519838 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:28.519927 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:28.520059 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:28.520887 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:28.521872 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:28.522987 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:28.523429 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:28.523516 (+ 87us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:28.526851 (+ 3335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:28.526855 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:28.526855 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:28.526869 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:28.529050 (+ 2181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:28.529588 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:28.529591 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:28.529591 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:28.529711 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:28.530031 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:28.530032 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:28.530033 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:28.530372 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:28.530564 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:28.531147 (+ 583us) server_negotiation.cc:299] Negotiation successful
0806 01:07:28.531266 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":94,"threads_started":1}
I20260806 01:07:28.532976 11617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 01:07:28.546800 629 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:07:28.547437 629 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:07:28.551108 629 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a629b5b0cc4849f4b1035cbb1a76c527: Generated new TSK 0
I20260806 01:07:28.551391 629 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:07:28.554426 621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:28.534518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.162:44167 (local address 127.0.0.1:45469)
0806 01:07:28.534582 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:28.534584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:28.546094 (+ 11510us) server_negotiation.cc:407] Connection header received
0806 01:07:28.546132 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:28.546133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:28.546150 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:28.546231 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:28.547104 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:28.547975 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:28.549078 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:28.549453 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:28.549531 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:28.551231 (+ 1700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:28.551232 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:28.551233 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:28.551241 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:28.553035 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:28.553448 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:28.553449 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:28.553449 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:28.553517 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:28.553803 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:28.553804 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:28.553805 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:28.553993 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:28.554107 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:28.554252 (+ 145us) server_negotiation.cc:299] Negotiation successful
0806 01:07:28.554326 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 01:07:28.556944 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 549
W20260806 01:07:28.563768 534 connection.cc:535] client connection to 127.0.0.1:45469 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45469): Connection reset by peer (error 104)
2026-08-06T01:07:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1412 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:07:28 dist-test-slave-69rg krb5kdc[649](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:07:28 dist-test-slave-69rg krb5kdc[649](info): set up 2 sockets
Aug 06 01:07:28 dist-test-slave-69rg krb5kdc[649](info): commencing operation
krb5kdc: starting...
W20260806 01:07:29.682961 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.104s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:07:29 dist-test-slave-69rg krb5kdc[649](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:07:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:07:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 01:07:29.820830 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35131
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35131
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:29.905485 662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:29.905716 662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:29.905740 662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:29.906996 662 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:29.907060 662 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:29.907075 662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:29.907088 662 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:29.907100 662 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:29.908631 662 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35131
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.662
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:29.908864 662 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:29.909061 662 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:29.914323 670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:29.914314 668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:29.914315 667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:29.914333 662 server_base.cc:1034] running on GCE node
I20260806 01:07:29.914880 662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:29.915143 662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:29.916313 662 hybrid_clock.cc:648] HybridClock initialized: now 1785978449916302 us; error 40 us; skew 500 ppm
Aug 06 01:07:29 dist-test-slave-69rg krb5kdc[649](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978449, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:29.919061 662 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 01:07:29.919611 662 webserver.cc:460] Webserver started at http://127.0.0.1:42819/ using document root <none> and password file <none>
I20260806 01:07:29.919907 662 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:29.919981 662 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:29.920125 662 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:29.921278 662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "d8fd83a2f96b40aeb38da50e3451eece"
format_stamp: "Formatted at 2026-08-06 01:07:29 on dist-test-slave-69rg"
server_key: "cb8e59e1e84020133cf29a68a2fe25e8"
server_key_iv: "8b5c31f80e0265b4eb7abbd4a89d8788"
server_key_version: "encryptionkey@0"
I20260806 01:07:29.921676 662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "d8fd83a2f96b40aeb38da50e3451eece"
format_stamp: "Formatted at 2026-08-06 01:07:29 on dist-test-slave-69rg"
server_key: "cb8e59e1e84020133cf29a68a2fe25e8"
server_key_iv: "8b5c31f80e0265b4eb7abbd4a89d8788"
server_key_version: "encryptionkey@0"
I20260806 01:07:29.923336 662 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:07:29.924216 677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:29.924508 662 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:29.924651 662 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "d8fd83a2f96b40aeb38da50e3451eece"
format_stamp: "Formatted at 2026-08-06 01:07:29 on dist-test-slave-69rg"
server_key: "cb8e59e1e84020133cf29a68a2fe25e8"
server_key_iv: "8b5c31f80e0265b4eb7abbd4a89d8788"
server_key_version: "encryptionkey@0"
I20260806 01:07:29.924753 662 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:29.954193 662 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:29.956643 662 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:29.956835 662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:29.961753 662 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35131
I20260806 01:07:29.961920 729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35131 every 8 connection(s)
I20260806 01:07:29.962298 662 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:07:29.963328 730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:29.966003 730 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8fd83a2f96b40aeb38da50e3451eece: Bootstrap starting.
I20260806 01:07:29.966688 730 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d8fd83a2f96b40aeb38da50e3451eece: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:29.967017 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 662
I20260806 01:07:29.967070 730 log.cc:824] T 00000000000000000000000000000000 P d8fd83a2f96b40aeb38da50e3451eece: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:29.967166 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:07:29.967427 11617 external_mini_cluster.cc:1428] Setting key e1a473cbc26a0a3916d8b04288d40fc2
I20260806 01:07:29.968160 730 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8fd83a2f96b40aeb38da50e3451eece: No bootstrap required, opened a new log
I20260806 01:07:29.971026 730 raft_consensus.cc:348] T 00000000000000000000000000000000 P d8fd83a2f96b40aeb38da50e3451eece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8fd83a2f96b40aeb38da50e3451eece" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35131 } }
I20260806 01:07:29.971259 730 raft_consensus.cc:374] T 00000000000000000000000000000000 P d8fd83a2f96b40aeb38da50e3451eece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:29.971304 730 raft_consensus.cc:729] T 00000000000000000000000000000000 P d8fd83a2f96b40aeb38da50e3451eece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fd83a2f96b40aeb38da50e3451eece, State: Initialized, Role: FOLLOWER
I20260806 01:07:29.971441 730 consensus_queue.cc:260] T 00000000000000000000000000000000 P d8fd83a2f96b40aeb38da50e3451eece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8fd83a2f96b40aeb38da50e3451eece" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35131 } }
I20260806 01:07:29.971531 730 raft_consensus.cc:388] T 00000000000000000000000000000000 P d8fd83a2f96b40aeb38da50e3451eece [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:07:29.971563 730 raft_consensus.cc:482] T 00000000000000000000000000000000 P d8fd83a2f96b40aeb38da50e3451eece [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:07:29.971607 730 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d8fd83a2f96b40aeb38da50e3451eece [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:29.972430 730 raft_consensus.cc:504] T 00000000000000000000000000000000 P d8fd83a2f96b40aeb38da50e3451eece [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8fd83a2f96b40aeb38da50e3451eece" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35131 } }
I20260806 01:07:29.972530 730 leader_election.cc:302] T 00000000000000000000000000000000 P d8fd83a2f96b40aeb38da50e3451eece [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d8fd83a2f96b40aeb38da50e3451eece; no voters:
I20260806 01:07:29.972805 730 leader_election.cc:288] T 00000000000000000000000000000000 P d8fd83a2f96b40aeb38da50e3451eece [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:07:29.972832 735 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d8fd83a2f96b40aeb38da50e3451eece [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:29.973059 735 raft_consensus.cc:686] T 00000000000000000000000000000000 P d8fd83a2f96b40aeb38da50e3451eece [term 1 LEADER]: Becoming Leader. State: Replica: d8fd83a2f96b40aeb38da50e3451eece, State: Running, Role: LEADER
I20260806 01:07:29.973198 730 sys_catalog.cc:564] T 00000000000000000000000000000000 P d8fd83a2f96b40aeb38da50e3451eece [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:29.973204 735 consensus_queue.cc:237] T 00000000000000000000000000000000 P d8fd83a2f96b40aeb38da50e3451eece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8fd83a2f96b40aeb38da50e3451eece" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35131 } }
I20260806 01:07:29.973635 735 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8fd83a2f96b40aeb38da50e3451eece [sys.catalog]: SysCatalogTable state changed. Reason: New leader d8fd83a2f96b40aeb38da50e3451eece. Latest consensus state: current_term: 1 leader_uuid: "d8fd83a2f96b40aeb38da50e3451eece" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8fd83a2f96b40aeb38da50e3451eece" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35131 } } }
I20260806 01:07:29.973737 735 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8fd83a2f96b40aeb38da50e3451eece [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:29.973958 737 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8fd83a2f96b40aeb38da50e3451eece [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d8fd83a2f96b40aeb38da50e3451eece" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8fd83a2f96b40aeb38da50e3451eece" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35131 } } }
I20260806 01:07:29.974042 737 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8fd83a2f96b40aeb38da50e3451eece [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:29.974182 741 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:07:29.974952 734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:29.968072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.162:33847 (local address 127.0.0.1:35131)
0806 01:07:29.968358 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:29.968366 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:29.968392 (+ 26us) server_negotiation.cc:407] Connection header received
0806 01:07:29.969486 (+ 1094us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:29.969494 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:29.969553 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:29.969676 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:29.969964 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:29.970954 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:29.972150 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:29.972737 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:29.972878 (+ 141us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:29.973872 (+ 994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:29.973876 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:29.973877 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:29.974136 (+ 259us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:29.974191 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:29.974209 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:29.974303 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:29.974665 (+ 362us) server_negotiation.cc:299] Negotiation successful
0806 01:07:29.974700 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":146,"threads_started":1}
I20260806 01:07:29.975406 741 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:07:29.976155 11617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 01:07:29.978255 741 catalog_manager.cc:1347] Generated new cluster ID: 7ad044908d104ab9bcfd2410211e49c7
I20260806 01:07:29.978320 741 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:07:29.983775 741 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:07:29.984549 741 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:07:29.986784 734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:29.978511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.162:48435 (local address 127.0.0.1:35131)
0806 01:07:29.978552 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:29.978554 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:29.983604 (+ 5050us) server_negotiation.cc:407] Connection header received
0806 01:07:29.983691 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:29.983692 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:29.983704 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:29.983783 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:29.983951 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:29.984459 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:29.985327 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:29.985566 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:29.985656 (+ 90us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:29.986469 (+ 813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:29.986471 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:29.986471 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:29.986476 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:29.986492 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:29.986497 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:29.986574 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:29.986647 (+ 73us) server_negotiation.cc:299] Negotiation successful
0806 01:07:29.986657 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":21}
I20260806 01:07:29.991050 741 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d8fd83a2f96b40aeb38da50e3451eece: Generated new TSK 0
I20260806 01:07:29.991298 741 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:07:29.995440 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 662
W20260806 01:07:30.001165 647 connection.cc:535] client connection to 127.0.0.1:35131 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35131): Connection reset by peer (error 104)
2026-08-06T01:07:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1437 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:07:30 dist-test-slave-69rg krb5kdc[762](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:07:30 dist-test-slave-69rg krb5kdc[762](info): set up 2 sockets
Aug 06 01:07:30 dist-test-slave-69rg krb5kdc[762](info): commencing operation
krb5kdc: starting...
W20260806 01:07:31.100307 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.084s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:07:31 dist-test-slave-69rg krb5kdc[762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978451, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:07:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:07:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 01:07:31.236796 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42615
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42615
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:31.341478 775 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:31.341719 775 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:31.341747 775 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:31.343050 775 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:31.343101 775 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:31.343115 775 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:31.343128 775 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:31.343142 775 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:31.344762 775 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42615
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.775
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:31.345079 775 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:31.345343 775 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:31.350576 781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:31.350564 780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:31.350575 783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:31.350766 775 server_base.cc:1034] running on GCE node
I20260806 01:07:31.351001 775 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:31.351315 775 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:31.352494 775 hybrid_clock.cc:648] HybridClock initialized: now 1785978451352482 us; error 33 us; skew 500 ppm
Aug 06 01:07:31 dist-test-slave-69rg krb5kdc[762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978451, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:31.355237 775 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 01:07:31.355768 775 webserver.cc:460] Webserver started at http://127.0.0.1:33771/ using document root <none> and password file <none>
I20260806 01:07:31.356009 775 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:31.356078 775 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:31.356243 775 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:31.357358 775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "9c22a5a27ffb490a85f4bccfb69e4703"
format_stamp: "Formatted at 2026-08-06 01:07:31 on dist-test-slave-69rg"
server_key: "3162bdf6e4df3c94aea379dd06d10b0a"
server_key_iv: "de54b638f0c076023a648387ee6998d8"
server_key_version: "encryptionkey@0"
I20260806 01:07:31.357755 775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "9c22a5a27ffb490a85f4bccfb69e4703"
format_stamp: "Formatted at 2026-08-06 01:07:31 on dist-test-slave-69rg"
server_key: "3162bdf6e4df3c94aea379dd06d10b0a"
server_key_iv: "de54b638f0c076023a648387ee6998d8"
server_key_version: "encryptionkey@0"
I20260806 01:07:31.359267 775 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:31.360102 790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:31.360332 775 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:31.360450 775 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "9c22a5a27ffb490a85f4bccfb69e4703"
format_stamp: "Formatted at 2026-08-06 01:07:31 on dist-test-slave-69rg"
server_key: "3162bdf6e4df3c94aea379dd06d10b0a"
server_key_iv: "de54b638f0c076023a648387ee6998d8"
server_key_version: "encryptionkey@0"
I20260806 01:07:31.360531 775 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:31.364147 775 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:31.366392 775 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:31.366552 775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:31.370929 775 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42615
I20260806 01:07:31.370982 842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42615 every 8 connection(s)
I20260806 01:07:31.371352 775 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:07:31.372259 843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:31.372864 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 775
I20260806 01:07:31.373011 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:07:31.373207 11617 external_mini_cluster.cc:1428] Setting key 1b4897dccef516be848953f72cfb2120
I20260806 01:07:31.375370 843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c22a5a27ffb490a85f4bccfb69e4703: Bootstrap starting.
I20260806 01:07:31.375777 846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:31.373807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.162:45163 (local address 127.0.0.1:42615)
0806 01:07:31.374003 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:31.374011 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:31.374037 (+ 26us) server_negotiation.cc:407] Connection header received
0806 01:07:31.374435 (+ 398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:31.374441 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:31.374472 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:31.374585 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:31.375286 (+ 701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:31.375289 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:31.375290 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:31.375294 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:31.375335 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:31.375345 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:31.375399 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:31.375525 (+ 126us) server_negotiation.cc:299] Negotiation successful
0806 01:07:31.375574 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":73,"threads_started":1}
I20260806 01:07:31.376103 843 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c22a5a27ffb490a85f4bccfb69e4703: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:31.376441 843 log.cc:824] T 00000000000000000000000000000000 P 9c22a5a27ffb490a85f4bccfb69e4703: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:31.376840 11617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 01:07:31.377264 843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c22a5a27ffb490a85f4bccfb69e4703: No bootstrap required, opened a new log
I20260806 01:07:31.379488 846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:31.378385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.162:54305 (local address 127.0.0.1:42615)
0806 01:07:31.378425 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:31.378426 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:31.378510 (+ 84us) server_negotiation.cc:407] Connection header received
0806 01:07:31.378553 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:31.378554 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:31.378559 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:31.378620 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:31.379238 (+ 618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:31.379240 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:31.379240 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:31.379246 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:31.379261 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:31.379267 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:31.379341 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:31.379390 (+ 49us) server_negotiation.cc:299] Negotiation successful
0806 01:07:31.379404 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 01:07:31.379997 843 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c22a5a27ffb490a85f4bccfb69e4703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c22a5a27ffb490a85f4bccfb69e4703" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42615 } }
I20260806 01:07:31.380133 843 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c22a5a27ffb490a85f4bccfb69e4703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:31.380156 843 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c22a5a27ffb490a85f4bccfb69e4703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c22a5a27ffb490a85f4bccfb69e4703, State: Initialized, Role: FOLLOWER
I20260806 01:07:31.380285 843 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c22a5a27ffb490a85f4bccfb69e4703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c22a5a27ffb490a85f4bccfb69e4703" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42615 } }
I20260806 01:07:31.380375 843 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9c22a5a27ffb490a85f4bccfb69e4703 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:07:31.380400 843 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c22a5a27ffb490a85f4bccfb69e4703 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:07:31.380455 843 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c22a5a27ffb490a85f4bccfb69e4703 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:31.381047 843 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c22a5a27ffb490a85f4bccfb69e4703 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c22a5a27ffb490a85f4bccfb69e4703" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42615 } }
I20260806 01:07:31.381136 843 leader_election.cc:302] T 00000000000000000000000000000000 P 9c22a5a27ffb490a85f4bccfb69e4703 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c22a5a27ffb490a85f4bccfb69e4703; no voters:
I20260806 01:07:31.381323 843 leader_election.cc:288] T 00000000000000000000000000000000 P 9c22a5a27ffb490a85f4bccfb69e4703 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:07:31.381513 853 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c22a5a27ffb490a85f4bccfb69e4703 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:31.381584 843 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c22a5a27ffb490a85f4bccfb69e4703 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:31.381701 853 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c22a5a27ffb490a85f4bccfb69e4703 [term 1 LEADER]: Becoming Leader. State: Replica: 9c22a5a27ffb490a85f4bccfb69e4703, State: Running, Role: LEADER
I20260806 01:07:31.381932 853 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c22a5a27ffb490a85f4bccfb69e4703 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c22a5a27ffb490a85f4bccfb69e4703" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42615 } }
I20260806 01:07:31.382344 854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c22a5a27ffb490a85f4bccfb69e4703 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c22a5a27ffb490a85f4bccfb69e4703" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c22a5a27ffb490a85f4bccfb69e4703" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42615 } } }
I20260806 01:07:31.382360 855 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c22a5a27ffb490a85f4bccfb69e4703 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c22a5a27ffb490a85f4bccfb69e4703. Latest consensus state: current_term: 1 leader_uuid: "9c22a5a27ffb490a85f4bccfb69e4703" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c22a5a27ffb490a85f4bccfb69e4703" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42615 } } }
I20260806 01:07:31.382436 854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c22a5a27ffb490a85f4bccfb69e4703 [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:31.382470 855 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c22a5a27ffb490a85f4bccfb69e4703 [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:31.382715 862 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:07:31.383437 862 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:07:31.384948 862 catalog_manager.cc:1347] Generated new cluster ID: 532543163a74402e918e42c9e484de7f
I20260806 01:07:31.385006 862 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:07:31.408910 862 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:07:31.409127 862 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:07:31.412228 862 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9c22a5a27ffb490a85f4bccfb69e4703: Generated new TSK 0
I20260806 01:07:31.412410 862 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:07:31.420346 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 775
2026-08-06T01:07:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1424 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:07:31 dist-test-slave-69rg krb5kdc[874](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:07:31 dist-test-slave-69rg krb5kdc[874](info): set up 2 sockets
Aug 06 01:07:31 dist-test-slave-69rg krb5kdc[874](info): commencing operation
krb5kdc: starting...
W20260806 01:07:32.490805 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.051s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:07:32 dist-test-slave-69rg krb5kdc[874](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978452, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:07:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:07:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 01:07:32.637549 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37805
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37805
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:32.722693 887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:32.722914 887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:32.722939 887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:32.724156 887 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:32.724201 887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:32.724216 887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:32.724229 887 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:32.724241 887 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:32.725762 887 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37805
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37805
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.887
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:32.726047 887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:32.726289 887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:32.731380 892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:32.731527 893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:32.731424 895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:32.731554 887 server_base.cc:1034] running on GCE node
I20260806 01:07:32.731827 887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:32.732144 887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:32.733351 887 hybrid_clock.cc:648] HybridClock initialized: now 1785978452733332 us; error 39 us; skew 500 ppm
Aug 06 01:07:32 dist-test-slave-69rg krb5kdc[874](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978452, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:32.736055 887 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 01:07:32.736558 887 webserver.cc:460] Webserver started at http://127.0.0.1:44131/ using document root <none> and password file <none>
I20260806 01:07:32.736788 887 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:32.736835 887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:32.736980 887 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:32.738193 887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "9a4d9c5a326f442da220e0e4a58803b2"
format_stamp: "Formatted at 2026-08-06 01:07:32 on dist-test-slave-69rg"
server_key: "3d1aeb5263cf1fee8b8b48e12e66d45c"
server_key_iv: "a980f395954ef4e9c46e7c87df174fb6"
server_key_version: "encryptionkey@0"
I20260806 01:07:32.738566 887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "9a4d9c5a326f442da220e0e4a58803b2"
format_stamp: "Formatted at 2026-08-06 01:07:32 on dist-test-slave-69rg"
server_key: "3d1aeb5263cf1fee8b8b48e12e66d45c"
server_key_iv: "a980f395954ef4e9c46e7c87df174fb6"
server_key_version: "encryptionkey@0"
I20260806 01:07:32.740110 887 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 01:07:32.741020 902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:32.741202 887 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:32.741307 887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "9a4d9c5a326f442da220e0e4a58803b2"
format_stamp: "Formatted at 2026-08-06 01:07:32 on dist-test-slave-69rg"
server_key: "3d1aeb5263cf1fee8b8b48e12e66d45c"
server_key_iv: "a980f395954ef4e9c46e7c87df174fb6"
server_key_version: "encryptionkey@0"
I20260806 01:07:32.741371 887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:32.755156 887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:32.757504 887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:32.757623 887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:32.761729 887 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37805
I20260806 01:07:32.761854 955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37805 every 8 connection(s)
I20260806 01:07:32.762198 887 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:07:32.763159 956 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:32.763386 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 887
I20260806 01:07:32.763517 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:07:32.763739 11617 external_mini_cluster.cc:1428] Setting key 1730c17849e535c4a1a162cb044cfe76
I20260806 01:07:32.766052 956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a4d9c5a326f442da220e0e4a58803b2: Bootstrap starting.
I20260806 01:07:32.766795 956 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9a4d9c5a326f442da220e0e4a58803b2: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:32.767158 956 log.cc:824] T 00000000000000000000000000000000 P 9a4d9c5a326f442da220e0e4a58803b2: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:32.767931 956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a4d9c5a326f442da220e0e4a58803b2: No bootstrap required, opened a new log
I20260806 01:07:32.770404 956 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9a4d9c5a326f442da220e0e4a58803b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a4d9c5a326f442da220e0e4a58803b2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37805 } }
I20260806 01:07:32.770609 956 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9a4d9c5a326f442da220e0e4a58803b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:32.770653 956 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9a4d9c5a326f442da220e0e4a58803b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a4d9c5a326f442da220e0e4a58803b2, State: Initialized, Role: FOLLOWER
I20260806 01:07:32.770833 956 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a4d9c5a326f442da220e0e4a58803b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a4d9c5a326f442da220e0e4a58803b2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37805 } }
I20260806 01:07:32.770900 956 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9a4d9c5a326f442da220e0e4a58803b2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:07:32.770977 956 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9a4d9c5a326f442da220e0e4a58803b2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:07:32.771056 956 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9a4d9c5a326f442da220e0e4a58803b2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:32.771961 956 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9a4d9c5a326f442da220e0e4a58803b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a4d9c5a326f442da220e0e4a58803b2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37805 } }
I20260806 01:07:32.772079 956 leader_election.cc:302] T 00000000000000000000000000000000 P 9a4d9c5a326f442da220e0e4a58803b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9a4d9c5a326f442da220e0e4a58803b2; no voters:
I20260806 01:07:32.772301 956 leader_election.cc:288] T 00000000000000000000000000000000 P 9a4d9c5a326f442da220e0e4a58803b2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:07:32.772334 961 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9a4d9c5a326f442da220e0e4a58803b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:32.772526 961 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9a4d9c5a326f442da220e0e4a58803b2 [term 1 LEADER]: Becoming Leader. State: Replica: 9a4d9c5a326f442da220e0e4a58803b2, State: Running, Role: LEADER
I20260806 01:07:32.772586 956 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9a4d9c5a326f442da220e0e4a58803b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:32.772686 961 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9a4d9c5a326f442da220e0e4a58803b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a4d9c5a326f442da220e0e4a58803b2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37805 } }
Aug 06 01:07:32 dist-test-slave-69rg krb5kdc[874](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978452, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 01:07:32.773118 962 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a4d9c5a326f442da220e0e4a58803b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9a4d9c5a326f442da220e0e4a58803b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a4d9c5a326f442da220e0e4a58803b2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37805 } } }
I20260806 01:07:32.773208 962 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a4d9c5a326f442da220e0e4a58803b2 [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:32.773449 963 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a4d9c5a326f442da220e0e4a58803b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a4d9c5a326f442da220e0e4a58803b2. Latest consensus state: current_term: 1 leader_uuid: "9a4d9c5a326f442da220e0e4a58803b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a4d9c5a326f442da220e0e4a58803b2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37805 } } }
I20260806 01:07:32.773777 968 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:07:32.773854 963 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a4d9c5a326f442da220e0e4a58803b2 [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:32.774448 968 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:07:32.776064 968 catalog_manager.cc:1347] Generated new cluster ID: cf8d1aed10f84d7b962bcd1f0afec2da
I20260806 01:07:32.776125 968 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:07:32.777485 959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:32.764313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.162:52665 (local address 127.0.0.1:37805)
0806 01:07:32.764506 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:32.764515 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:32.766060 (+ 1545us) server_negotiation.cc:407] Connection header received
0806 01:07:32.766692 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:32.766701 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:32.766770 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:32.766934 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:32.767647 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:32.768625 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:32.769781 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:32.770293 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:32.770385 (+ 92us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:32.773598 (+ 3213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:32.773602 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:32.773603 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:32.773616 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:32.775915 (+ 2299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:32.776438 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:32.776441 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:32.776441 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:32.776527 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:32.776756 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:32.776757 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:32.776757 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:32.776974 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:32.777087 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:32.777249 (+ 162us) server_negotiation.cc:299] Negotiation successful
0806 01:07:32.777335 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":80,"threads_started":1}
I20260806 01:07:32.778584 11617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 01:07:32.787004 959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:32.779876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.162:54489 (local address 127.0.0.1:37805)
0806 01:07:32.779915 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:32.779917 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:32.779999 (+ 82us) server_negotiation.cc:407] Connection header received
0806 01:07:32.780066 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:32.780067 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:32.780075 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:32.780118 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:32.780732 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:32.781235 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:32.782258 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:32.782580 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:32.782617 (+ 37us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:32.784079 (+ 1462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:32.784080 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:32.784081 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:32.784088 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:32.785639 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:32.786122 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:32.786123 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:32.786124 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:32.786181 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:32.786409 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:32.786410 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:32.786410 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:32.786553 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:32.786626 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:32.786838 (+ 212us) server_negotiation.cc:299] Negotiation successful
0806 01:07:32.786905 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260806 01:07:32.802791 968 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:07:32.803588 968 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:07:32.807651 968 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9a4d9c5a326f442da220e0e4a58803b2: Generated new TSK 0
I20260806 01:07:32.807844 968 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:07:32.812041 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 887
W20260806 01:07:32.817806 872 connection.cc:535] client connection to 127.0.0.1:37805 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37805): Connection reset by peer (error 104)
2026-08-06T01:07:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1391 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:07:32 dist-test-slave-69rg krb5kdc[987](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:07:32 dist-test-slave-69rg krb5kdc[987](info): set up 2 sockets
Aug 06 01:07:32 dist-test-slave-69rg krb5kdc[987](info): commencing operation
krb5kdc: starting...
W20260806 01:07:33.863014 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.031s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:07:33 dist-test-slave-69rg krb5kdc[987](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978453, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:07:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:07:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 01:07:33.996457 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40863
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40863
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:34.085177 1000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:34.085466 1000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:34.085510 1000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:34.086843 1000 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:34.086925 1000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:34.086951 1000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:34.086973 1000 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:34.086999 1000 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:34.088639 1000 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40863
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40863
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1000
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:34.088961 1000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:34.089224 1000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:34.094336 1006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:34.094331 1005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:34.094408 1000 server_base.cc:1034] running on GCE node
W20260806 01:07:34.094331 1008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:34.094832 1000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:34.095155 1000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:34.096324 1000 hybrid_clock.cc:648] HybridClock initialized: now 1785978454096310 us; error 30 us; skew 500 ppm
Aug 06 01:07:34 dist-test-slave-69rg krb5kdc[987](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978454, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:34.099061 1000 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 01:07:34.099500 1000 webserver.cc:460] Webserver started at http://127.0.0.1:41793/ using document root <none> and password file <none>
I20260806 01:07:34.099743 1000 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:34.099867 1000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:34.099983 1000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:34.101053 1000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "5ff1f362b3a543d58ecd29ff9a6f3d53"
format_stamp: "Formatted at 2026-08-06 01:07:34 on dist-test-slave-69rg"
server_key: "75fd513c2df330392fbebd02c6755d0f"
server_key_iv: "19a51284b0ab21c7c751f2ec533dd690"
server_key_version: "encryptionkey@0"
I20260806 01:07:34.101397 1000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "5ff1f362b3a543d58ecd29ff9a6f3d53"
format_stamp: "Formatted at 2026-08-06 01:07:34 on dist-test-slave-69rg"
server_key: "75fd513c2df330392fbebd02c6755d0f"
server_key_iv: "19a51284b0ab21c7c751f2ec533dd690"
server_key_version: "encryptionkey@0"
I20260806 01:07:34.102906 1000 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 01:07:34.103688 1015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:34.103869 1000 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:07:34.103981 1000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "5ff1f362b3a543d58ecd29ff9a6f3d53"
format_stamp: "Formatted at 2026-08-06 01:07:34 on dist-test-slave-69rg"
server_key: "75fd513c2df330392fbebd02c6755d0f"
server_key_iv: "19a51284b0ab21c7c751f2ec533dd690"
server_key_version: "encryptionkey@0"
I20260806 01:07:34.104061 1000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:34.114156 1000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:34.116514 1000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:34.116686 1000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:34.120896 1000 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40863
I20260806 01:07:34.120959 1067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40863 every 8 connection(s)
I20260806 01:07:34.121363 1000 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:07:34.122285 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 1000
I20260806 01:07:34.122375 1068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:34.122453 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:07:34.122690 11617 external_mini_cluster.cc:1428] Setting key 5fd77b1607d91a1305949728ec5f7725
I20260806 01:07:34.125607 1068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ff1f362b3a543d58ecd29ff9a6f3d53: Bootstrap starting.
I20260806 01:07:34.126367 1068 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ff1f362b3a543d58ecd29ff9a6f3d53: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:34.126682 1068 log.cc:824] T 00000000000000000000000000000000 P 5ff1f362b3a543d58ecd29ff9a6f3d53: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:34.127460 1068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ff1f362b3a543d58ecd29ff9a6f3d53: No bootstrap required, opened a new log
I20260806 01:07:34.128476 1071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:34.123250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.162:58937 (local address 127.0.0.1:40863)
0806 01:07:34.123445 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:34.123452 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:34.123478 (+ 26us) server_negotiation.cc:407] Connection header received
0806 01:07:34.123931 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:34.123937 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:34.123984 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:34.124100 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:34.124370 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:34.125262 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:34.126391 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:34.126900 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:34.127036 (+ 136us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:34.127823 (+ 787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:34.127828 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:34.127828 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:34.127996 (+ 168us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:34.128039 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:34.128050 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:34.128182 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:34.128263 (+ 81us) server_negotiation.cc:299] Negotiation successful
0806 01:07:34.128299 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":97,"threads_started":1}
I20260806 01:07:34.129616 11617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 01:07:34.129951 1068 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ff1f362b3a543d58ecd29ff9a6f3d53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ff1f362b3a543d58ecd29ff9a6f3d53" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40863 } }
I20260806 01:07:34.130106 1068 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5ff1f362b3a543d58ecd29ff9a6f3d53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:34.130156 1068 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ff1f362b3a543d58ecd29ff9a6f3d53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ff1f362b3a543d58ecd29ff9a6f3d53, State: Initialized, Role: FOLLOWER
I20260806 01:07:34.130290 1068 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ff1f362b3a543d58ecd29ff9a6f3d53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ff1f362b3a543d58ecd29ff9a6f3d53" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40863 } }
I20260806 01:07:34.130370 1068 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5ff1f362b3a543d58ecd29ff9a6f3d53 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:07:34.130393 1068 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ff1f362b3a543d58ecd29ff9a6f3d53 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:07:34.130462 1068 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ff1f362b3a543d58ecd29ff9a6f3d53 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:34.131189 1068 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ff1f362b3a543d58ecd29ff9a6f3d53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ff1f362b3a543d58ecd29ff9a6f3d53" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40863 } }
I20260806 01:07:34.131309 1068 leader_election.cc:302] T 00000000000000000000000000000000 P 5ff1f362b3a543d58ecd29ff9a6f3d53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5ff1f362b3a543d58ecd29ff9a6f3d53; no voters:
I20260806 01:07:34.131480 1068 leader_election.cc:288] T 00000000000000000000000000000000 P 5ff1f362b3a543d58ecd29ff9a6f3d53 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:07:34.131512 1078 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ff1f362b3a543d58ecd29ff9a6f3d53 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:34.131690 1078 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5ff1f362b3a543d58ecd29ff9a6f3d53 [term 1 LEADER]: Becoming Leader. State: Replica: 5ff1f362b3a543d58ecd29ff9a6f3d53, State: Running, Role: LEADER
I20260806 01:07:34.131794 1068 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ff1f362b3a543d58ecd29ff9a6f3d53 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:34.131841 1078 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ff1f362b3a543d58ecd29ff9a6f3d53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ff1f362b3a543d58ecd29ff9a6f3d53" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40863 } }
I20260806 01:07:34.132192 1078 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ff1f362b3a543d58ecd29ff9a6f3d53 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ff1f362b3a543d58ecd29ff9a6f3d53. Latest consensus state: current_term: 1 leader_uuid: "5ff1f362b3a543d58ecd29ff9a6f3d53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ff1f362b3a543d58ecd29ff9a6f3d53" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40863 } } }
I20260806 01:07:34.132201 1080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ff1f362b3a543d58ecd29ff9a6f3d53 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5ff1f362b3a543d58ecd29ff9a6f3d53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ff1f362b3a543d58ecd29ff9a6f3d53" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40863 } } }
I20260806 01:07:34.132431 1078 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ff1f362b3a543d58ecd29ff9a6f3d53 [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:34.132470 1080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ff1f362b3a543d58ecd29ff9a6f3d53 [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:34.132647 1086 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:07:34.133186 1086 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:07:34.135167 1071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:34.131200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.162:59173 (local address 127.0.0.1:40863)
0806 01:07:34.131243 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:34.131245 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:34.131360 (+ 115us) server_negotiation.cc:407] Connection header received
0806 01:07:34.131430 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:34.131431 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:34.131441 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:34.131486 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:34.131645 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:34.132462 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:34.133544 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:34.133765 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:34.134009 (+ 244us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:34.134620 (+ 611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:34.134621 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:34.134622 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:34.134626 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:34.134642 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:34.134646 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:34.134694 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:34.135057 (+ 363us) server_negotiation.cc:299] Negotiation successful
0806 01:07:34.135068 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 01:07:34.135193 1095 mvcc.cc:205] Tried to move back new op lower bound from 7315367748134977536 to 7315367748124438528. Current Snapshot: MvccSnapshot[applied={T|T < 7315367748134977536}]
I20260806 01:07:34.135627 1086 catalog_manager.cc:1347] Generated new cluster ID: 855ab61a74594a7182453849339ea571
I20260806 01:07:34.135679 1086 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:07:34.145891 1086 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:07:34.146494 1086 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:07:34.157754 1086 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5ff1f362b3a543d58ecd29ff9a6f3d53: Generated new TSK 0
I20260806 01:07:34.158082 1086 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:07:34.162734 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 1000
W20260806 01:07:34.168788 985 connection.cc:535] client connection to 127.0.0.1:40863 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40863): Connection reset by peer (error 104)
2026-08-06T01:07:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1350 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:07:34 dist-test-slave-69rg krb5kdc[1099](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:07:34 dist-test-slave-69rg krb5kdc[1099](info): set up 2 sockets
Aug 06 01:07:34 dist-test-slave-69rg krb5kdc[1099](info): commencing operation
krb5kdc: starting...
W20260806 01:07:35.231360 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.048s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:07:35 dist-test-slave-69rg krb5kdc[1099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:07:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:07:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 01:07:35.365340 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38941
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38941
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:35.448417 1112 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:35.448634 1112 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:35.448658 1112 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:35.449752 1112 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:35.449787 1112 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:35.449801 1112 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:35.449873 1112 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:35.449908 1112 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:35.451375 1112 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38941
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785978186227899-11617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38941
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1112
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:35.451575 1112 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:35.451745 1112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:35.456633 1118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:35.456636 1117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:35.456694 1112 server_base.cc:1034] running on GCE node
W20260806 01:07:35.456633 1120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:35.457176 1112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:35.457489 1112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:35.458636 1112 hybrid_clock.cc:648] HybridClock initialized: now 1785978455458622 us; error 25 us; skew 500 ppm
Aug 06 01:07:35 dist-test-slave-69rg krb5kdc[1099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978455, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:35.461217 1112 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 01:07:35.461757 1112 webserver.cc:460] Webserver started at http://127.0.0.1:46521/ using document root <none> and password file <none>
I20260806 01:07:35.462059 1112 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:35.462107 1112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:35.462242 1112 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:35.463428 1112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "b3114b85ad35432597aaae83dbd0c446"
format_stamp: "Formatted at 2026-08-06 01:07:35 on dist-test-slave-69rg"
server_key: "b83605161a47bbb626a5a9e8bde89021"
server_key_iv: "21a2a6204242dc1cf9ac7d3041948974"
server_key_version: "encryptionkey@0"
I20260806 01:07:35.463796 1112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "b3114b85ad35432597aaae83dbd0c446"
format_stamp: "Formatted at 2026-08-06 01:07:35 on dist-test-slave-69rg"
server_key: "b83605161a47bbb626a5a9e8bde89021"
server_key_iv: "21a2a6204242dc1cf9ac7d3041948974"
server_key_version: "encryptionkey@0"
I20260806 01:07:35.465169 1112 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:07:35.465982 1127 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:35.466146 1112 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:35.466269 1112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "b3114b85ad35432597aaae83dbd0c446"
format_stamp: "Formatted at 2026-08-06 01:07:35 on dist-test-slave-69rg"
server_key: "b83605161a47bbb626a5a9e8bde89021"
server_key_iv: "21a2a6204242dc1cf9ac7d3041948974"
server_key_version: "encryptionkey@0"
I20260806 01:07:35.466329 1112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:35.469662 1112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:35.471740 1112 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:35.471850 1112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:35.475800 1112 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38941
I20260806 01:07:35.475870 1179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38941 every 8 connection(s)
I20260806 01:07:35.476200 1112 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:07:35.477090 1180 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:35.479465 1180 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3114b85ad35432597aaae83dbd0c446: Bootstrap starting.
I20260806 01:07:35.480047 1180 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3114b85ad35432597aaae83dbd0c446: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:35.480360 1180 log.cc:824] T 00000000000000000000000000000000 P b3114b85ad35432597aaae83dbd0c446: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:35.480844 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 1112
I20260806 01:07:35.480991 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:07:35.481200 11617 external_mini_cluster.cc:1428] Setting key 921c2f3c306d919c0c8f83c297c2ba0b
I20260806 01:07:35.481297 1180 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3114b85ad35432597aaae83dbd0c446: No bootstrap required, opened a new log
I20260806 01:07:35.483211 1180 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3114b85ad35432597aaae83dbd0c446 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3114b85ad35432597aaae83dbd0c446" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38941 } }
I20260806 01:07:35.483379 1180 raft_consensus.cc:374] T 00000000000000000000000000000000 P b3114b85ad35432597aaae83dbd0c446 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:35.483421 1180 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3114b85ad35432597aaae83dbd0c446 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3114b85ad35432597aaae83dbd0c446, State: Initialized, Role: FOLLOWER
I20260806 01:07:35.483613 1180 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3114b85ad35432597aaae83dbd0c446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3114b85ad35432597aaae83dbd0c446" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38941 } }
I20260806 01:07:35.484086 1180 raft_consensus.cc:388] T 00000000000000000000000000000000 P b3114b85ad35432597aaae83dbd0c446 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:07:35.484128 1180 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3114b85ad35432597aaae83dbd0c446 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:07:35.484180 1180 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3114b85ad35432597aaae83dbd0c446 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:35.484628 1184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:35.481757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.162:41345 (local address 127.0.0.1:38941)
0806 01:07:35.482000 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:35.482007 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:35.482030 (+ 23us) server_negotiation.cc:407] Connection header received
0806 01:07:35.483211 (+ 1181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:35.483219 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:35.483256 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:35.483403 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:35.484139 (+ 736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:35.484142 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:35.484143 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:35.484154 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:35.484205 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:35.484219 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:35.484299 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:35.484427 (+ 128us) server_negotiation.cc:299] Negotiation successful
0806 01:07:35.484480 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":114,"threads_started":1}
I20260806 01:07:35.485445 1180 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3114b85ad35432597aaae83dbd0c446 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3114b85ad35432597aaae83dbd0c446" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38941 } }
I20260806 01:07:35.485561 1180 leader_election.cc:302] T 00000000000000000000000000000000 P b3114b85ad35432597aaae83dbd0c446 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3114b85ad35432597aaae83dbd0c446; no voters:
I20260806 01:07:35.485621 11617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 01:07:35.485723 1180 leader_election.cc:288] T 00000000000000000000000000000000 P b3114b85ad35432597aaae83dbd0c446 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:07:35.485754 1185 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3114b85ad35432597aaae83dbd0c446 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:35.485885 1185 raft_consensus.cc:686] T 00000000000000000000000000000000 P b3114b85ad35432597aaae83dbd0c446 [term 1 LEADER]: Becoming Leader. State: Replica: b3114b85ad35432597aaae83dbd0c446, State: Running, Role: LEADER
I20260806 01:07:35.485967 1185 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3114b85ad35432597aaae83dbd0c446 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3114b85ad35432597aaae83dbd0c446" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38941 } }
I20260806 01:07:35.485997 1180 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3114b85ad35432597aaae83dbd0c446 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:35.487767 1185 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3114b85ad35432597aaae83dbd0c446 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3114b85ad35432597aaae83dbd0c446. Latest consensus state: current_term: 1 leader_uuid: "b3114b85ad35432597aaae83dbd0c446" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3114b85ad35432597aaae83dbd0c446" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38941 } } }
I20260806 01:07:35.487919 1185 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3114b85ad35432597aaae83dbd0c446 [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:35.487947 1186 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3114b85ad35432597aaae83dbd0c446 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3114b85ad35432597aaae83dbd0c446" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3114b85ad35432597aaae83dbd0c446" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38941 } } }
I20260806 01:07:35.488016 1186 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3114b85ad35432597aaae83dbd0c446 [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:35.488186 1206 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:07:35.488647 1184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:35.487135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.162:47033 (local address 127.0.0.1:38941)
0806 01:07:35.487169 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:35.487170 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:35.487320 (+ 150us) server_negotiation.cc:407] Connection header received
0806 01:07:35.487392 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:35.487393 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:35.487397 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:35.487446 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:35.488430 (+ 984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:35.488431 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:35.488431 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:35.488437 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:35.488452 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:35.488457 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:35.488488 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:35.488592 (+ 104us) server_negotiation.cc:299] Negotiation successful
0806 01:07:35.488605 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260806 01:07:35.488806 1206 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:07:35.490319 1206 catalog_manager.cc:1347] Generated new cluster ID: e6641624439849c98a0dde756d5b4159
I20260806 01:07:35.490372 1206 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:07:35.495447 1206 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:07:35.495646 1206 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:07:35.507128 1206 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b3114b85ad35432597aaae83dbd0c446: Generated new TSK 0
I20260806 01:07:35.507390 1206 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:07:35.509707 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 1112
2026-08-06T01:07:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1346 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:07:35 dist-test-slave-69rg krb5kdc[1213](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:07:35 dist-test-slave-69rg krb5kdc[1213](info): set up 2 sockets
Aug 06 01:07:35 dist-test-slave-69rg krb5kdc[1213](info): commencing operation
krb5kdc: starting...
W20260806 01:07:36.578920 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.049s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:07:36 dist-test-slave-69rg krb5kdc[1213](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:07:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:07:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:07:36.713328 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:38701
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:37251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:38701
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:36.806488 1226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:36.806763 1226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:36.806809 1226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:36.808449 1226 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:36.808555 1226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:36.808583 1226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:36.808617 1226 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:36.808650 1226 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:36.810418 1226 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:37251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:38701
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:38701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1226
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:36.810746 1226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:36.811009 1226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:36.816562 1234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:36.816540 1232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:36.816532 1231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:36.817013 1226 server_base.cc:1034] running on GCE node
I20260806 01:07:36.817315 1226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:36.817679 1226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:36.818917 1226 hybrid_clock.cc:648] HybridClock initialized: now 1785978456818890 us; error 45 us; skew 500 ppm
Aug 06 01:07:36 dist-test-slave-69rg krb5kdc[1213](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978456, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:36.827113 1226 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:07:36.827666 1226 webserver.cc:460] Webserver started at http://127.11.88.126:44027/ using document root <none> and password file <none>
I20260806 01:07:36.827939 1226 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:36.828015 1226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:36.828188 1226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:36.829339 1226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "dac54ed52bdb45dd870a15602a3f33ad"
format_stamp: "Formatted at 2026-08-06 01:07:36 on dist-test-slave-69rg"
server_key: "46c3a1acc62ff2ff22d93512985500cf"
server_key_iv: "d3fa67f8cebe7c29d5c71a36839ee14d"
server_key_version: "encryptionkey@0"
I20260806 01:07:36.829741 1226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "dac54ed52bdb45dd870a15602a3f33ad"
format_stamp: "Formatted at 2026-08-06 01:07:36 on dist-test-slave-69rg"
server_key: "46c3a1acc62ff2ff22d93512985500cf"
server_key_iv: "d3fa67f8cebe7c29d5c71a36839ee14d"
server_key_version: "encryptionkey@0"
I20260806 01:07:36.831264 1226 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:07:36.832175 1241 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:36.832432 1226 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:36.832553 1226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "dac54ed52bdb45dd870a15602a3f33ad"
format_stamp: "Formatted at 2026-08-06 01:07:36 on dist-test-slave-69rg"
server_key: "46c3a1acc62ff2ff22d93512985500cf"
server_key_iv: "d3fa67f8cebe7c29d5c71a36839ee14d"
server_key_version: "encryptionkey@0"
I20260806 01:07:36.832634 1226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:36.844179 1226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:36.846719 1226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:36.846920 1226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:36.851555 1226 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:38701
I20260806 01:07:36.851591 1295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:38701 every 8 connection(s)
I20260806 01:07:36.851979 1226 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:07:36.852919 1296 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:36.855465 1296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dac54ed52bdb45dd870a15602a3f33ad: Bootstrap starting.
I20260806 01:07:36.856105 1296 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dac54ed52bdb45dd870a15602a3f33ad: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:36.856431 1296 log.cc:824] T 00000000000000000000000000000000 P dac54ed52bdb45dd870a15602a3f33ad: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:36.857227 1296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dac54ed52bdb45dd870a15602a3f33ad: No bootstrap required, opened a new log
I20260806 01:07:36.859040 1296 raft_consensus.cc:348] T 00000000000000000000000000000000 P dac54ed52bdb45dd870a15602a3f33ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dac54ed52bdb45dd870a15602a3f33ad" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 38701 } }
I20260806 01:07:36.859194 1296 raft_consensus.cc:374] T 00000000000000000000000000000000 P dac54ed52bdb45dd870a15602a3f33ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:36.859217 1296 raft_consensus.cc:729] T 00000000000000000000000000000000 P dac54ed52bdb45dd870a15602a3f33ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dac54ed52bdb45dd870a15602a3f33ad, State: Initialized, Role: FOLLOWER
I20260806 01:07:36.859381 1296 consensus_queue.cc:260] T 00000000000000000000000000000000 P dac54ed52bdb45dd870a15602a3f33ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dac54ed52bdb45dd870a15602a3f33ad" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 38701 } }
I20260806 01:07:36.859457 1296 raft_consensus.cc:388] T 00000000000000000000000000000000 P dac54ed52bdb45dd870a15602a3f33ad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:07:36.859500 1296 raft_consensus.cc:482] T 00000000000000000000000000000000 P dac54ed52bdb45dd870a15602a3f33ad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:07:36.859553 1296 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dac54ed52bdb45dd870a15602a3f33ad [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:36.859925 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 1226
I20260806 01:07:36.860051 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:07:36.860283 11617 external_mini_cluster.cc:1428] Setting key 6ce98b86ec05d8d508f31f38b27f2ae5
I20260806 01:07:36.860929 1296 raft_consensus.cc:504] T 00000000000000000000000000000000 P dac54ed52bdb45dd870a15602a3f33ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dac54ed52bdb45dd870a15602a3f33ad" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 38701 } }
I20260806 01:07:36.861127 1296 leader_election.cc:302] T 00000000000000000000000000000000 P dac54ed52bdb45dd870a15602a3f33ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dac54ed52bdb45dd870a15602a3f33ad; no voters:
I20260806 01:07:36.861325 1296 leader_election.cc:288] T 00000000000000000000000000000000 P dac54ed52bdb45dd870a15602a3f33ad [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:07:36.861374 1302 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dac54ed52bdb45dd870a15602a3f33ad [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:36.861546 1302 raft_consensus.cc:686] T 00000000000000000000000000000000 P dac54ed52bdb45dd870a15602a3f33ad [term 1 LEADER]: Becoming Leader. State: Replica: dac54ed52bdb45dd870a15602a3f33ad, State: Running, Role: LEADER
I20260806 01:07:36.861629 1296 sys_catalog.cc:564] T 00000000000000000000000000000000 P dac54ed52bdb45dd870a15602a3f33ad [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:36.861711 1302 consensus_queue.cc:237] T 00000000000000000000000000000000 P dac54ed52bdb45dd870a15602a3f33ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dac54ed52bdb45dd870a15602a3f33ad" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 38701 } }
I20260806 01:07:36.862190 1302 sys_catalog.cc:455] T 00000000000000000000000000000000 P dac54ed52bdb45dd870a15602a3f33ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader dac54ed52bdb45dd870a15602a3f33ad. Latest consensus state: current_term: 1 leader_uuid: "dac54ed52bdb45dd870a15602a3f33ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dac54ed52bdb45dd870a15602a3f33ad" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 38701 } } }
I20260806 01:07:36.862200 1303 sys_catalog.cc:455] T 00000000000000000000000000000000 P dac54ed52bdb45dd870a15602a3f33ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dac54ed52bdb45dd870a15602a3f33ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dac54ed52bdb45dd870a15602a3f33ad" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 38701 } } }
I20260806 01:07:36.862357 1302 sys_catalog.cc:458] T 00000000000000000000000000000000 P dac54ed52bdb45dd870a15602a3f33ad [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:36.862370 1303 sys_catalog.cc:458] T 00000000000000000000000000000000 P dac54ed52bdb45dd870a15602a3f33ad [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:36.862622 1311 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:07:36.863430 1311 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:07:36.866284 1311 catalog_manager.cc:1347] Generated new cluster ID: f48f323075bd4a9099353ee9828ae7be
I20260806 01:07:36.866353 1311 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 01:07:36 dist-test-slave-69rg krb5kdc[1213](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:07:36.872985 1301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:36.860870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47183 (local address 127.11.88.126:38701)
0806 01:07:36.861094 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:36.861106 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:36.861147 (+ 41us) server_negotiation.cc:407] Connection header received
0806 01:07:36.861338 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:36.861348 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:36.861428 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:36.861594 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:36.862525 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:36.864161 (+ 1636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:36.865240 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:36.865968 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:36.866083 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:36.868884 (+ 2801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:36.868888 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:36.868889 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:36.868903 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:36.871012 (+ 2109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:36.871557 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:36.871561 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:36.871561 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:36.871689 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:36.871961 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:36.871962 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:36.871963 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:36.872305 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:36.872484 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:36.872641 (+ 157us) server_negotiation.cc:299] Negotiation successful
0806 01:07:36.872754 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":109,"threads_started":1}
I20260806 01:07:36.874408 11617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 01:07:36.874444 1311 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:07:36.875123 1311 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:07:36.881563 1311 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dac54ed52bdb45dd870a15602a3f33ad: Generated new TSK 0
I20260806 01:07:36.881798 1311 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:07:36.888494 1301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:36.878263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40149 (local address 127.11.88.126:38701)
0806 01:07:36.878304 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:36.878307 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:36.881202 (+ 2895us) server_negotiation.cc:407] Connection header received
0806 01:07:36.881318 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:36.881319 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:36.881332 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:36.881386 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:36.882159 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:36.882694 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:36.883816 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:36.884052 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:36.884126 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:36.885669 (+ 1543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:36.885670 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:36.885670 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:36.885678 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:36.887243 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:36.887691 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:36.887692 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:36.887692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:36.887761 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:36.887996 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:36.887996 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:36.887997 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:36.888099 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:36.888178 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:36.888368 (+ 190us) server_negotiation.cc:299] Negotiation successful
0806 01:07:36.888423 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 01:07:36.890784 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 1226
W20260806 01:07:36.896606 1211 connection.cc:535] client connection to 127.11.88.126:38701 recv error: Network error: failed to read from TLS socket (remote: 127.11.88.126:38701): Connection reset by peer (error 104)
2026-08-06T01:07:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1380 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:07:36 dist-test-slave-69rg krb5kdc[1328](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:07:36 dist-test-slave-69rg krb5kdc[1328](info): set up 2 sockets
Aug 06 01:07:36 dist-test-slave-69rg krb5kdc[1328](info): commencing operation
krb5kdc: starting...
W20260806 01:07:37.959350 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.049s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:07:38 dist-test-slave-69rg krb5kdc[1328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:07:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:07:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:07:38.101051 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:35573
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:32995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:35573
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:38.185166 1341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:38.185434 1341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:38.185475 1341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:38.186703 1341 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:38.186784 1341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:38.186812 1341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:38.186843 1341 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:38.186865 1341 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:38.188421 1341 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:32995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:35573
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:35573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1341
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:38.188720 1341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:38.188963 1341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:38.193928 1347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:38.193928 1349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:38.194173 1346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:38.194604 1341 server_base.cc:1034] running on GCE node
I20260806 01:07:38.194860 1341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:38.195139 1341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:38.196306 1341 hybrid_clock.cc:648] HybridClock initialized: now 1785978458196285 us; error 37 us; skew 500 ppm
Aug 06 01:07:38 dist-test-slave-69rg krb5kdc[1328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978458, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:38.198910 1341 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:07:38.199386 1341 webserver.cc:460] Webserver started at http://127.11.88.126:35449/ using document root <none> and password file <none>
I20260806 01:07:38.199591 1341 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:38.199633 1341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:38.199734 1341 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:38.200824 1341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "1a72cb621f4f4ec5b5cf58408ce9f54d"
format_stamp: "Formatted at 2026-08-06 01:07:38 on dist-test-slave-69rg"
server_key: "66afae5793f3a60cec1b4b4ccafa9363"
server_key_iv: "b8016d68208f4c124b37ec3644438af2"
server_key_version: "encryptionkey@0"
I20260806 01:07:38.201138 1341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "1a72cb621f4f4ec5b5cf58408ce9f54d"
format_stamp: "Formatted at 2026-08-06 01:07:38 on dist-test-slave-69rg"
server_key: "66afae5793f3a60cec1b4b4ccafa9363"
server_key_iv: "b8016d68208f4c124b37ec3644438af2"
server_key_version: "encryptionkey@0"
I20260806 01:07:38.202513 1341 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:07:38.203248 1357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:38.203429 1341 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 01:07:38.203519 1341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "1a72cb621f4f4ec5b5cf58408ce9f54d"
format_stamp: "Formatted at 2026-08-06 01:07:38 on dist-test-slave-69rg"
server_key: "66afae5793f3a60cec1b4b4ccafa9363"
server_key_iv: "b8016d68208f4c124b37ec3644438af2"
server_key_version: "encryptionkey@0"
I20260806 01:07:38.203579 1341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:38.216441 1341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:38.218842 1341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:38.218962 1341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:38.223093 1341 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:35573
I20260806 01:07:38.223165 1410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:35573 every 8 connection(s)
I20260806 01:07:38.223531 1341 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:07:38.224462 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:38.226835 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 1341
I20260806 01:07:38.226943 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:07:38.226959 1411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a72cb621f4f4ec5b5cf58408ce9f54d: Bootstrap starting.
I20260806 01:07:38.227154 11617 external_mini_cluster.cc:1428] Setting key 4c85847db9d98c26c6316166e0d0b949
I20260806 01:07:38.227758 1411 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1a72cb621f4f4ec5b5cf58408ce9f54d: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:38.228092 1411 log.cc:824] T 00000000000000000000000000000000 P 1a72cb621f4f4ec5b5cf58408ce9f54d: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:38.228834 1411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a72cb621f4f4ec5b5cf58408ce9f54d: No bootstrap required, opened a new log
I20260806 01:07:38.230799 1411 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1a72cb621f4f4ec5b5cf58408ce9f54d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a72cb621f4f4ec5b5cf58408ce9f54d" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 35573 } }
I20260806 01:07:38.230963 1411 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1a72cb621f4f4ec5b5cf58408ce9f54d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:38.231012 1411 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1a72cb621f4f4ec5b5cf58408ce9f54d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a72cb621f4f4ec5b5cf58408ce9f54d, State: Initialized, Role: FOLLOWER
I20260806 01:07:38.231158 1411 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a72cb621f4f4ec5b5cf58408ce9f54d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a72cb621f4f4ec5b5cf58408ce9f54d" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 35573 } }
I20260806 01:07:38.231240 1411 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1a72cb621f4f4ec5b5cf58408ce9f54d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:07:38.231285 1411 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1a72cb621f4f4ec5b5cf58408ce9f54d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:07:38.231335 1411 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1a72cb621f4f4ec5b5cf58408ce9f54d [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:38.231918 1411 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1a72cb621f4f4ec5b5cf58408ce9f54d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a72cb621f4f4ec5b5cf58408ce9f54d" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 35573 } }
I20260806 01:07:38.232034 1411 leader_election.cc:302] T 00000000000000000000000000000000 P 1a72cb621f4f4ec5b5cf58408ce9f54d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1a72cb621f4f4ec5b5cf58408ce9f54d; no voters:
I20260806 01:07:38.232246 1411 leader_election.cc:288] T 00000000000000000000000000000000 P 1a72cb621f4f4ec5b5cf58408ce9f54d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:07:38.232272 1416 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1a72cb621f4f4ec5b5cf58408ce9f54d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:38.232439 1416 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1a72cb621f4f4ec5b5cf58408ce9f54d [term 1 LEADER]: Becoming Leader. State: Replica: 1a72cb621f4f4ec5b5cf58408ce9f54d, State: Running, Role: LEADER
I20260806 01:07:38.232582 1411 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1a72cb621f4f4ec5b5cf58408ce9f54d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:38.232581 1416 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1a72cb621f4f4ec5b5cf58408ce9f54d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a72cb621f4f4ec5b5cf58408ce9f54d" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 35573 } }
I20260806 01:07:38.233071 1414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:38.227730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47865 (local address 127.11.88.126:35573)
0806 01:07:38.227941 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:38.227950 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:38.227984 (+ 34us) server_negotiation.cc:407] Connection header received
0806 01:07:38.228625 (+ 641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:38.228632 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:38.228684 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:38.228835 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:38.229059 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:38.230040 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:38.230842 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:38.231441 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:38.231567 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:38.232316 (+ 749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:38.232320 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:38.232320 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:38.232540 (+ 220us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:38.232581 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:38.232599 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:38.232836 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:38.232877 (+ 41us) server_negotiation.cc:299] Negotiation successful
0806 01:07:38.232904 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":81,"threads_started":1}
I20260806 01:07:38.233224 1417 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a72cb621f4f4ec5b5cf58408ce9f54d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1a72cb621f4f4ec5b5cf58408ce9f54d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a72cb621f4f4ec5b5cf58408ce9f54d" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 35573 } } }
I20260806 01:07:38.233345 1417 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a72cb621f4f4ec5b5cf58408ce9f54d [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:38.233785 1418 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a72cb621f4f4ec5b5cf58408ce9f54d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1a72cb621f4f4ec5b5cf58408ce9f54d. Latest consensus state: current_term: 1 leader_uuid: "1a72cb621f4f4ec5b5cf58408ce9f54d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a72cb621f4f4ec5b5cf58408ce9f54d" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 35573 } } }
I20260806 01:07:38.233999 1418 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a72cb621f4f4ec5b5cf58408ce9f54d [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:38.234400 11617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260806 01:07:38.234727 1432 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1a72cb621f4f4ec5b5cf58408ce9f54d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 01:07:38.234793 1432 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 01:07:38.235080 1431 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:07:38.235311 1431 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:07:38.237031 1431 catalog_manager.cc:1347] Generated new cluster ID: 02ad0afa6d4e4293a011b8849342e5d5
I20260806 01:07:38.237107 1431 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:07:38.240002 1414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:38.235975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53825 (local address 127.11.88.126:35573)
0806 01:07:38.236043 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:38.236046 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:38.236280 (+ 234us) server_negotiation.cc:407] Connection header received
0806 01:07:38.236338 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:38.236339 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:38.236350 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:38.236423 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:38.236597 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:38.237342 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:38.238503 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:38.238821 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:38.238867 (+ 46us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:38.239706 (+ 839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:38.239708 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:38.239708 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:38.239715 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:38.239730 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:38.239735 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:38.239769 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:38.239909 (+ 140us) server_negotiation.cc:299] Negotiation successful
0806 01:07:38.239924 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 01:07:38.242628 1431 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:07:38.243271 1431 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:07:38.246392 1431 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1a72cb621f4f4ec5b5cf58408ce9f54d: Generated new TSK 0
I20260806 01:07:38.246570 1431 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:07:38.252578 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 1341
W20260806 01:07:38.257961 1326 connection.cc:535] client connection to 127.11.88.126:35573 recv error: Network error: failed to read from TLS socket (remote: 127.11.88.126:35573): Connection reset by peer (error 104)
2026-08-06T01:07:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1361 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:07:38 dist-test-slave-69rg krb5kdc[1443](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:07:38 dist-test-slave-69rg krb5kdc[1443](info): set up 2 sockets
Aug 06 01:07:38 dist-test-slave-69rg krb5kdc[1443](info): commencing operation
krb5kdc: starting...
W20260806 01:07:39.327266 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.055s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:07:39 dist-test-slave-69rg krb5kdc[1443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978459, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:07:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:07:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:07:39.462321 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:34087
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:43519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:34087
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:39.545799 1456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:39.546039 1456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:39.546063 1456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:39.547274 1456 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:39.547322 1456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:39.547335 1456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:39.547348 1456 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:39.547360 1456 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:39.548856 1456 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:43519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:34087
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:34087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1456
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:39.549057 1456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:39.549239 1456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:39.554116 1464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:39.554137 1462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:39.554296 1461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:39.554459 1456 server_base.cc:1034] running on GCE node
I20260806 01:07:39.554715 1456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:39.555016 1456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:39.556196 1456 hybrid_clock.cc:648] HybridClock initialized: now 1785978459556178 us; error 40 us; skew 500 ppm
Aug 06 01:07:39 dist-test-slave-69rg krb5kdc[1443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978459, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:39.558929 1456 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:07:39.559396 1456 webserver.cc:460] Webserver started at http://127.11.88.126:44263/ using document root <none> and password file <none>
I20260806 01:07:39.559648 1456 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:39.559720 1456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:39.559861 1456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:39.560957 1456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "ca2522aaf7c144ab97dbf69e80a322a8"
format_stamp: "Formatted at 2026-08-06 01:07:39 on dist-test-slave-69rg"
server_key: "cc2bd9cdca81725dee4f63b256ac1d56"
server_key_iv: "eb4cc57264ff78bd5171b7c13513d2fe"
server_key_version: "encryptionkey@0"
I20260806 01:07:39.561321 1456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "ca2522aaf7c144ab97dbf69e80a322a8"
format_stamp: "Formatted at 2026-08-06 01:07:39 on dist-test-slave-69rg"
server_key: "cc2bd9cdca81725dee4f63b256ac1d56"
server_key_iv: "eb4cc57264ff78bd5171b7c13513d2fe"
server_key_version: "encryptionkey@0"
I20260806 01:07:39.562783 1456 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 01:07:39.563514 1471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:39.563697 1456 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 01:07:39.563802 1456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "ca2522aaf7c144ab97dbf69e80a322a8"
format_stamp: "Formatted at 2026-08-06 01:07:39 on dist-test-slave-69rg"
server_key: "cc2bd9cdca81725dee4f63b256ac1d56"
server_key_iv: "eb4cc57264ff78bd5171b7c13513d2fe"
server_key_version: "encryptionkey@0"
I20260806 01:07:39.563874 1456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:39.567298 1456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:39.569558 1456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:39.569731 1456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:39.573906 1456 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:34087
I20260806 01:07:39.573946 1524 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:34087 every 8 connection(s)
I20260806 01:07:39.574298 1456 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:07:39.575273 1525 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:39.577484 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 1456
I20260806 01:07:39.577643 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:07:39.577631 1525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca2522aaf7c144ab97dbf69e80a322a8: Bootstrap starting.
I20260806 01:07:39.577867 11617 external_mini_cluster.cc:1428] Setting key e601f3e7e0ab5877c46549987c86377c
I20260806 01:07:39.578439 1525 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca2522aaf7c144ab97dbf69e80a322a8: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:39.578742 1525 log.cc:824] T 00000000000000000000000000000000 P ca2522aaf7c144ab97dbf69e80a322a8: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:39.579448 1525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca2522aaf7c144ab97dbf69e80a322a8: No bootstrap required, opened a new log
I20260806 01:07:39.580494 1528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:39.578413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47119 (local address 127.11.88.126:34087)
0806 01:07:39.578635 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:39.578645 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:39.578679 (+ 34us) server_negotiation.cc:407] Connection header received
0806 01:07:39.579196 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:39.579203 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:39.579230 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:39.579377 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:39.580025 (+ 648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:39.580028 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:39.580029 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:39.580033 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:39.580119 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:39.580130 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:39.580226 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:39.580282 (+ 56us) server_negotiation.cc:299] Negotiation successful
0806 01:07:39.580332 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":84,"threads_started":1}
I20260806 01:07:39.581418 11617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 01:07:39.581902 1525 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca2522aaf7c144ab97dbf69e80a322a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca2522aaf7c144ab97dbf69e80a322a8" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 34087 } }
I20260806 01:07:39.582054 1525 raft_consensus.cc:374] T 00000000000000000000000000000000 P ca2522aaf7c144ab97dbf69e80a322a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:39.582099 1525 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca2522aaf7c144ab97dbf69e80a322a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca2522aaf7c144ab97dbf69e80a322a8, State: Initialized, Role: FOLLOWER
I20260806 01:07:39.582230 1525 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca2522aaf7c144ab97dbf69e80a322a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca2522aaf7c144ab97dbf69e80a322a8" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 34087 } }
I20260806 01:07:39.582332 1525 raft_consensus.cc:388] T 00000000000000000000000000000000 P ca2522aaf7c144ab97dbf69e80a322a8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:07:39.582377 1525 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca2522aaf7c144ab97dbf69e80a322a8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:07:39.582427 1525 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca2522aaf7c144ab97dbf69e80a322a8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:39.583249 1525 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca2522aaf7c144ab97dbf69e80a322a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca2522aaf7c144ab97dbf69e80a322a8" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 34087 } }
I20260806 01:07:39.583364 1525 leader_election.cc:302] T 00000000000000000000000000000000 P ca2522aaf7c144ab97dbf69e80a322a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ca2522aaf7c144ab97dbf69e80a322a8; no voters:
I20260806 01:07:39.583519 1525 leader_election.cc:288] T 00000000000000000000000000000000 P ca2522aaf7c144ab97dbf69e80a322a8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:07:39.583560 1535 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca2522aaf7c144ab97dbf69e80a322a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:39.583717 1535 raft_consensus.cc:686] T 00000000000000000000000000000000 P ca2522aaf7c144ab97dbf69e80a322a8 [term 1 LEADER]: Becoming Leader. State: Replica: ca2522aaf7c144ab97dbf69e80a322a8, State: Running, Role: LEADER
I20260806 01:07:39.583786 1525 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca2522aaf7c144ab97dbf69e80a322a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:39.583859 1535 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca2522aaf7c144ab97dbf69e80a322a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca2522aaf7c144ab97dbf69e80a322a8" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 34087 } }
I20260806 01:07:39.584199 1528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:39.583109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46075 (local address 127.11.88.126:34087)
0806 01:07:39.583167 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:39.583168 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:39.583178 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:07:39.583257 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:39.583258 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:39.583263 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:39.583318 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:39.583917 (+ 599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:39.583919 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:39.583919 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:39.583923 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:39.583937 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:39.583942 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:39.583986 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:39.584118 (+ 132us) server_negotiation.cc:299] Negotiation successful
0806 01:07:39.584132 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 01:07:39.584240 1536 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca2522aaf7c144ab97dbf69e80a322a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca2522aaf7c144ab97dbf69e80a322a8. Latest consensus state: current_term: 1 leader_uuid: "ca2522aaf7c144ab97dbf69e80a322a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca2522aaf7c144ab97dbf69e80a322a8" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 34087 } } }
I20260806 01:07:39.584318 1536 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca2522aaf7c144ab97dbf69e80a322a8 [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:39.584569 1537 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca2522aaf7c144ab97dbf69e80a322a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ca2522aaf7c144ab97dbf69e80a322a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca2522aaf7c144ab97dbf69e80a322a8" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 34087 } } }
I20260806 01:07:39.584619 1544 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:07:39.584712 1537 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca2522aaf7c144ab97dbf69e80a322a8 [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:39.585206 1544 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:07:39.586781 1544 catalog_manager.cc:1347] Generated new cluster ID: fc3332d67b2a45efbb789ec4f7c50b9b
I20260806 01:07:39.586838 1544 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:07:39.603034 1544 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:07:39.603242 1544 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:07:39.607527 1544 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ca2522aaf7c144ab97dbf69e80a322a8: Generated new TSK 0
I20260806 01:07:39.607731 1544 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:07:39.614094 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 1456
2026-08-06T01:07:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1361 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:07:39 dist-test-slave-69rg krb5kdc[1556](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:07:39 dist-test-slave-69rg krb5kdc[1556](info): set up 2 sockets
Aug 06 01:07:39 dist-test-slave-69rg krb5kdc[1556](info): commencing operation
krb5kdc: starting...
W20260806 01:07:40.695901 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.062s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:07:40 dist-test-slave-69rg krb5kdc[1556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:07:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:07:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:07:40.829071 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:41387
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:43999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:41387
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:40.912864 1570 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:40.913077 1570 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:40.913101 1570 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:40.914211 1570 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:40.914250 1570 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:40.914265 1570 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:40.914278 1570 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:40.914289 1570 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:40.915712 1570 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:43999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:41387
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:41387
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1570
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:40.915903 1570 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:40.916072 1570 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:40.920907 1575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:40.920948 1576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:40.921063 1570 server_base.cc:1034] running on GCE node
W20260806 01:07:40.920944 1578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:40.921501 1570 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:40.921761 1570 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:40.923171 1570 hybrid_clock.cc:648] HybridClock initialized: now 1785978460923126 us; error 61 us; skew 500 ppm
Aug 06 01:07:40 dist-test-slave-69rg krb5kdc[1556](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978460, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:40.925926 1570 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:07:40.926451 1570 webserver.cc:460] Webserver started at http://127.11.88.126:39167/ using document root <none> and password file <none>
I20260806 01:07:40.926707 1570 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:40.926755 1570 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:40.926894 1570 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:40.927964 1570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "dbcbf6dec3d2418e91855218e1a3d794"
format_stamp: "Formatted at 2026-08-06 01:07:40 on dist-test-slave-69rg"
server_key: "ef1b83b12d699d658e7a20d2573b6f61"
server_key_iv: "de8e5677472ce9982dcea0d001630aa0"
server_key_version: "encryptionkey@0"
I20260806 01:07:40.928323 1570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "dbcbf6dec3d2418e91855218e1a3d794"
format_stamp: "Formatted at 2026-08-06 01:07:40 on dist-test-slave-69rg"
server_key: "ef1b83b12d699d658e7a20d2573b6f61"
server_key_iv: "de8e5677472ce9982dcea0d001630aa0"
server_key_version: "encryptionkey@0"
I20260806 01:07:40.929715 1570 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:07:40.930536 1585 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:40.930708 1570 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 01:07:40.930799 1570 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "dbcbf6dec3d2418e91855218e1a3d794"
format_stamp: "Formatted at 2026-08-06 01:07:40 on dist-test-slave-69rg"
server_key: "ef1b83b12d699d658e7a20d2573b6f61"
server_key_iv: "de8e5677472ce9982dcea0d001630aa0"
server_key_version: "encryptionkey@0"
I20260806 01:07:40.930882 1570 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:40.951553 1570 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:40.953999 1570 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:40.954165 1570 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:40.958447 1570 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:41387
I20260806 01:07:40.958493 1638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:41387 every 8 connection(s)
I20260806 01:07:40.958864 1570 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:07:40.959774 1639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:40.962065 1639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbcbf6dec3d2418e91855218e1a3d794: Bootstrap starting.
I20260806 01:07:40.962620 1639 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dbcbf6dec3d2418e91855218e1a3d794: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:40.962867 1639 log.cc:824] T 00000000000000000000000000000000 P dbcbf6dec3d2418e91855218e1a3d794: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:40.963617 1639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbcbf6dec3d2418e91855218e1a3d794: No bootstrap required, opened a new log
I20260806 01:07:40.964766 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 1570
I20260806 01:07:40.964869 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:07:40.965034 11617 external_mini_cluster.cc:1428] Setting key c531a99b0743b74fa4500af87d11454b
I20260806 01:07:40.965539 1639 raft_consensus.cc:348] T 00000000000000000000000000000000 P dbcbf6dec3d2418e91855218e1a3d794 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbcbf6dec3d2418e91855218e1a3d794" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 41387 } }
I20260806 01:07:40.965745 1639 raft_consensus.cc:374] T 00000000000000000000000000000000 P dbcbf6dec3d2418e91855218e1a3d794 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:40.965814 1639 raft_consensus.cc:729] T 00000000000000000000000000000000 P dbcbf6dec3d2418e91855218e1a3d794 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbcbf6dec3d2418e91855218e1a3d794, State: Initialized, Role: FOLLOWER
I20260806 01:07:40.965983 1639 consensus_queue.cc:260] T 00000000000000000000000000000000 P dbcbf6dec3d2418e91855218e1a3d794 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbcbf6dec3d2418e91855218e1a3d794" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 41387 } }
I20260806 01:07:40.966084 1639 raft_consensus.cc:388] T 00000000000000000000000000000000 P dbcbf6dec3d2418e91855218e1a3d794 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:07:40.966130 1639 raft_consensus.cc:482] T 00000000000000000000000000000000 P dbcbf6dec3d2418e91855218e1a3d794 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:07:40.966220 1639 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dbcbf6dec3d2418e91855218e1a3d794 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:40.966805 1639 raft_consensus.cc:504] T 00000000000000000000000000000000 P dbcbf6dec3d2418e91855218e1a3d794 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbcbf6dec3d2418e91855218e1a3d794" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 41387 } }
I20260806 01:07:40.966925 1639 leader_election.cc:302] T 00000000000000000000000000000000 P dbcbf6dec3d2418e91855218e1a3d794 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dbcbf6dec3d2418e91855218e1a3d794; no voters:
I20260806 01:07:40.967084 1639 leader_election.cc:288] T 00000000000000000000000000000000 P dbcbf6dec3d2418e91855218e1a3d794 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:07:40.967130 1644 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dbcbf6dec3d2418e91855218e1a3d794 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:40.967298 1644 raft_consensus.cc:686] T 00000000000000000000000000000000 P dbcbf6dec3d2418e91855218e1a3d794 [term 1 LEADER]: Becoming Leader. State: Replica: dbcbf6dec3d2418e91855218e1a3d794, State: Running, Role: LEADER
I20260806 01:07:40.967362 1639 sys_catalog.cc:564] T 00000000000000000000000000000000 P dbcbf6dec3d2418e91855218e1a3d794 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:40.967448 1644 consensus_queue.cc:237] T 00000000000000000000000000000000 P dbcbf6dec3d2418e91855218e1a3d794 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbcbf6dec3d2418e91855218e1a3d794" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 41387 } }
I20260806 01:07:40.967875 1644 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbcbf6dec3d2418e91855218e1a3d794 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dbcbf6dec3d2418e91855218e1a3d794. Latest consensus state: current_term: 1 leader_uuid: "dbcbf6dec3d2418e91855218e1a3d794" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbcbf6dec3d2418e91855218e1a3d794" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 41387 } } }
I20260806 01:07:40.968010 1644 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbcbf6dec3d2418e91855218e1a3d794 [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:40.967979 1645 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbcbf6dec3d2418e91855218e1a3d794 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dbcbf6dec3d2418e91855218e1a3d794" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbcbf6dec3d2418e91855218e1a3d794" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 41387 } } }
I20260806 01:07:40.968101 1645 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbcbf6dec3d2418e91855218e1a3d794 [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:40.968369 1653 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:07:40.968876 1653 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:07:40.970692 1653 catalog_manager.cc:1347] Generated new cluster ID: 50a364863b2943c8a3cb13fa31168e94
I20260806 01:07:40.970748 1653 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 01:07:40 dist-test-slave-69rg krb5kdc[1556](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:07:40.976732 1643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:40.965594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60473 (local address 127.11.88.126:41387)
0806 01:07:40.965864 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:40.965874 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:40.965903 (+ 29us) server_negotiation.cc:407] Connection header received
0806 01:07:40.966039 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:40.966045 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:40.966087 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:40.966233 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:40.967292 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:40.968731 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:40.969690 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:40.970345 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:40.970457 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:40.973052 (+ 2595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:40.973056 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:40.973057 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:40.973069 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:40.974972 (+ 1903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:40.975462 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:40.975466 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:40.975466 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:40.975577 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:40.975804 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:40.975805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:40.975805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:40.976077 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:40.976259 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:40.976353 (+ 94us) server_negotiation.cc:299] Negotiation successful
0806 01:07:40.976515 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":129,"threads_started":1}
I20260806 01:07:40.977722 11617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 01:07:40.986078 1643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:40.979305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54447 (local address 127.11.88.126:41387)
0806 01:07:40.979345 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:40.979347 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:40.979476 (+ 129us) server_negotiation.cc:407] Connection header received
0806 01:07:40.979564 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:40.979565 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:40.979577 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:40.979630 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:40.980201 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:40.980735 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:40.981505 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:40.981756 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:40.981857 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:40.983137 (+ 1280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:40.983139 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:40.983139 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:40.983147 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:40.984649 (+ 1502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:40.985030 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:40.985031 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:40.985032 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:40.985093 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:40.985420 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:40.985421 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:40.985421 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:40.985559 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:40.985667 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:40.985864 (+ 197us) server_negotiation.cc:299] Negotiation successful
0806 01:07:40.985945 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 01:07:40.997259 1653 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:07:40.997852 1653 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:07:41.001533 1653 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dbcbf6dec3d2418e91855218e1a3d794: Generated new TSK 0
I20260806 01:07:41.001756 1653 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:07:41.006865 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 1570
2026-08-06T01:07:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1393 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:07:41 dist-test-slave-69rg krb5kdc[1670](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:07:41 dist-test-slave-69rg krb5kdc[1670](info): set up 2 sockets
Aug 06 01:07:41 dist-test-slave-69rg krb5kdc[1670](info): commencing operation
krb5kdc: starting...
W20260806 01:07:42.143007 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:07:42 dist-test-slave-69rg krb5kdc[1670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978462, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:07:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:07:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:07:42.277541 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:32879
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:33181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:32879
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:42.362082 1683 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:42.362299 1683 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:42.362324 1683 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:42.363545 1683 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:42.363600 1683 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:42.363615 1683 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:42.363627 1683 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:42.363639 1683 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:42.365190 1683 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:33181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:32879
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:32879
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1683
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:42.365454 1683 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:42.365697 1683 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:42.370874 1688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:42.370850 1691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:42.370887 1683 server_base.cc:1034] running on GCE node
W20260806 01:07:42.370846 1689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:42.371389 1683 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:42.371757 1683 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:42.372915 1683 hybrid_clock.cc:648] HybridClock initialized: now 1785978462372894 us; error 47 us; skew 500 ppm
Aug 06 01:07:42 dist-test-slave-69rg krb5kdc[1670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978462, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:42.380968 1683 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:07:42.381479 1683 webserver.cc:460] Webserver started at http://127.11.88.126:41761/ using document root <none> and password file <none>
I20260806 01:07:42.381752 1683 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:42.381837 1683 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:42.381989 1683 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:42.383132 1683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "79c3c20159d543788e452a39a713a658"
format_stamp: "Formatted at 2026-08-06 01:07:42 on dist-test-slave-69rg"
server_key: "feffd31c6dd561cc4afd38a17a24610b"
server_key_iv: "4107839bc368ebf9640f1f6596ac2705"
server_key_version: "encryptionkey@0"
I20260806 01:07:42.383490 1683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "79c3c20159d543788e452a39a713a658"
format_stamp: "Formatted at 2026-08-06 01:07:42 on dist-test-slave-69rg"
server_key: "feffd31c6dd561cc4afd38a17a24610b"
server_key_iv: "4107839bc368ebf9640f1f6596ac2705"
server_key_version: "encryptionkey@0"
I20260806 01:07:42.384935 1683 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:07:42.385742 1698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:42.386034 1683 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:42.386180 1683 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "79c3c20159d543788e452a39a713a658"
format_stamp: "Formatted at 2026-08-06 01:07:42 on dist-test-slave-69rg"
server_key: "feffd31c6dd561cc4afd38a17a24610b"
server_key_iv: "4107839bc368ebf9640f1f6596ac2705"
server_key_version: "encryptionkey@0"
I20260806 01:07:42.386266 1683 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:42.397519 1683 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:42.399979 1683 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:42.400225 1683 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:42.404546 1683 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:32879
I20260806 01:07:42.404582 1751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:32879 every 8 connection(s)
I20260806 01:07:42.404966 1683 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:07:42.406118 1752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:42.408711 1752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79c3c20159d543788e452a39a713a658: Bootstrap starting.
I20260806 01:07:42.409395 1752 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 79c3c20159d543788e452a39a713a658: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:42.409731 1752 log.cc:824] T 00000000000000000000000000000000 P 79c3c20159d543788e452a39a713a658: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:42.410621 1752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79c3c20159d543788e452a39a713a658: No bootstrap required, opened a new log
I20260806 01:07:42.412530 1752 raft_consensus.cc:348] T 00000000000000000000000000000000 P 79c3c20159d543788e452a39a713a658 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79c3c20159d543788e452a39a713a658" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 32879 } }
I20260806 01:07:42.412700 1752 raft_consensus.cc:374] T 00000000000000000000000000000000 P 79c3c20159d543788e452a39a713a658 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:42.412726 1752 raft_consensus.cc:729] T 00000000000000000000000000000000 P 79c3c20159d543788e452a39a713a658 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c3c20159d543788e452a39a713a658, State: Initialized, Role: FOLLOWER
I20260806 01:07:42.412904 1752 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79c3c20159d543788e452a39a713a658 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79c3c20159d543788e452a39a713a658" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 32879 } }
I20260806 01:07:42.412977 1752 raft_consensus.cc:388] T 00000000000000000000000000000000 P 79c3c20159d543788e452a39a713a658 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:07:42.413002 1752 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79c3c20159d543788e452a39a713a658 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:07:42.413080 1752 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 79c3c20159d543788e452a39a713a658 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:42.413360 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 1683
I20260806 01:07:42.413496 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:07:42.413692 11617 external_mini_cluster.cc:1428] Setting key d4d5f93647ff4be660d7128b500e4b21
I20260806 01:07:42.414479 1752 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79c3c20159d543788e452a39a713a658 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79c3c20159d543788e452a39a713a658" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 32879 } }
I20260806 01:07:42.414613 1752 leader_election.cc:302] T 00000000000000000000000000000000 P 79c3c20159d543788e452a39a713a658 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 79c3c20159d543788e452a39a713a658; no voters:
I20260806 01:07:42.414811 1752 leader_election.cc:288] T 00000000000000000000000000000000 P 79c3c20159d543788e452a39a713a658 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:07:42.414846 1757 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 79c3c20159d543788e452a39a713a658 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:42.415004 1757 raft_consensus.cc:686] T 00000000000000000000000000000000 P 79c3c20159d543788e452a39a713a658 [term 1 LEADER]: Becoming Leader. State: Replica: 79c3c20159d543788e452a39a713a658, State: Running, Role: LEADER
I20260806 01:07:42.415117 1752 sys_catalog.cc:564] T 00000000000000000000000000000000 P 79c3c20159d543788e452a39a713a658 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:42.415138 1757 consensus_queue.cc:237] T 00000000000000000000000000000000 P 79c3c20159d543788e452a39a713a658 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79c3c20159d543788e452a39a713a658" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 32879 } }
I20260806 01:07:42.415668 1759 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79c3c20159d543788e452a39a713a658 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "79c3c20159d543788e452a39a713a658" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79c3c20159d543788e452a39a713a658" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 32879 } } }
I20260806 01:07:42.415817 1759 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79c3c20159d543788e452a39a713a658 [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:42.416201 1758 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79c3c20159d543788e452a39a713a658 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79c3c20159d543788e452a39a713a658. Latest consensus state: current_term: 1 leader_uuid: "79c3c20159d543788e452a39a713a658" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79c3c20159d543788e452a39a713a658" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 32879 } } }
I20260806 01:07:42.416286 1758 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79c3c20159d543788e452a39a713a658 [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:42.416431 1766 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:07:42.416965 1766 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:07:42.418962 1766 catalog_manager.cc:1347] Generated new cluster ID: c5fa2d25b95e4429b37e288cbfd14cff
I20260806 01:07:42.419036 1766 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:07:42.420732 1756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:42.414298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47435 (local address 127.11.88.126:32879)
0806 01:07:42.414558 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:42.414571 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:42.414619 (+ 48us) server_negotiation.cc:407] Connection header received
0806 01:07:42.414763 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:42.414770 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:42.414840 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:42.415016 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:42.415436 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:42.417211 (+ 1775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:42.418431 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:42.419036 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:42.419199 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:42.419976 (+ 777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:42.419980 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:42.419980 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:42.420204 (+ 224us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:42.420245 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:42.420263 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:42.420332 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:42.420414 (+ 82us) server_negotiation.cc:299] Negotiation successful
0806 01:07:42.420484 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":117,"threads_started":1}
I20260806 01:07:42.421752 11617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 01:07:42.427191 1756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:42.423512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53371 (local address 127.11.88.126:32879)
0806 01:07:42.423556 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:42.423559 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:42.423566 (+ 7us) server_negotiation.cc:407] Connection header received
0806 01:07:42.423591 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:42.423592 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:42.423603 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:42.423659 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:42.423810 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:42.424633 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:42.425728 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:42.426116 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:42.426182 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:42.426936 (+ 754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:42.426937 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:42.426937 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:42.426944 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:42.426963 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:42.426968 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:42.427023 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:42.427072 (+ 49us) server_negotiation.cc:299] Negotiation successful
0806 01:07:42.427100 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 01:07:42.443058 1766 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:07:42.443717 1766 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:07:42.447130 1766 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 79c3c20159d543788e452a39a713a658: Generated new TSK 0
I20260806 01:07:42.447355 1766 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:07:42.453948 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 1683
2026-08-06T01:07:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1447 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:07:42 dist-test-slave-69rg krb5kdc[1784](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:07:42 dist-test-slave-69rg krb5kdc[1784](info): set up 2 sockets
Aug 06 01:07:42 dist-test-slave-69rg krb5kdc[1784](info): commencing operation
krb5kdc: starting...
W20260806 01:07:43.536445 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.062s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:07:43 dist-test-slave-69rg krb5kdc[1784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978463, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:07:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:07:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:07:43.669305 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:37049
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:42151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:37049
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:43.755577 1797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:43.755793 1797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:43.755820 1797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:43.756929 1797 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:43.756966 1797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:43.756980 1797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:43.756992 1797 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:43.757004 1797 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:43.758592 1797 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:42151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:37049
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:37049
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1797
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:43.758811 1797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:43.758987 1797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:43.763980 1803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:43.764008 1806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:43.763979 1804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:43.764266 1797 server_base.cc:1034] running on GCE node
I20260806 01:07:43.764571 1797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:43.764878 1797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:43.766016 1797 hybrid_clock.cc:648] HybridClock initialized: now 1785978463766018 us; error 61 us; skew 500 ppm
Aug 06 01:07:43 dist-test-slave-69rg krb5kdc[1784](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978463, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:43.768687 1797 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:07:43.769202 1797 webserver.cc:460] Webserver started at http://127.11.88.126:42263/ using document root <none> and password file <none>
I20260806 01:07:43.769446 1797 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:43.769512 1797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:43.769656 1797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:43.770817 1797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "8ca45328fa3b4c07a7be1f78bd18ed0e"
format_stamp: "Formatted at 2026-08-06 01:07:43 on dist-test-slave-69rg"
server_key: "548e1822da0e26213cf218d8d2d26e53"
server_key_iv: "1eb262d5de420d4d40328ae4f869b331"
server_key_version: "encryptionkey@0"
I20260806 01:07:43.771196 1797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "8ca45328fa3b4c07a7be1f78bd18ed0e"
format_stamp: "Formatted at 2026-08-06 01:07:43 on dist-test-slave-69rg"
server_key: "548e1822da0e26213cf218d8d2d26e53"
server_key_iv: "1eb262d5de420d4d40328ae4f869b331"
server_key_version: "encryptionkey@0"
I20260806 01:07:43.772624 1797 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 01:07:43.773445 1813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:43.773631 1797 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:43.773751 1797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "8ca45328fa3b4c07a7be1f78bd18ed0e"
format_stamp: "Formatted at 2026-08-06 01:07:43 on dist-test-slave-69rg"
server_key: "548e1822da0e26213cf218d8d2d26e53"
server_key_iv: "1eb262d5de420d4d40328ae4f869b331"
server_key_version: "encryptionkey@0"
I20260806 01:07:43.773861 1797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:43.777199 1797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:43.779417 1797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:43.779572 1797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:43.783852 1797 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:37049
I20260806 01:07:43.783977 1866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:37049 every 8 connection(s)
I20260806 01:07:43.784255 1797 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:07:43.784710 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 1797
I20260806 01:07:43.784861 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:07:43.785214 11617 external_mini_cluster.cc:1428] Setting key 7ea43208f0240c0b16d832f2f8f84479
I20260806 01:07:43.785583 1867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:43.788121 1870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:43.785768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35509 (local address 127.11.88.126:37049)
0806 01:07:43.786030 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:43.786038 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:43.786067 (+ 29us) server_negotiation.cc:407] Connection header received
0806 01:07:43.786761 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:43.786768 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:43.786795 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:43.786913 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:43.787653 (+ 740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:43.787656 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:43.787656 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:43.787660 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:43.787711 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:43.787721 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:43.787783 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:43.787876 (+ 93us) server_negotiation.cc:299] Negotiation successful
0806 01:07:43.787932 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":171,"threads_started":1}
I20260806 01:07:43.789222 11617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 01:07:43.789330 1867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ca45328fa3b4c07a7be1f78bd18ed0e: Bootstrap starting.
I20260806 01:07:43.790127 1867 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ca45328fa3b4c07a7be1f78bd18ed0e: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:43.790503 1867 log.cc:824] T 00000000000000000000000000000000 P 8ca45328fa3b4c07a7be1f78bd18ed0e: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:43.791410 1867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ca45328fa3b4c07a7be1f78bd18ed0e: No bootstrap required, opened a new log
I20260806 01:07:43.792078 1870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:43.790958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51835 (local address 127.11.88.126:37049)
0806 01:07:43.790999 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:43.791001 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:43.791112 (+ 111us) server_negotiation.cc:407] Connection header received
0806 01:07:43.791182 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:43.791183 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:43.791189 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:43.791249 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:43.791867 (+ 618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:43.791868 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:43.791869 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 01:07:43.791874 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:43.791890 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 01:07:43.791894 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:43.791963 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:43.791999 (+ 36us) server_negotiation.cc:299] Negotiation successful
0806 01:07:43.792012 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 01:07:43.793632 1867 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ca45328fa3b4c07a7be1f78bd18ed0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ca45328fa3b4c07a7be1f78bd18ed0e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 37049 } }
I20260806 01:07:43.793787 1867 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8ca45328fa3b4c07a7be1f78bd18ed0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 01:07:43.793855 1867 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ca45328fa3b4c07a7be1f78bd18ed0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca45328fa3b4c07a7be1f78bd18ed0e, State: Initialized, Role: FOLLOWER
I20260806 01:07:43.793994 1867 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ca45328fa3b4c07a7be1f78bd18ed0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ca45328fa3b4c07a7be1f78bd18ed0e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 37049 } }
I20260806 01:07:43.794087 1867 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8ca45328fa3b4c07a7be1f78bd18ed0e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 01:07:43.794111 1867 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8ca45328fa3b4c07a7be1f78bd18ed0e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 01:07:43.794142 1867 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ca45328fa3b4c07a7be1f78bd18ed0e [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:43.794690 1867 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8ca45328fa3b4c07a7be1f78bd18ed0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ca45328fa3b4c07a7be1f78bd18ed0e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 37049 } }
I20260806 01:07:43.794783 1867 leader_election.cc:302] T 00000000000000000000000000000000 P 8ca45328fa3b4c07a7be1f78bd18ed0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ca45328fa3b4c07a7be1f78bd18ed0e; no voters:
I20260806 01:07:43.794922 1867 leader_election.cc:288] T 00000000000000000000000000000000 P 8ca45328fa3b4c07a7be1f78bd18ed0e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 01:07:43.795001 1877 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8ca45328fa3b4c07a7be1f78bd18ed0e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:43.795187 1867 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ca45328fa3b4c07a7be1f78bd18ed0e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:43.795238 1877 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8ca45328fa3b4c07a7be1f78bd18ed0e [term 1 LEADER]: Becoming Leader. State: Replica: 8ca45328fa3b4c07a7be1f78bd18ed0e, State: Running, Role: LEADER
I20260806 01:07:43.795332 1877 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ca45328fa3b4c07a7be1f78bd18ed0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ca45328fa3b4c07a7be1f78bd18ed0e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 37049 } }
I20260806 01:07:43.795755 1878 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ca45328fa3b4c07a7be1f78bd18ed0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8ca45328fa3b4c07a7be1f78bd18ed0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ca45328fa3b4c07a7be1f78bd18ed0e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 37049 } } }
I20260806 01:07:43.795755 1879 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ca45328fa3b4c07a7be1f78bd18ed0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ca45328fa3b4c07a7be1f78bd18ed0e. Latest consensus state: current_term: 1 leader_uuid: "8ca45328fa3b4c07a7be1f78bd18ed0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ca45328fa3b4c07a7be1f78bd18ed0e" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 37049 } } }
I20260806 01:07:43.795890 1878 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ca45328fa3b4c07a7be1f78bd18ed0e [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:43.795895 1879 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ca45328fa3b4c07a7be1f78bd18ed0e [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:43.796693 1886 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:07:43.797266 1886 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:07:43.798993 1886 catalog_manager.cc:1347] Generated new cluster ID: 17743e622e85473d9f2bad776d5ec681
I20260806 01:07:43.799068 1886 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:07:43.810472 1886 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:07:43.810688 1886 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:07:43.821381 1886 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8ca45328fa3b4c07a7be1f78bd18ed0e: Generated new TSK 0
I20260806 01:07:43.821674 1886 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 01:07:43.834563 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 1797
2026-08-06T01:07:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1380 ms)
[----------] 18 tests from AuthTokenIssuingTest (25129 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:07:43 dist-test-slave-69rg krb5kdc[1898](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:07:43 dist-test-slave-69rg krb5kdc[1898](info): set up 2 sockets
Aug 06 01:07:43 dist-test-slave-69rg krb5kdc[1898](info): commencing operation
krb5kdc: starting...
W20260806 01:07:44.915927 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.061s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:07:45 dist-test-slave-69rg krb5kdc[1898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:07:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:07:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:07:45.050004 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:46561
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:34621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:46561,127.11.88.125:41439,127.11.88.124:44951
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:45.137414 1912 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 01:07:45.137635 1912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:45.137655 1912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:45.137676 1912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:45.138834 1912 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:45.138875 1912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:45.138890 1912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:45.138902 1912 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:45.138914 1912 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:45.140388 1912 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:34621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:46561,127.11.88.125:41439,127.11.88.124:44951
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:46561
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1912
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:45.140596 1912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:45.140786 1912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:45.145989 1917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:45.146015 1918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:45.146272 1912 server_base.cc:1034] running on GCE node
W20260806 01:07:45.146034 1920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:45.146620 1912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:45.146884 1912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:45.148072 1912 hybrid_clock.cc:648] HybridClock initialized: now 1785978465148048 us; error 41 us; skew 500 ppm
Aug 06 01:07:45 dist-test-slave-69rg krb5kdc[1898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978465, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:45.150808 1912 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:07:45.151249 1912 webserver.cc:460] Webserver started at http://127.11.88.126:39403/ using document root <none> and password file <none>
I20260806 01:07:45.151503 1912 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:45.151599 1912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:45.151736 1912 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:45.152838 1912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "944de709a79c43dfaf43ec14f2bec09f"
format_stamp: "Formatted at 2026-08-06 01:07:45 on dist-test-slave-69rg"
server_key: "19fc3ac283c320bae5bb8e6ef0c78984"
server_key_iv: "aa7acea97543a3b37c50fb176fc1a0a4"
server_key_version: "encryptionkey@0"
I20260806 01:07:45.153239 1912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "944de709a79c43dfaf43ec14f2bec09f"
format_stamp: "Formatted at 2026-08-06 01:07:45 on dist-test-slave-69rg"
server_key: "19fc3ac283c320bae5bb8e6ef0c78984"
server_key_iv: "aa7acea97543a3b37c50fb176fc1a0a4"
server_key_version: "encryptionkey@0"
I20260806 01:07:45.154788 1912 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:07:45.155659 1927 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:45.155836 1912 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:45.155929 1912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "944de709a79c43dfaf43ec14f2bec09f"
format_stamp: "Formatted at 2026-08-06 01:07:45 on dist-test-slave-69rg"
server_key: "19fc3ac283c320bae5bb8e6ef0c78984"
server_key_iv: "aa7acea97543a3b37c50fb176fc1a0a4"
server_key_version: "encryptionkey@0"
I20260806 01:07:45.156010 1912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:45.176620 1912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:45.179208 1912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:45.179394 1912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:45.183979 1912 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:46561
I20260806 01:07:45.184018 1980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:46561 every 8 connection(s)
I20260806 01:07:45.184410 1912 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:07:45.185473 1981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:45.186147 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 1912
I20260806 01:07:45.186275 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:07:45.186460 11617 external_mini_cluster.cc:1428] Setting key 33d610e8a9e90a90cf91a444daeda3ae
I20260806 01:07:45.187999 1981 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46561 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 01:07:45 dist-test-slave-69rg krb5kdc[1898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978465, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.88.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.125@KRBTEST.COM" created.
I20260806 01:07:45.198305 1984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.188952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60982 (local address 127.11.88.126:46561)
0806 01:07:45.189144 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:45.189154 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:45.189334 (+ 180us) server_negotiation.cc:407] Connection header received
0806 01:07:45.189912 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:45.189919 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:45.189937 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:45.190034 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:45.190611 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.191430 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.192294 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.192607 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.192728 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:45.194947 (+ 2219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:45.194955 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:45.194955 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:45.194968 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:45.196482 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.196899 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.196902 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.196903 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.197048 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.197275 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.197276 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.197276 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.197599 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:45.197703 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:45.197941 (+ 238us) server_negotiation.cc:299] Negotiation successful
0806 01:07:45.198205 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":140,"server-negotiator.queue_time_us":143,"thread_start_us":108,"threads_started":1}
I20260806 01:07:45.198311 1985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.188939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:46561 (local address 127.0.0.1:60982)
0806 01:07:45.189157 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:45.189198 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:45.189738 (+ 540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:45.190039 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:45.190042 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:45.190344 (+ 302us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:45.190507 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:45.190512 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.191532 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.191533 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:45.192195 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:45.192197 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.192720 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.192721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:45.192785 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:45.193408 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:07:45.193416 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:45.194857 (+ 1441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:45.196581 (+ 1724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:45.196588 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:45.196590 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:45.196785 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:45.197126 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:45.197127 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:45.197127 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:45.197216 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:45.197674 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:45.197680 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:45.197764 (+ 84us) client_negotiation.cc:769] Sending connection context
0806 01:07:45.197890 (+ 126us) client_negotiation.cc:240] Negotiation successful
0806 01:07:45.198045 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":116,"threads_started":1}
I20260806 01:07:45.199169 1981 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.125" port: 41439 } has no permanent_uuid. Determining permanent_uuid...
I20260806 01:07:45.199579 1985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.199437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:41439 (local address 127.0.0.1:49848)
0806 01:07:45.199490 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:45.199545 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.125:41439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260806 01:07:45.199728 1931 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.88.125:41439: connect: Connection refused (error 111)
I20260806 01:07:45.200203 1985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.200086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:41439 (local address 127.0.0.1:49850)
0806 01:07:45.200139 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:45.200173 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.125:41439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260806 01:07:45.200418 1981 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.88.125:41439: Network error: Client connection negotiation failed: client connection to 127.11.88.125:41439: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.125.keytab.
Entry for principal kudu/127.11.88.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.125.keytab.
I20260806 01:07:45.216553 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.125:41439
--webserver_interface=127.11.88.125
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.125.keytab
--principal=kudu/127.11.88.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:34621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:46561,127.11.88.125:41439,127.11.88.124:44951
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 01:07:45.249692 1981 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.88.125" port: 41439 } attempt: 1
I20260806 01:07:45.250445 1985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.250283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:41439 (local address 127.0.0.1:49856)
0806 01:07:45.250353 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:45.250405 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.125:41439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260806 01:07:45.250877 1985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.250761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:41439 (local address 127.0.0.1:49864)
0806 01:07:45.250805 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:45.250853 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.125:41439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260806 01:07:45.250998 1981 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.88.125:41439: Network error: Client connection negotiation failed: client connection to 127.11.88.125:41439: connect: Connection refused (error 111)
W20260806 01:07:45.303311 1988 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 01:07:45.303552 1988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:45.303571 1988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:45.303593 1988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:45.304797 1988 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:45.304842 1988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:45.304857 1988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:45.304869 1988 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:45.304919 1988 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:45.306510 1988 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:34621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:46561,127.11.88.125:41439,127.11.88.124:44951
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.125.keytab
--principal=kudu/127.11.88.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.125:41439
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.88.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1988
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:45.306787 1988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:45.307024 1988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:45.312170 1996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:45.312179 1994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:45.312193 1993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:45.312255 1988 server_base.cc:1034] running on GCE node
I20260806 01:07:45.312731 1988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:45.313092 1988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:45.314256 1988 hybrid_clock.cc:648] HybridClock initialized: now 1785978465314242 us; error 34 us; skew 500 ppm
Aug 06 01:07:45 dist-test-slave-69rg krb5kdc[1898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978465, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:45.317015 1988 init.cc:377] Logged in from keytab as kudu/127.11.88.125@KRBTEST.COM (short username kudu)
I20260806 01:07:45.317593 1988 webserver.cc:460] Webserver started at http://127.11.88.125:33563/ using document root <none> and password file <none>
I20260806 01:07:45.317931 1988 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:45.318008 1988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:45.318189 1988 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:45.319214 1981 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.88.125" port: 41439 } attempt: 2
I20260806 01:07:45.319485 1988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-1/data/instance:
uuid: "daff1224a70242d5bd3f865eab089d39"
format_stamp: "Formatted at 2026-08-06 01:07:45 on dist-test-slave-69rg"
server_key: "d389627d25880c6996e7598c83f9ed00"
server_key_iv: "66b7267c9bb0e363326ccd07069390e2"
server_key_version: "encryptionkey@0"
I20260806 01:07:45.319633 1985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.319500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:41439 (local address 127.0.0.1:49876)
0806 01:07:45.319562 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:45.319595 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.125:41439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260806 01:07:45.319927 1988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-1/wal/instance:
uuid: "daff1224a70242d5bd3f865eab089d39"
format_stamp: "Formatted at 2026-08-06 01:07:45 on dist-test-slave-69rg"
server_key: "d389627d25880c6996e7598c83f9ed00"
server_key_iv: "66b7267c9bb0e363326ccd07069390e2"
server_key_version: "encryptionkey@0"
I20260806 01:07:45.319953 1985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.319866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:41439 (local address 127.0.0.1:49886)
0806 01:07:45.319907 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:45.319931 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.125:41439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260806 01:07:45.320035 1981 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.88.125:41439: Network error: Client connection negotiation failed: client connection to 127.11.88.125:41439: connect: Connection refused (error 111)
I20260806 01:07:45.321601 1988 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 01:07:45.322602 2003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:45.322883 1988 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 01:07:45.322994 1988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-1/wal
uuid: "daff1224a70242d5bd3f865eab089d39"
format_stamp: "Formatted at 2026-08-06 01:07:45 on dist-test-slave-69rg"
server_key: "d389627d25880c6996e7598c83f9ed00"
server_key_iv: "66b7267c9bb0e363326ccd07069390e2"
server_key_version: "encryptionkey@0"
I20260806 01:07:45.323081 1988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:45.368465 1988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:45.370733 1988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:45.370899 1988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:45.375209 1988 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.125:41439
I20260806 01:07:45.375274 2055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.125:41439 every 8 connection(s)
I20260806 01:07:45.375658 1988 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-1/data/info.pb
I20260806 01:07:45.376727 2056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:45.378378 2056 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46561 } has no permanent_uuid. Determining permanent_uuid...
I20260806 01:07:45.383275 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 1988
I20260806 01:07:45.383400 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-1/wal/instance
I20260806 01:07:45.383605 11617 external_mini_cluster.cc:1428] Setting key f9a348570fa22643bccd73a6a9d3c72a
Aug 06 01:07:45 dist-test-slave-69rg krb5kdc[1898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978465, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.125@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:07:45.388284 1984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.379212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60984 (local address 127.11.88.126:46561)
0806 01:07:45.379285 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:45.379287 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:45.379490 (+ 203us) server_negotiation.cc:407] Connection header received
0806 01:07:45.379981 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:45.379982 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:45.379993 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:45.380061 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:45.380730 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.381242 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.382325 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.382533 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.382586 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:45.385081 (+ 2495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:45.385083 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:45.385083 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:45.385093 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:45.386716 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.387155 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.387157 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.387157 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.387222 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.387473 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.387475 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.387475 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.387637 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:45.387714 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:45.388137 (+ 423us) server_negotiation.cc:299] Negotiation successful
0806 01:07:45.388216 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 01:07:45.388617 2058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.379125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:46561 (local address 127.0.0.1:60984)
0806 01:07:45.379333 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:45.379377 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:45.379893 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:45.380159 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:45.380163 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:45.380429 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:45.380630 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:45.380634 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.381325 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.381326 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:45.382237 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:45.382240 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.382614 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.382615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:45.382720 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:45.383263 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:07:45.383274 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:45.384970 (+ 1696us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:45.386800 (+ 1830us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:45.386809 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:45.386811 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:45.387047 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:45.387298 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:45.387298 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:45.387299 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:45.387410 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:45.387737 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:45.387746 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:45.387941 (+ 195us) client_negotiation.cc:769] Sending connection context
0806 01:07:45.388080 (+ 139us) client_negotiation.cc:240] Negotiation successful
0806 01:07:45.388273 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":127,"threads_started":1}
I20260806 01:07:45.389364 2056 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.125" port: 41439 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.88.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.124@KRBTEST.COM" created.
Aug 06 01:07:45 dist-test-slave-69rg krb5kdc[1898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978465, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.125@KRBTEST.COM for kudu/127.11.88.125@KRBTEST.COM
I20260806 01:07:45.399276 2058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.389649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:41439 (local address 127.0.0.1:49894)
0806 01:07:45.389698 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:45.389710 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:45.389751 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:45.390082 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:45.390083 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:45.390203 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:45.390254 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:45.390255 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.391604 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.391605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:45.392116 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:45.392118 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.392787 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.392788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:45.392853 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:45.393225 (+ 372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:07:45.393230 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:45.396209 (+ 2979us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:45.398156 (+ 1947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:45.398156 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:45.398157 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:45.398319 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:45.398554 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:45.398555 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:45.398555 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:45.398620 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:45.398972 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:45.398972 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:45.399010 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 01:07:45.399109 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 01:07:45.399201 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260806 01:07:45.399477 2061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.389707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49894 (local address 127.11.88.125:41439)
0806 01:07:45.389908 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:45.389914 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:45.389939 (+ 25us) server_negotiation.cc:407] Connection header received
0806 01:07:45.389963 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:45.389965 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:45.389981 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:45.390069 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:45.390329 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.391485 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.392212 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.392712 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.392775 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:45.396314 (+ 3539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:45.396323 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:45.396323 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:45.396331 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:45.398055 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.398397 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.398400 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.398401 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.398470 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.398691 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.398692 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.398692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.398904 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:45.398991 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:45.399147 (+ 156us) server_negotiation.cc:299] Negotiation successful
0806 01:07:45.399311 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":166,"thread_start_us":97,"threads_started":1}
I20260806 01:07:45.400240 2056 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 } has no permanent_uuid. Determining permanent_uuid...
I20260806 01:07:45.400600 2058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.400483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44951 (local address 127.0.0.1:38878)
0806 01:07:45.400530 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:45.400580 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260806 01:07:45.400769 2006 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44951: connect: Connection refused (error 111)
I20260806 01:07:45.401232 2058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.401147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44951 (local address 127.0.0.1:38888)
0806 01:07:45.401191 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:45.401215 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260806 01:07:45.401355 2056 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.88.124:44951: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44951: connect: Connection refused (error 111)
I20260806 01:07:45.411167 1981 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.88.125" port: 41439 } attempt: 3
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.124.keytab.
Entry for principal kudu/127.11.88.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.124.keytab.
I20260806 01:07:45.413180 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.124:44951
--webserver_interface=127.11.88.124
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.124.keytab
--principal=kudu/127.11.88.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:34621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:46561,127.11.88.125:41439,127.11.88.124:44951
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 01:07:45 dist-test-slave-69rg krb5kdc[1898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978465, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for kudu/127.11.88.125@KRBTEST.COM
I20260806 01:07:45.419078 1985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.411576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:41439 (local address 127.0.0.1:49908)
0806 01:07:45.411640 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:45.411651 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:45.411693 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:45.411912 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:45.411914 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:45.412106 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:45.412177 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:45.412179 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.412947 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.412948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:45.413777 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:45.413781 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.414285 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.414286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:45.414374 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:45.414846 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:07:45.414853 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:45.416325 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:45.418016 (+ 1691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:45.418017 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:45.418018 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:45.418214 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:45.418424 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:45.418425 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:45.418426 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:45.418490 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:45.418734 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:45.418735 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:45.418786 (+ 51us) client_negotiation.cc:769] Sending connection context
0806 01:07:45.418868 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 01:07:45.418975 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260806 01:07:45.419087 2061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.411672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49908 (local address 127.11.88.125:41439)
0806 01:07:45.411750 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:45.411752 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:45.411762 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:07:45.411787 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:45.411788 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:45.411797 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:45.411862 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:45.412293 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.412851 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.413975 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.414207 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.414277 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:45.416418 (+ 2141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:45.416420 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:45.416420 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:45.416429 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:45.417918 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.418300 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.418301 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.418302 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.418359 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.418551 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.418552 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.418552 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.418671 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:45.418742 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:45.418894 (+ 152us) server_negotiation.cc:299] Negotiation successful
0806 01:07:45.418978 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 01:07:45.419556 1981 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 } has no permanent_uuid. Determining permanent_uuid...
I20260806 01:07:45.419909 1985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.419800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44951 (local address 127.0.0.1:38904)
0806 01:07:45.419847 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:45.419876 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260806 01:07:45.420243 1985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.420156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44951 (local address 127.0.0.1:38918)
0806 01:07:45.420197 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:45.420220 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260806 01:07:45.420332 1981 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.88.124:44951: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44951: connect: Connection refused (error 111)
I20260806 01:07:45.450608 2056 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 } attempt: 1
I20260806 01:07:45.451126 2058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.450976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44951 (local address 127.0.0.1:38920)
0806 01:07:45.451047 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:45.451088 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260806 01:07:45.451493 1981 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 } attempt: 1
I20260806 01:07:45.451694 2058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.451564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44951 (local address 127.0.0.1:38932)
0806 01:07:45.451620 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:45.451658 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260806 01:07:45.451910 2056 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.88.124:44951: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44951: connect: Connection refused (error 111)
I20260806 01:07:45.451959 1985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.451808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44951 (local address 127.0.0.1:38938)
0806 01:07:45.451873 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:45.451924 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260806 01:07:45.452391 1985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.452259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44951 (local address 127.0.0.1:38954)
0806 01:07:45.452315 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:45.452354 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260806 01:07:45.452530 1981 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.88.124:44951: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44951: connect: Connection refused (error 111)
W20260806 01:07:45.499218 2064 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 01:07:45.499444 2064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:45.499462 2064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:45.499485 2064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:45.500679 2064 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:45.500733 2064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:45.500747 2064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:45.500761 2064 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:45.500772 2064 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:45.502403 2064 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:34621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:46561,127.11.88.125:41439,127.11.88.124:44951
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.124.keytab
--principal=kudu/127.11.88.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.124:44951
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.88.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2064
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:45.502700 2064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:45.502956 2064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:45.508190 2072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:45.508190 2069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:45.508494 2070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:45.508544 2064 server_base.cc:1034] running on GCE node
I20260806 01:07:45.508836 2064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:45.509179 2064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:45.510437 2064 hybrid_clock.cc:648] HybridClock initialized: now 1785978465510415 us; error 32 us; skew 500 ppm
Aug 06 01:07:45 dist-test-slave-69rg krb5kdc[1898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978465, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:45.513037 2064 init.cc:377] Logged in from keytab as kudu/127.11.88.124@KRBTEST.COM (short username kudu)
I20260806 01:07:45.513500 2064 webserver.cc:460] Webserver started at http://127.11.88.124:33975/ using document root <none> and password file <none>
I20260806 01:07:45.513752 2064 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:45.513854 2064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:45.514020 2064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:45.515115 2064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-2/data/instance:
uuid: "a5c7833bc0e243fc89da9a044c832b5f"
format_stamp: "Formatted at 2026-08-06 01:07:45 on dist-test-slave-69rg"
server_key: "8ede559cd53d1fec177c01572d199096"
server_key_iv: "c62bdc514a00863ac38bb5b7f19944ea"
server_key_version: "encryptionkey@0"
I20260806 01:07:45.515497 2064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-2/wal/instance:
uuid: "a5c7833bc0e243fc89da9a044c832b5f"
format_stamp: "Formatted at 2026-08-06 01:07:45 on dist-test-slave-69rg"
server_key: "8ede559cd53d1fec177c01572d199096"
server_key_iv: "c62bdc514a00863ac38bb5b7f19944ea"
server_key_version: "encryptionkey@0"
I20260806 01:07:45.516901 2064 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 01:07:45.517683 2079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:45.517897 2064 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:07:45.518002 2064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-2/wal
uuid: "a5c7833bc0e243fc89da9a044c832b5f"
format_stamp: "Formatted at 2026-08-06 01:07:45 on dist-test-slave-69rg"
server_key: "8ede559cd53d1fec177c01572d199096"
server_key_iv: "c62bdc514a00863ac38bb5b7f19944ea"
server_key_version: "encryptionkey@0"
I20260806 01:07:45.518095 2064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:45.520081 2056 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 } attempt: 2
I20260806 01:07:45.520529 2058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.520407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44951 (local address 127.0.0.1:38962)
0806 01:07:45.520463 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:45.520501 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260806 01:07:45.520900 2058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.520803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44951 (local address 127.0.0.1:38972)
0806 01:07:45.520845 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:45.520871 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260806 01:07:45.520994 2056 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.88.124:44951: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44951: connect: Connection refused (error 111)
I20260806 01:07:45.527691 1981 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 } attempt: 2
I20260806 01:07:45.528182 1985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.528048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44951 (local address 127.0.0.1:38984)
0806 01:07:45.528109 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:45.528149 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260806 01:07:45.528577 1985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.528494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44951 (local address 127.0.0.1:38990)
0806 01:07:45.528534 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:45.528559 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260806 01:07:45.528673 1981 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.88.124:44951: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44951: connect: Connection refused (error 111)
I20260806 01:07:45.564543 2064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:45.566979 2064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:45.567152 2064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:45.571282 2064 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.124:44951
I20260806 01:07:45.571336 2131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.124:44951 every 8 connection(s)
I20260806 01:07:45.571703 2064 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-2/data/info.pb
I20260806 01:07:45.573025 2132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:45.574769 2132 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46561 } has no permanent_uuid. Determining permanent_uuid...
I20260806 01:07:45.580016 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 2064
I20260806 01:07:45.580137 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785978186227899-11617-0/minicluster-data/master-2/wal/instance
I20260806 01:07:45.580330 11617 external_mini_cluster.cc:1428] Setting key a4f47fb6ff1735c63d562b7d0733babc
Aug 06 01:07:45 dist-test-slave-69rg krb5kdc[1898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978465, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.124@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:07:45.584849 1984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.575578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32768 (local address 127.11.88.126:46561)
0806 01:07:45.575662 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:45.575665 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:45.575927 (+ 262us) server_negotiation.cc:407] Connection header received
0806 01:07:45.576450 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:45.576451 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:45.576463 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:45.576526 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:45.577155 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.577670 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.578793 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.578995 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.579117 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:45.581788 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:45.581789 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:45.581790 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:45.581798 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:45.583387 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.583830 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.583831 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.583831 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.583894 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.584153 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.584154 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.584154 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.584266 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:45.584365 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:45.584652 (+ 287us) server_negotiation.cc:299] Negotiation successful
0806 01:07:45.584745 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 01:07:45.585029 2134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.575560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:46561 (local address 127.0.0.1:32768)
0806 01:07:45.575803 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:45.575843 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:45.576327 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:45.576600 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:45.576604 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:45.576861 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:45.577055 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:45.577058 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.577755 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.577755 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:45.578704 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:45.578706 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.579147 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.579148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:45.579274 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:45.579885 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:07:45.579907 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:45.581684 (+ 1777us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:45.583470 (+ 1786us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:45.583479 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:45.583481 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:45.583714 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:45.583951 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:45.583952 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:45.583952 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:45.584087 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:45.584358 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:45.584365 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:45.584511 (+ 146us) client_negotiation.cc:769] Sending connection context
0806 01:07:45.584624 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 01:07:45.584779 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":128,"threads_started":1}
I20260806 01:07:45.585696 2132 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.125" port: 41439 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 01:07:45 dist-test-slave-69rg krb5kdc[1898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.124@KRBTEST.COM
Aug 06 01:07:45 dist-test-slave-69rg krb5kdc[1898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978465, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.124@KRBTEST.COM for kudu/127.11.88.125@KRBTEST.COM
I20260806 01:07:45.590301 2136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.580831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39000 (local address 127.11.88.124:44951)
0806 01:07:45.581002 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:45.581008 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:45.581052 (+ 44us) server_negotiation.cc:407] Connection header received
0806 01:07:45.581078 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:45.581080 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:45.581104 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:45.581188 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:45.581927 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.582935 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.583804 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.584261 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.584345 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:45.587090 (+ 2745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:45.587100 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:45.587100 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:45.587107 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:45.588913 (+ 1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.589350 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.589353 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.589353 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.589411 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.589644 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.589645 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.589645 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.589861 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:45.590047 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:45.590095 (+ 48us) server_negotiation.cc:299] Negotiation successful
0806 01:07:45.590171 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":86,"threads_started":1}
I20260806 01:07:45.593246 2061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.586103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49910 (local address 127.11.88.125:41439)
0806 01:07:45.586149 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:45.586152 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:45.586161 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:07:45.586195 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:45.586196 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:45.586204 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:45.586249 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:45.586560 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.587093 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.588080 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.588420 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.588498 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:45.590762 (+ 2264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:45.590763 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:45.590764 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:45.590771 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:45.592108 (+ 1337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.592439 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.592440 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.592441 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.592501 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.592719 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.592720 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.592721 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.592845 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:45.592913 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:45.593073 (+ 160us) server_negotiation.cc:299] Negotiation successful
0806 01:07:45.593149 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 01:07:45.593246 2134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.586010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:41439 (local address 127.0.0.1:49910)
0806 01:07:45.586080 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:45.586092 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:45.586140 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:45.586255 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:45.586256 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:45.586422 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:45.586486 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:45.586488 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.587150 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.587151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:45.587960 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:45.587963 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.588506 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.588507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:45.588574 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:45.588988 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:07:45.588993 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:45.590674 (+ 1681us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:45.592198 (+ 1524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:45.592199 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:45.592200 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:45.592362 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:45.592594 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:45.592595 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:45.592595 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:45.592652 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:45.592927 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:45.592928 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:45.592968 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 01:07:45.593052 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 01:07:45.593148 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260806 01:07:45.593592 2132 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 01:07:45 dist-test-slave-69rg krb5kdc[1898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
Aug 06 01:07:45 dist-test-slave-69rg krb5kdc[1898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978465, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.124@KRBTEST.COM for kudu/127.11.88.124@KRBTEST.COM
I20260806 01:07:45.598206 1984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.591076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32782 (local address 127.11.88.126:46561)
0806 01:07:45.591272 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:45.591273 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:45.591282 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:07:45.591303 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:45.591304 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:45.591313 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:45.591383 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:45.591949 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.592414 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.593092 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.593317 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.593383 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:45.595568 (+ 2185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:45.595570 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:45.595570 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:45.595577 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:45.597019 (+ 1442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.597393 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.597394 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.597395 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.597453 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.597652 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.597653 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.597653 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.597763 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:45.597981 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:45.598017 (+ 36us) server_negotiation.cc:299] Negotiation successful
0806 01:07:45.598101 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174}
I20260806 01:07:45.600322 2136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.593959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39002 (local address 127.11.88.124:44951)
0806 01:07:45.594010 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:45.594012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:45.594020 (+ 8us) server_negotiation.cc:407] Connection header received
0806 01:07:45.594094 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:45.594094 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:45.594105 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:45.594148 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:45.594389 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.594841 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.595530 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.595766 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.595833 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:45.597479 (+ 1646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:45.597480 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:45.597480 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:45.597487 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:45.599112 (+ 1625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.599516 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.599517 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.599517 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.599578 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.599763 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.599764 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.599764 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.599902 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:45.599975 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:45.600116 (+ 141us) server_negotiation.cc:299] Negotiation successful
0806 01:07:45.600235 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":56,"server-negotiator.queue_time_us":35}
I20260806 01:07:45.600368 2134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.593921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44951 (local address 127.0.0.1:39002)
0806 01:07:45.593955 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:45.593965 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:45.594008 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:45.594160 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:45.594161 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:45.594289 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:45.594315 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:45.594316 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.594914 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.594915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:45.595454 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:45.595456 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.595841 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.595842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:45.595888 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:45.596159 (+ 271us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:07:45.596165 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:45.597400 (+ 1235us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:45.599212 (+ 1812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:45.599213 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:45.599213 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:45.599447 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:45.599649 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:45.599650 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:45.599650 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:45.599701 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:45.599964 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:45.599964 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:45.600023 (+ 59us) client_negotiation.cc:769] Sending connection context
0806 01:07:45.600094 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 01:07:45.600191 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17}
I20260806 01:07:45.602169 2132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5c7833bc0e243fc89da9a044c832b5f: Bootstrap starting.
I20260806 01:07:45.603034 2132 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a5c7833bc0e243fc89da9a044c832b5f: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:45.603328 2132 log.cc:824] T 00000000000000000000000000000000 P a5c7833bc0e243fc89da9a044c832b5f: Log is configured to *not* fsync() on all Append() calls
Aug 06 01:07:45 dist-test-slave-69rg krb5kdc[1898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.125@KRBTEST.COM
I20260806 01:07:45.604177 2132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5c7833bc0e243fc89da9a044c832b5f: No bootstrap required, opened a new log
I20260806 01:07:45.606791 2061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.599266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49918 (local address 127.11.88.125:41439)
0806 01:07:45.599306 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:45.599308 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:45.599316 (+ 8us) server_negotiation.cc:407] Connection header received
0806 01:07:45.599337 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:45.599338 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:45.599348 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:45.599415 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:45.600010 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.600625 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.601446 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.601652 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.601723 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:45.604016 (+ 2293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:45.604018 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:45.604018 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:45.604027 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:45.605598 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.605990 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.605992 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.605992 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.606060 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.606248 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.606249 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.606249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.606403 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:45.606585 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:45.606627 (+ 42us) server_negotiation.cc:299] Negotiation successful
0806 01:07:45.606706 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 01:07:45.606700 2132 raft_consensus.cc:348] T 00000000000000000000000000000000 P a5c7833bc0e243fc89da9a044c832b5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944de709a79c43dfaf43ec14f2bec09f" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46561 } } peers { permanent_uuid: "daff1224a70242d5bd3f865eab089d39" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 41439 } } peers { permanent_uuid: "a5c7833bc0e243fc89da9a044c832b5f" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 } }
I20260806 01:07:45.606858 2132 raft_consensus.cc:729] T 00000000000000000000000000000000 P a5c7833bc0e243fc89da9a044c832b5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5c7833bc0e243fc89da9a044c832b5f, State: Initialized, Role: FOLLOWER
I20260806 01:07:45.606942 2132 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5c7833bc0e243fc89da9a044c832b5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944de709a79c43dfaf43ec14f2bec09f" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46561 } } peers { permanent_uuid: "daff1224a70242d5bd3f865eab089d39" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 41439 } } peers { permanent_uuid: "a5c7833bc0e243fc89da9a044c832b5f" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 } }
I20260806 01:07:45.607331 2132 sys_catalog.cc:564] T 00000000000000000000000000000000 P a5c7833bc0e243fc89da9a044c832b5f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:45.607306 2138 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5c7833bc0e243fc89da9a044c832b5f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944de709a79c43dfaf43ec14f2bec09f" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46561 } } peers { permanent_uuid: "daff1224a70242d5bd3f865eab089d39" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 41439 } } peers { permanent_uuid: "a5c7833bc0e243fc89da9a044c832b5f" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 } } }
I20260806 01:07:45.607439 2138 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5c7833bc0e243fc89da9a044c832b5f [sys.catalog]: This master's current role is: FOLLOWER
I20260806 01:07:45.608409 11617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260806 01:07:45.609246 2149 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a5c7833bc0e243fc89da9a044c832b5f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 01:07:45.609295 2149 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 01:07:45.609539 1955 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "944de709a79c43dfaf43ec14f2bec09f"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32782
I20260806 01:07:45.609566 2064 master_runner.cc:186] Error getting master registration for 127.11.88.126:46561: OK, instance_id { permanent_uuid: "944de709a79c43dfaf43ec14f2bec09f" instance_seqno: 1785978465182708 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 01:07:45.611892 2064 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 01:07:45.612130 2056 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 } attempt: 3
Aug 06 01:07:45 dist-test-slave-69rg krb5kdc[1898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978465, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.125@KRBTEST.COM for kudu/127.11.88.124@KRBTEST.COM
I20260806 01:07:45.620306 2058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.612390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44951 (local address 127.0.0.1:39006)
0806 01:07:45.612436 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:45.612449 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:45.612490 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:45.612618 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:45.612618 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:45.612823 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:45.612875 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:45.612878 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.613766 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.613767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:45.614598 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:45.614602 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.615049 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.615050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:45.615118 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:45.615623 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:07:45.615629 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:45.617188 (+ 1559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:45.619107 (+ 1919us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:45.619108 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:45.619108 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:45.619330 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:45.619542 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:45.619542 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:45.619543 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:45.619605 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:45.619974 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:45.619975 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:45.620021 (+ 46us) client_negotiation.cc:769] Sending connection context
0806 01:07:45.620095 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 01:07:45.620193 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260806 01:07:45.620312 2136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.612457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39006 (local address 127.11.88.124:44951)
0806 01:07:45.612509 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:45.612511 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:45.612519 (+ 8us) server_negotiation.cc:407] Connection header received
0806 01:07:45.612540 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:45.612540 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:45.612550 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:45.612612 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:45.612960 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.613679 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.614686 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.614977 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.615037 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:45.617286 (+ 2249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:45.617288 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:45.617288 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:45.617296 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:45.619025 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.619406 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.619407 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.619408 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.619471 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.619672 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.619673 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.619674 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.619892 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:45.619988 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:45.620140 (+ 152us) server_negotiation.cc:299] Negotiation successful
0806 01:07:45.620224 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260806 01:07:45.622231 2056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daff1224a70242d5bd3f865eab089d39: Bootstrap starting.
I20260806 01:07:45.623013 2056 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P daff1224a70242d5bd3f865eab089d39: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:45.623299 2056 log.cc:824] T 00000000000000000000000000000000 P daff1224a70242d5bd3f865eab089d39: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:45.624202 2056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daff1224a70242d5bd3f865eab089d39: No bootstrap required, opened a new log
I20260806 01:07:45.625788 2056 raft_consensus.cc:348] T 00000000000000000000000000000000 P daff1224a70242d5bd3f865eab089d39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944de709a79c43dfaf43ec14f2bec09f" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46561 } } peers { permanent_uuid: "daff1224a70242d5bd3f865eab089d39" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 41439 } } peers { permanent_uuid: "a5c7833bc0e243fc89da9a044c832b5f" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 } }
I20260806 01:07:45.625973 2056 raft_consensus.cc:729] T 00000000000000000000000000000000 P daff1224a70242d5bd3f865eab089d39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daff1224a70242d5bd3f865eab089d39, State: Initialized, Role: FOLLOWER
I20260806 01:07:45.626068 2056 consensus_queue.cc:260] T 00000000000000000000000000000000 P daff1224a70242d5bd3f865eab089d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944de709a79c43dfaf43ec14f2bec09f" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46561 } } peers { permanent_uuid: "daff1224a70242d5bd3f865eab089d39" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 41439 } } peers { permanent_uuid: "a5c7833bc0e243fc89da9a044c832b5f" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 } }
I20260806 01:07:45.626369 2153 sys_catalog.cc:455] T 00000000000000000000000000000000 P daff1224a70242d5bd3f865eab089d39 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944de709a79c43dfaf43ec14f2bec09f" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46561 } } peers { permanent_uuid: "daff1224a70242d5bd3f865eab089d39" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 41439 } } peers { permanent_uuid: "a5c7833bc0e243fc89da9a044c832b5f" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 } } }
I20260806 01:07:45.626487 2056 sys_catalog.cc:564] T 00000000000000000000000000000000 P daff1224a70242d5bd3f865eab089d39 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:45.626493 2153 sys_catalog.cc:458] T 00000000000000000000000000000000 P daff1224a70242d5bd3f865eab089d39 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 01:07:45.627806 1981 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 } attempt: 3
W20260806 01:07:45.628875 2164 catalog_manager.cc:1558] T 00000000000000000000000000000000 P daff1224a70242d5bd3f865eab089d39: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 01:07:45.628929 2164 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 01:07:45.628589 1988 master_runner.cc:186] Error getting master registration for 127.11.88.126:46561: OK, instance_id { permanent_uuid: "944de709a79c43dfaf43ec14f2bec09f" instance_seqno: 1785978465182708 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 01:07:45.631575 1988 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 06 01:07:45 dist-test-slave-69rg krb5kdc[1898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978465, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for kudu/127.11.88.124@KRBTEST.COM
I20260806 01:07:45.636411 1985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.628163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44951 (local address 127.0.0.1:39014)
0806 01:07:45.628217 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:45.628228 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:45.628267 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:45.628431 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:45.628431 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:45.628633 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:45.628688 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:45.628691 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.629731 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.629732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:45.630589 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:45.630592 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.631131 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.631132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:45.631191 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:45.631718 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:07:45.631724 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:45.633257 (+ 1533us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:45.635254 (+ 1997us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:45.635255 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:45.635256 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:45.635493 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:45.635705 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:45.635719 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:45.635719 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:45.635784 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:45.636069 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:45.636070 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:45.636121 (+ 51us) client_negotiation.cc:769] Sending connection context
0806 01:07:45.636191 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 01:07:45.636295 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260806 01:07:45.636431 2136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.628266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39014 (local address 127.11.88.124:44951)
0806 01:07:45.628313 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:45.628315 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:45.628326 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:07:45.628353 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:45.628354 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:45.628365 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:45.628427 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:45.628798 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.629554 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.630692 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.631003 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.631066 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:45.633344 (+ 2278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:45.633345 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:45.633346 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:45.633354 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:45.635162 (+ 1808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.635580 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.635581 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.635582 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.635647 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.635852 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.635852 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.635853 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.635997 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:45.636060 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:45.636231 (+ 171us) server_negotiation.cc:299] Negotiation successful
0806 01:07:45.636333 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 01:07:45.638595 1981 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 944de709a79c43dfaf43ec14f2bec09f: Bootstrap starting.
I20260806 01:07:45.639412 1981 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 944de709a79c43dfaf43ec14f2bec09f: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:45.639750 1981 log.cc:824] T 00000000000000000000000000000000 P 944de709a79c43dfaf43ec14f2bec09f: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:45.640750 1981 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 944de709a79c43dfaf43ec14f2bec09f: No bootstrap required, opened a new log
I20260806 01:07:45.643121 1981 raft_consensus.cc:348] T 00000000000000000000000000000000 P 944de709a79c43dfaf43ec14f2bec09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944de709a79c43dfaf43ec14f2bec09f" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46561 } } peers { permanent_uuid: "daff1224a70242d5bd3f865eab089d39" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 41439 } } peers { permanent_uuid: "a5c7833bc0e243fc89da9a044c832b5f" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 } }
I20260806 01:07:45.643428 1981 raft_consensus.cc:729] T 00000000000000000000000000000000 P 944de709a79c43dfaf43ec14f2bec09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 944de709a79c43dfaf43ec14f2bec09f, State: Initialized, Role: FOLLOWER
I20260806 01:07:45.643635 1981 consensus_queue.cc:260] T 00000000000000000000000000000000 P 944de709a79c43dfaf43ec14f2bec09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944de709a79c43dfaf43ec14f2bec09f" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46561 } } peers { permanent_uuid: "daff1224a70242d5bd3f865eab089d39" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 41439 } } peers { permanent_uuid: "a5c7833bc0e243fc89da9a044c832b5f" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 } }
I20260806 01:07:45.644141 2167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 944de709a79c43dfaf43ec14f2bec09f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944de709a79c43dfaf43ec14f2bec09f" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46561 } } peers { permanent_uuid: "daff1224a70242d5bd3f865eab089d39" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 41439 } } peers { permanent_uuid: "a5c7833bc0e243fc89da9a044c832b5f" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 } } }
I20260806 01:07:45.644237 1955 raft_consensus.cc:482] T 00000000000000000000000000000000 P 944de709a79c43dfaf43ec14f2bec09f [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 01:07:45.644271 2167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 944de709a79c43dfaf43ec14f2bec09f [sys.catalog]: This master's current role is: FOLLOWER
I20260806 01:07:45.644302 1955 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 944de709a79c43dfaf43ec14f2bec09f [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:45.645150 1955 raft_consensus.cc:504] T 00000000000000000000000000000000 P 944de709a79c43dfaf43ec14f2bec09f [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944de709a79c43dfaf43ec14f2bec09f" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46561 } } peers { permanent_uuid: "daff1224a70242d5bd3f865eab089d39" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 41439 } } peers { permanent_uuid: "a5c7833bc0e243fc89da9a044c832b5f" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 } }
I20260806 01:07:45.645402 1955 leader_election.cc:288] T 00000000000000000000000000000000 P 944de709a79c43dfaf43ec14f2bec09f [CANDIDATE]: Term 1 election: Requested vote from peers daff1224a70242d5bd3f865eab089d39 (127.11.88.125:41439), a5c7833bc0e243fc89da9a044c832b5f (127.11.88.124:44951)
I20260806 01:07:45.645838 2030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "944de709a79c43dfaf43ec14f2bec09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "daff1224a70242d5bd3f865eab089d39"
I20260806 01:07:45.645982 2030 raft_consensus.cc:3037] T 00000000000000000000000000000000 P daff1224a70242d5bd3f865eab089d39 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:45.645928 2106 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "944de709a79c43dfaf43ec14f2bec09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a5c7833bc0e243fc89da9a044c832b5f"
I20260806 01:07:45.646059 2106 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a5c7833bc0e243fc89da9a044c832b5f [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:45.646860 2030 raft_consensus.cc:2454] T 00000000000000000000000000000000 P daff1224a70242d5bd3f865eab089d39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 944de709a79c43dfaf43ec14f2bec09f in term 1.
I20260806 01:07:45.646991 2106 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a5c7833bc0e243fc89da9a044c832b5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 944de709a79c43dfaf43ec14f2bec09f in term 1.
I20260806 01:07:45.647104 1931 leader_election.cc:302] T 00000000000000000000000000000000 P 944de709a79c43dfaf43ec14f2bec09f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 944de709a79c43dfaf43ec14f2bec09f, daff1224a70242d5bd3f865eab089d39; no voters:
I20260806 01:07:45.647439 1981 sys_catalog.cc:564] T 00000000000000000000000000000000 P 944de709a79c43dfaf43ec14f2bec09f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:45.648094 2167 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 944de709a79c43dfaf43ec14f2bec09f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:45.648267 2167 raft_consensus.cc:686] T 00000000000000000000000000000000 P 944de709a79c43dfaf43ec14f2bec09f [term 1 LEADER]: Becoming Leader. State: Replica: 944de709a79c43dfaf43ec14f2bec09f, State: Running, Role: LEADER
I20260806 01:07:45.648361 2167 consensus_queue.cc:237] T 00000000000000000000000000000000 P 944de709a79c43dfaf43ec14f2bec09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944de709a79c43dfaf43ec14f2bec09f" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46561 } } peers { permanent_uuid: "daff1224a70242d5bd3f865eab089d39" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 41439 } } peers { permanent_uuid: "a5c7833bc0e243fc89da9a044c832b5f" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 } }
I20260806 01:07:45.648828 2167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 944de709a79c43dfaf43ec14f2bec09f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 944de709a79c43dfaf43ec14f2bec09f. Latest consensus state: current_term: 1 leader_uuid: "944de709a79c43dfaf43ec14f2bec09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944de709a79c43dfaf43ec14f2bec09f" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46561 } } peers { permanent_uuid: "daff1224a70242d5bd3f865eab089d39" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 41439 } } peers { permanent_uuid: "a5c7833bc0e243fc89da9a044c832b5f" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 } } }
I20260806 01:07:45.648908 2167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 944de709a79c43dfaf43ec14f2bec09f [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:45.649106 2184 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:07:45.650457 2184 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:07:45.654906 2106 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a5c7833bc0e243fc89da9a044c832b5f [term 1 FOLLOWER]: Refusing update from remote peer 944de709a79c43dfaf43ec14f2bec09f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:07:45.655222 2167 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 944de709a79c43dfaf43ec14f2bec09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c7833bc0e243fc89da9a044c832b5f" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:07:45.655362 2030 raft_consensus.cc:1261] T 00000000000000000000000000000000 P daff1224a70242d5bd3f865eab089d39 [term 1 FOLLOWER]: Refusing update from remote peer 944de709a79c43dfaf43ec14f2bec09f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:07:45.655686 2167 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 944de709a79c43dfaf43ec14f2bec09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "daff1224a70242d5bd3f865eab089d39" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 41439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:07:45.656702 2138 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5c7833bc0e243fc89da9a044c832b5f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 944de709a79c43dfaf43ec14f2bec09f. Latest consensus state: current_term: 1 leader_uuid: "944de709a79c43dfaf43ec14f2bec09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944de709a79c43dfaf43ec14f2bec09f" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46561 } } peers { permanent_uuid: "daff1224a70242d5bd3f865eab089d39" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 41439 } } peers { permanent_uuid: "a5c7833bc0e243fc89da9a044c832b5f" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 } } }
I20260806 01:07:45.656810 2138 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5c7833bc0e243fc89da9a044c832b5f [sys.catalog]: This master's current role is: FOLLOWER
I20260806 01:07:45.659068 2153 sys_catalog.cc:455] T 00000000000000000000000000000000 P daff1224a70242d5bd3f865eab089d39 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 944de709a79c43dfaf43ec14f2bec09f. Latest consensus state: current_term: 1 leader_uuid: "944de709a79c43dfaf43ec14f2bec09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944de709a79c43dfaf43ec14f2bec09f" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46561 } } peers { permanent_uuid: "daff1224a70242d5bd3f865eab089d39" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 41439 } } peers { permanent_uuid: "a5c7833bc0e243fc89da9a044c832b5f" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 } } }
I20260806 01:07:45.659174 2153 sys_catalog.cc:458] T 00000000000000000000000000000000 P daff1224a70242d5bd3f865eab089d39 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 01:07:45.660105 2167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 944de709a79c43dfaf43ec14f2bec09f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "944de709a79c43dfaf43ec14f2bec09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944de709a79c43dfaf43ec14f2bec09f" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46561 } } peers { permanent_uuid: "daff1224a70242d5bd3f865eab089d39" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 41439 } } peers { permanent_uuid: "a5c7833bc0e243fc89da9a044c832b5f" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 } } }
I20260806 01:07:45.660205 2167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 944de709a79c43dfaf43ec14f2bec09f [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:45.660677 2153 sys_catalog.cc:455] T 00000000000000000000000000000000 P daff1224a70242d5bd3f865eab089d39 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "944de709a79c43dfaf43ec14f2bec09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944de709a79c43dfaf43ec14f2bec09f" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46561 } } peers { permanent_uuid: "daff1224a70242d5bd3f865eab089d39" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 41439 } } peers { permanent_uuid: "a5c7833bc0e243fc89da9a044c832b5f" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 } } }
I20260806 01:07:45.660763 2153 sys_catalog.cc:458] T 00000000000000000000000000000000 P daff1224a70242d5bd3f865eab089d39 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 01:07:45.660996 2194 mvcc.cc:205] Tried to move back new op lower bound from 7315367795319140352 to 7315367795296493568. Current Snapshot: MvccSnapshot[applied={T|T < 7315367795319140352}]
I20260806 01:07:45.661128 2184 catalog_manager.cc:1347] Generated new cluster ID: 233358cc3caf45589eb35c23083b792b
I20260806 01:07:45.661230 2184 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:07:45.667322 2138 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5c7833bc0e243fc89da9a044c832b5f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "944de709a79c43dfaf43ec14f2bec09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944de709a79c43dfaf43ec14f2bec09f" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46561 } } peers { permanent_uuid: "daff1224a70242d5bd3f865eab089d39" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 41439 } } peers { permanent_uuid: "a5c7833bc0e243fc89da9a044c832b5f" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 } } }
I20260806 01:07:45.667495 2138 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5c7833bc0e243fc89da9a044c832b5f [sys.catalog]: This master's current role is: FOLLOWER
I20260806 01:07:45.667603 2192 mvcc.cc:205] Tried to move back new op lower bound from 7315367795319140352 to 7315367795296493568. Current Snapshot: MvccSnapshot[applied={T|T < 7315367795319140352}]
I20260806 01:07:45.667968 2167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 944de709a79c43dfaf43ec14f2bec09f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "944de709a79c43dfaf43ec14f2bec09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "944de709a79c43dfaf43ec14f2bec09f" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 46561 } } peers { permanent_uuid: "daff1224a70242d5bd3f865eab089d39" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 41439 } } peers { permanent_uuid: "a5c7833bc0e243fc89da9a044c832b5f" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44951 } } }
I20260806 01:07:45.668074 2167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 944de709a79c43dfaf43ec14f2bec09f [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:45.671167 1984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.654146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32788 (local address 127.11.88.126:46561)
0806 01:07:45.654193 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:45.654195 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:45.662114 (+ 7919us) server_negotiation.cc:407] Connection header received
0806 01:07:45.662230 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:45.662231 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:45.662243 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:45.662274 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:45.663141 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.663894 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.664991 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.665297 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.665342 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:45.667109 (+ 1767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:45.667110 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:45.667110 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:45.667118 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:45.669025 (+ 1907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.670287 (+ 1262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.670289 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.670289 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.670351 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.670566 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.670567 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.670568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.670693 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:45.670790 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:45.670982 (+ 192us) server_negotiation.cc:299] Negotiation successful
0806 01:07:45.671072 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 01:07:45.676819 2061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.654587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49922 (local address 127.11.88.125:41439)
0806 01:07:45.654627 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:45.654629 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:45.668392 (+ 13763us) server_negotiation.cc:407] Connection header received
0806 01:07:45.668717 (+ 325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:45.668719 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:45.668732 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:45.668798 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:45.670249 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.670996 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.671988 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.672288 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.672333 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:45.673908 (+ 1575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:45.673910 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:45.673910 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:45.673918 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:45.675567 (+ 1649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.675977 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.675978 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.675978 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.676033 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.676222 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.676223 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.676224 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.676347 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:45.676441 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:45.676631 (+ 190us) server_negotiation.cc:299] Negotiation successful
0806 01:07:45.676710 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 01:07:45.680227 2184 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:07:45.680965 2184 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:07:45.683813 2136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:45.654355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39028 (local address 127.11.88.124:44951)
0806 01:07:45.654407 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:45.654410 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:45.668556 (+ 14146us) server_negotiation.cc:407] Connection header received
0806 01:07:45.668876 (+ 320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:45.668877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:45.668889 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:45.668921 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:45.671989 (+ 3068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.672656 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.677959 (+ 5303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:45.678286 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:45.678334 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:45.680823 (+ 2489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:45.680825 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:45.680825 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:45.680832 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:45.682569 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.682954 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.682955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.682955 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.683011 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:45.683200 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:45.683201 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:45.683201 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:45.683324 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:45.683419 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:45.683637 (+ 218us) server_negotiation.cc:299] Negotiation successful
0806 01:07:45.683716 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260806 01:07:45.692683 2184 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 944de709a79c43dfaf43ec14f2bec09f: Generated new TSK 0
I20260806 01:07:45.693929 2184 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 01:07:45.731318 2061 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:07:45.729453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49932 (local address 127.11.88.125:41439)
0806 01:07:45.729500 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:45.729503 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:45.730598 (+ 1095us) server_negotiation.cc:407] Connection header received
0806 01:07:45.730716 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:45.730718 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:45.730731 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:45.730763 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:45.731250 (+ 487us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49932: BlockingRecv error: recv got EOF from 127.0.0.1:49932 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260806 01:07:45.732323 1984 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:07:45.729946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32790 (local address 127.11.88.126:46561)
0806 01:07:45.729990 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:45.729992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:45.731756 (+ 1764us) server_negotiation.cc:407] Connection header received
0806 01:07:45.731862 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:45.731864 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:45.731876 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:45.731907 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:45.732253 (+ 346us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32790: BlockingRecv error: recv got EOF from 127.0.0.1:32790 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260806 01:07:45.733290 2136 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:07:45.730285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39036 (local address 127.11.88.124:44951)
0806 01:07:45.730330 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:45.730332 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:45.732719 (+ 2387us) server_negotiation.cc:407] Connection header received
0806 01:07:45.732860 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:45.732861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:45.732873 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:45.732904 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:45.733230 (+ 326us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39036: BlockingRecv error: recv got EOF from 127.0.0.1:39036 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260806 01:07:45.735702 2061 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:07:45.734905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49942 (local address 127.11.88.125:41439)
0806 01:07:45.734946 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:45.734948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:45.735155 (+ 207us) server_negotiation.cc:407] Connection header received
0806 01:07:45.735266 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:45.735267 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:45.735286 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:45.735317 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:45.735649 (+ 332us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49942: BlockingRecv error: recv got EOF from 127.0.0.1:49942 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260806 01:07:45.739012 2061 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:07:45.738161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49944 (local address 127.11.88.125:41439)
0806 01:07:45.738197 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:45.738199 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:45.738454 (+ 255us) server_negotiation.cc:407] Connection header received
0806 01:07:45.738569 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:45.738570 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:45.738581 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:45.738612 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:45.738962 (+ 350us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49944: BlockingRecv error: recv got EOF from 127.0.0.1:49944 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260806 01:07:45.743191 2061 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:07:45.742379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49956 (local address 127.11.88.125:41439)
0806 01:07:45.742418 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:45.742419 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:45.742681 (+ 262us) server_negotiation.cc:407] Connection header received
0806 01:07:45.742782 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:45.742784 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:45.742794 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:45.742823 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:45.743144 (+ 321us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49956: BlockingRecv error: recv got EOF from 127.0.0.1:49956 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260806 01:07:45.749387 2061 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:07:45.748495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49958 (local address 127.11.88.125:41439)
0806 01:07:45.748533 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:45.748535 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:45.748831 (+ 296us) server_negotiation.cc:407] Connection header received
0806 01:07:45.748935 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:45.748937 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:45.748949 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:45.748980 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:45.749332 (+ 352us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49958: BlockingRecv error: recv got EOF from 127.0.0.1:49958 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260806 01:07:45.760035 2061 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:07:45.758938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49960 (local address 127.11.88.125:41439)
0806 01:07:45.758986 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:45.758988 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:45.759308 (+ 320us) server_negotiation.cc:407] Connection header received
0806 01:07:45.759421 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:45.759422 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:45.759434 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:45.759465 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:45.759969 (+ 504us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49960: BlockingRecv error: recv got EOF from 127.0.0.1:49960 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260806 01:07:45.778616 2061 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:07:45.777593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49970 (local address 127.11.88.125:41439)
0806 01:07:45.777648 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:45.777650 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:45.777977 (+ 327us) server_negotiation.cc:407] Connection header received
0806 01:07:45.778096 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:45.778098 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:45.778110 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:45.778139 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:45.778556 (+ 417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49970: BlockingRecv error: recv got EOF from 127.0.0.1:49970 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260806 01:07:45.813172 2061 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:07:45.812308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49972 (local address 127.11.88.125:41439)
0806 01:07:45.812370 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:45.812372 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:45.812526 (+ 154us) server_negotiation.cc:407] Connection header received
0806 01:07:45.812631 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:45.812632 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:45.812646 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:45.812721 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:45.813102 (+ 381us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49972: BlockingRecv error: recv got EOF from 127.0.0.1:49972 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260806 01:07:45.879383 2061 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:07:45.878508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49978 (local address 127.11.88.125:41439)
0806 01:07:45.878620 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:45.878622 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:45.878642 (+ 20us) server_negotiation.cc:407] Connection header received
0806 01:07:45.878722 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:45.878723 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:45.878733 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:45.878803 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:45.879288 (+ 485us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49978: BlockingRecv error: recv got EOF from 127.0.0.1:49978 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260806 01:07:46.009932 2061 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:07:46.008870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49990 (local address 127.11.88.125:41439)
0806 01:07:46.008950 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:46.008952 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:46.009011 (+ 59us) server_negotiation.cc:407] Connection header received
0806 01:07:46.009097 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:46.009098 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:46.009108 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:46.009157 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:46.009794 (+ 637us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49990: BlockingRecv error: recv got EOF from 127.0.0.1:49990 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260806 01:07:46.268256 2061 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:07:46.267384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49994 (local address 127.11.88.125:41439)
0806 01:07:46.267494 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:46.267496 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:46.267508 (+ 12us) server_negotiation.cc:407] Connection header received
0806 01:07:46.267582 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:46.267583 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:46.267595 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:46.267655 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:46.268162 (+ 507us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49994: BlockingRecv error: recv got EOF from 127.0.0.1:49994 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 01:07:46.610344 2149 catalog_manager.cc:1259] Loaded cluster ID: 233358cc3caf45589eb35c23083b792b
I20260806 01:07:46.610457 2149 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a5c7833bc0e243fc89da9a044c832b5f: loading cluster ID for follower catalog manager: success
I20260806 01:07:46.611328 2149 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a5c7833bc0e243fc89da9a044c832b5f: acquiring CA information for follower catalog manager: success
I20260806 01:07:46.611653 2149 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a5c7833bc0e243fc89da9a044c832b5f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 01:07:46.629400 2164 catalog_manager.cc:1259] Loaded cluster ID: 233358cc3caf45589eb35c23083b792b
I20260806 01:07:46.629508 2164 catalog_manager.cc:1552] T 00000000000000000000000000000000 P daff1224a70242d5bd3f865eab089d39: loading cluster ID for follower catalog manager: success
I20260806 01:07:46.630385 2164 catalog_manager.cc:1574] T 00000000000000000000000000000000 P daff1224a70242d5bd3f865eab089d39: acquiring CA information for follower catalog manager: success
I20260806 01:07:46.630688 2164 catalog_manager.cc:1602] T 00000000000000000000000000000000 P daff1224a70242d5bd3f865eab089d39: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 01:07:46.784240 2266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:46.781517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50008 (local address 127.11.88.125:41439)
0806 01:07:46.781662 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:46.781664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:46.781715 (+ 51us) server_negotiation.cc:407] Connection header received
0806 01:07:46.781798 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:46.781799 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:46.781879 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:46.781957 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:07:46.782092 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:46.782633 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:46.783376 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:46.783575 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:46.783629 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:46.783792 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:07:46.783906 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:07:46.783968 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:46.784052 (+ 84us) server_negotiation.cc:299] Negotiation successful
0806 01:07:46.784070 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":77,"threads_started":1}
I20260806 01:07:46.788578 2272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:46.786139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39038 (local address 127.11.88.124:44951)
0806 01:07:46.786258 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:46.786260 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:46.786269 (+ 9us) server_negotiation.cc:407] Connection header received
0806 01:07:46.786347 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:46.786348 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:46.786394 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:46.786477 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:07:46.786597 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:46.787076 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:46.787810 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:46.788024 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:46.788098 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:46.788244 (+ 146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:07:46.788345 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:07:46.788425 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:46.788465 (+ 40us) server_negotiation.cc:299] Negotiation successful
0806 01:07:46.788486 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":55,"threads_started":1}
I20260806 01:07:46.793174 2272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:46.790560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39050 (local address 127.11.88.124:44951)
0806 01:07:46.790596 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:46.790597 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:46.790701 (+ 104us) server_negotiation.cc:407] Connection header received
0806 01:07:46.790814 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:46.790814 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:46.790826 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:46.790853 (+ 27us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:07:46.791043 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:46.791730 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:46.792448 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:46.792702 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:46.792765 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:46.792907 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:07:46.792937 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:07:46.792987 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:46.793066 (+ 79us) server_negotiation.cc:299] Negotiation successful
0806 01:07:46.793085 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260806 01:07:46.793439 2266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:46.790342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50012 (local address 127.11.88.125:41439)
0806 01:07:46.790440 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:46.790442 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:46.790570 (+ 128us) server_negotiation.cc:407] Connection header received
0806 01:07:46.790617 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:46.790618 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:46.790630 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:46.790735 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:07:46.790881 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:46.791649 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:46.792618 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:46.792919 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:46.792992 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:46.793134 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:07:46.793178 (+ 44us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:07:46.793207 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:46.793328 (+ 121us) server_negotiation.cc:299] Negotiation successful
0806 01:07:46.793352 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 01:07:46.793574 2279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:46.790334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32806 (local address 127.11.88.126:46561)
0806 01:07:46.790571 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:46.790573 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:46.790581 (+ 8us) server_negotiation.cc:407] Connection header received
0806 01:07:46.790631 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:46.790632 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:46.790691 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:46.790801 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:07:46.790919 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:46.791415 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:46.792500 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:46.792817 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:46.793032 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:46.793109 (+ 77us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:07:46.793216 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:07:46.793426 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:46.793445 (+ 19us) server_negotiation.cc:299] Negotiation successful
0806 01:07:46.793470 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":59,"threads_started":1}
I20260806 01:07:46.795147 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 1912
I20260806 01:07:46.801936 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 1988
I20260806 01:07:46.810184 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 2064
2026-08-06T01:07:46Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2976 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 01:07:46 dist-test-slave-69rg krb5kdc[2283](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 01:07:46 dist-test-slave-69rg krb5kdc[2283](info): set up 2 sockets
Aug 06 01:07:46 dist-test-slave-69rg krb5kdc[2283](info): commencing operation
krb5kdc: starting...
W20260806 01:07:47.943025 11617 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/krb5kdc/test-user.keytab.
Aug 06 01:07:48 dist-test-slave-69rg krb5kdc[2283](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978468, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T01:07:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T01:07:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.88.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
Entry for principal kudu/127.11.88.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab.
I20260806 01:07:48.074307 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:42481
--webserver_interface=127.11.88.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:35881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:42481,127.11.88.125:33267,127.11.88.124:44389
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 01:07:48.158187 2296 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 01:07:48.158414 2296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:48.158433 2296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:48.158454 2296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:48.159569 2296 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:48.159607 2296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:48.159622 2296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:48.159636 2296 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:48.159647 2296 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:48.161206 2296 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:35881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:42481,127.11.88.125:33267,127.11.88.124:44389
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.126.keytab
--principal=kudu/127.11.88.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.126:42481
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.88.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2296
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:48.161429 2296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:48.161609 2296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:48.166445 2302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:48.166460 2301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:48.166435 2304 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:48.166726 2296 server_base.cc:1034] running on GCE node
I20260806 01:07:48.166970 2296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:48.167289 2296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:48.168469 2296 hybrid_clock.cc:648] HybridClock initialized: now 1785978468168456 us; error 46 us; skew 500 ppm
Aug 06 01:07:48 dist-test-slave-69rg krb5kdc[2283](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978468, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:48.177395 2296 init.cc:377] Logged in from keytab as kudu/127.11.88.126@KRBTEST.COM (short username kudu)
I20260806 01:07:48.178001 2296 webserver.cc:460] Webserver started at http://127.11.88.126:46859/ using document root <none> and password file <none>
I20260806 01:07:48.178287 2296 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:48.178357 2296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:48.178509 2296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:48.179628 2296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-0/data/instance:
uuid: "26a019ee29864465b9225b4eddc1daba"
format_stamp: "Formatted at 2026-08-06 01:07:48 on dist-test-slave-69rg"
server_key: "2781d7a251bd796508e503ebac1f1781"
server_key_iv: "1abd85aa4888c42744ad9db6273e2adc"
server_key_version: "encryptionkey@0"
I20260806 01:07:48.180007 2296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-0/wal/instance:
uuid: "26a019ee29864465b9225b4eddc1daba"
format_stamp: "Formatted at 2026-08-06 01:07:48 on dist-test-slave-69rg"
server_key: "2781d7a251bd796508e503ebac1f1781"
server_key_iv: "1abd85aa4888c42744ad9db6273e2adc"
server_key_version: "encryptionkey@0"
I20260806 01:07:48.181463 2296 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 01:07:48.182363 2311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:48.182560 2296 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 01:07:48.182665 2296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-0/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-0/wal
uuid: "26a019ee29864465b9225b4eddc1daba"
format_stamp: "Formatted at 2026-08-06 01:07:48 on dist-test-slave-69rg"
server_key: "2781d7a251bd796508e503ebac1f1781"
server_key_iv: "1abd85aa4888c42744ad9db6273e2adc"
server_key_version: "encryptionkey@0"
I20260806 01:07:48.182763 2296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:48.201786 2296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:48.204123 2296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:48.204313 2296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:48.208840 2296 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.126:42481
I20260806 01:07:48.208875 2366 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.126:42481 every 8 connection(s)
I20260806 01:07:48.209240 2296 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-0/data/info.pb
I20260806 01:07:48.210212 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 2296
I20260806 01:07:48.210320 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-0/wal/instance
I20260806 01:07:48.210471 2367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:48.210553 11617 external_mini_cluster.cc:1428] Setting key 0dabfd887b97534f22cf29c186353dab
I20260806 01:07:48.212921 2367 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42481 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.88.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.125@KRBTEST.COM" created.
Aug 06 01:07:48 dist-test-slave-69rg krb5kdc[2283](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978468, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:07:48.227933 2370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.213736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42481 (local address 127.0.0.1:59138)
0806 01:07:48.213986 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:48.214033 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:48.214575 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:48.214937 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:48.214941 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:48.215377 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:48.215617 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:48.215623 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.216724 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.216725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:48.217992 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:48.217996 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.218646 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.218648 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:48.218753 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:48.219381 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:07:48.219393 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:48.223901 (+ 4508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:48.226138 (+ 2237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:48.226160 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:48.226162 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:48.226366 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:48.226658 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:48.226658 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:48.226658 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:48.226742 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:48.227326 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:48.227334 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:48.227404 (+ 70us) client_negotiation.cc:769] Sending connection context
0806 01:07:48.227535 (+ 131us) client_negotiation.cc:240] Negotiation successful
0806 01:07:48.227748 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"mutex_wait_us":3,"thread_start_us":136,"threads_started":1}
I20260806 01:07:48.227995 2371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.213781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59138 (local address 127.11.88.126:42481)
0806 01:07:48.214023 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:48.214034 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:48.214195 (+ 161us) server_negotiation.cc:407] Connection header received
0806 01:07:48.214758 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:48.214760 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:48.214783 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:48.214877 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:48.215731 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.216539 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.218170 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.218518 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.218620 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:48.224026 (+ 5406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:48.224036 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:48.224036 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:48.224045 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:48.226035 (+ 1990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.226465 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.226469 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.226469 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.226590 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.226816 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.226817 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.226817 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.227157 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:48.227307 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:48.227615 (+ 308us) server_negotiation.cc:299] Negotiation successful
0806 01:07:48.227843 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":113,"server-negotiator.queue_time_us":212,"thread_start_us":136,"threads_started":1}
I20260806 01:07:48.228848 2367 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.125" port: 33267 } has no permanent_uuid. Determining permanent_uuid...
I20260806 01:07:48.229269 2370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.229136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:33267 (local address 127.0.0.1:50332)
0806 01:07:48.229191 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:48.229246 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.125:33267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260806 01:07:48.229456 2312 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.88.125:33267: connect: Connection refused (error 111)
I20260806 01:07:48.229936 2370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.229845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:33267 (local address 127.0.0.1:50342)
0806 01:07:48.229881 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:48.229913 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.125:33267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260806 01:07:48.230123 2367 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.88.125:33267: Network error: Client connection negotiation failed: client connection to 127.11.88.125:33267: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.125.keytab.
Entry for principal kudu/127.11.88.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.125.keytab.
I20260806 01:07:48.240873 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.125:33267
--webserver_interface=127.11.88.125
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.125.keytab
--principal=kudu/127.11.88.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:35881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:42481,127.11.88.125:33267,127.11.88.124:44389
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 01:07:48.279362 2367 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.88.125" port: 33267 } attempt: 1
I20260806 01:07:48.279906 2370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.279760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:33267 (local address 127.0.0.1:50350)
0806 01:07:48.279830 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:48.279872 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.125:33267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260806 01:07:48.280258 2370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.280161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:33267 (local address 127.0.0.1:50358)
0806 01:07:48.280207 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:48.280234 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.125:33267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260806 01:07:48.280344 2367 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.88.125:33267: Network error: Client connection negotiation failed: client connection to 127.11.88.125:33267: connect: Connection refused (error 111)
W20260806 01:07:48.328236 2374 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 01:07:48.328516 2374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:48.328554 2374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:48.328599 2374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:48.329746 2374 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:48.329821 2374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:48.329876 2374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:48.329921 2374 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:48.329949 2374 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:48.331511 2374 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:35881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:42481,127.11.88.125:33267,127.11.88.124:44389
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.125.keytab
--principal=kudu/127.11.88.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.125:33267
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.88.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:48.331799 2374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:48.332046 2374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:48.337405 2380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:48.337441 2374 server_base.cc:1034] running on GCE node
W20260806 01:07:48.337394 2382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:48.337405 2379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:48.337944 2374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:48.338290 2374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:48.339509 2374 hybrid_clock.cc:648] HybridClock initialized: now 1785978468339487 us; error 31 us; skew 500 ppm
Aug 06 01:07:48 dist-test-slave-69rg krb5kdc[2283](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978468, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:48.342432 2374 init.cc:377] Logged in from keytab as kudu/127.11.88.125@KRBTEST.COM (short username kudu)
I20260806 01:07:48.342872 2374 webserver.cc:460] Webserver started at http://127.11.88.125:39221/ using document root <none> and password file <none>
I20260806 01:07:48.343137 2374 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:48.343189 2374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:48.343322 2374 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:48.344417 2374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-1/data/instance:
uuid: "f9253185f9dc4bd996020389699b43b4"
format_stamp: "Formatted at 2026-08-06 01:07:48 on dist-test-slave-69rg"
server_key: "79ca23607fcf259afa0b33e810cdde81"
server_key_iv: "13604bc94f8643abb434d6236921bf2e"
server_key_version: "encryptionkey@0"
I20260806 01:07:48.344787 2374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-1/wal/instance:
uuid: "f9253185f9dc4bd996020389699b43b4"
format_stamp: "Formatted at 2026-08-06 01:07:48 on dist-test-slave-69rg"
server_key: "79ca23607fcf259afa0b33e810cdde81"
server_key_iv: "13604bc94f8643abb434d6236921bf2e"
server_key_version: "encryptionkey@0"
I20260806 01:07:48.346259 2374 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 01:07:48.347208 2389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:48.347429 2374 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:07:48.347543 2374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-1/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-1/wal
uuid: "f9253185f9dc4bd996020389699b43b4"
format_stamp: "Formatted at 2026-08-06 01:07:48 on dist-test-slave-69rg"
server_key: "79ca23607fcf259afa0b33e810cdde81"
server_key_iv: "13604bc94f8643abb434d6236921bf2e"
server_key_version: "encryptionkey@0"
I20260806 01:07:48.347625 2374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:48.348472 2367 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.88.125" port: 33267 } attempt: 2
I20260806 01:07:48.349208 2370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.349057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:33267 (local address 127.0.0.1:50374)
0806 01:07:48.349118 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:48.349159 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.125:33267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260806 01:07:48.349548 2370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.349458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:33267 (local address 127.0.0.1:50388)
0806 01:07:48.349502 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:48.349529 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.125:33267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260806 01:07:48.349661 2367 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.88.125:33267: Network error: Client connection negotiation failed: client connection to 127.11.88.125:33267: connect: Connection refused (error 111)
I20260806 01:07:48.355374 2374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:48.357499 2374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:48.357653 2374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:48.361732 2374 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.125:33267
I20260806 01:07:48.361809 2441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.125:33267 every 8 connection(s)
I20260806 01:07:48.362188 2374 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-1/data/info.pb
I20260806 01:07:48.363236 2442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:48.364791 2442 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42481 } has no permanent_uuid. Determining permanent_uuid...
I20260806 01:07:48.369762 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 2374
I20260806 01:07:48.369918 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-1/wal/instance
I20260806 01:07:48.370216 11617 external_mini_cluster.cc:1428] Setting key 53e0094a55e50fb0d02119c23ae7f4ab
Aug 06 01:07:48 dist-test-slave-69rg krb5kdc[2283](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978468, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.125@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:07:48.374688 2371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.365495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59148 (local address 127.11.88.126:42481)
0806 01:07:48.365569 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:48.365573 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:48.365805 (+ 232us) server_negotiation.cc:407] Connection header received
0806 01:07:48.366406 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:48.366408 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:48.366433 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:48.366498 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:48.367164 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.367688 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.368816 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.369025 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.369077 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:48.371591 (+ 2514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:48.371592 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:48.371592 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:48.371604 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:48.373070 (+ 1466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.373631 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.373633 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.373633 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.373700 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.374016 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.374017 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.374017 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.374143 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:48.374205 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:48.374537 (+ 332us) server_negotiation.cc:299] Negotiation successful
0806 01:07:48.374616 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 01:07:48.374991 2444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.365467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42481 (local address 127.0.0.1:59148)
0806 01:07:48.365685 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:48.365723 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:48.366283 (+ 560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:48.366575 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:48.366578 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:48.366828 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:48.367026 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:48.367030 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.367795 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.367796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:48.368731 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:48.368734 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.369132 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.369133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:48.369263 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:48.369795 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:07:48.369806 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:48.371480 (+ 1674us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:48.373204 (+ 1724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:48.373214 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:48.373216 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:48.373542 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:48.373781 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:48.373782 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:48.373782 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:48.373947 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:48.374214 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:48.374220 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:48.374386 (+ 166us) client_negotiation.cc:769] Sending connection context
0806 01:07:48.374491 (+ 105us) client_negotiation.cc:240] Negotiation successful
0806 01:07:48.374700 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":106,"threads_started":1}
I20260806 01:07:48.375713 2442 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.125" port: 33267 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.88.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.88.124@KRBTEST.COM" created.
Aug 06 01:07:48 dist-test-slave-69rg krb5kdc[2283](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978468, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.125@KRBTEST.COM for kudu/127.11.88.125@KRBTEST.COM
I20260806 01:07:48.387516 2444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.376024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:33267 (local address 127.0.0.1:50392)
0806 01:07:48.376110 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:48.376123 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:48.376169 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:48.376507 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:48.376508 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:48.376637 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:48.376689 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:48.376690 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.378070 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.378071 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:48.378664 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:48.378667 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.379359 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.379360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:48.379415 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:48.379855 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:07:48.379860 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:48.383823 (+ 3963us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:48.386281 (+ 2458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:48.386283 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:48.386283 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:48.386513 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:48.386793 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:48.386794 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:48.386794 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:48.386858 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:48.387258 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:48.387259 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:48.387297 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 01:07:48.387349 (+ 52us) client_negotiation.cc:240] Negotiation successful
0806 01:07:48.387442 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260806 01:07:48.387748 2447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.376138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50392 (local address 127.11.88.125:33267)
0806 01:07:48.376325 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:48.376330 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:48.376356 (+ 26us) server_negotiation.cc:407] Connection header received
0806 01:07:48.376382 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:48.376384 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:48.376402 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:48.376497 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:48.376769 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.377941 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.378758 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.379279 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.379356 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:48.383951 (+ 4595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:48.383974 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:48.383974 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:48.383982 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:48.386149 (+ 2167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.386613 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.386617 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.386618 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.386701 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.386934 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.386935 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.386935 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.387183 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:48.387280 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:48.387389 (+ 109us) server_negotiation.cc:299] Negotiation successful
0806 01:07:48.387557 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":150,"thread_start_us":98,"threads_started":1}
I20260806 01:07:48.388463 2442 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44389 } has no permanent_uuid. Determining permanent_uuid...
I20260806 01:07:48.388840 2444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.388714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44389 (local address 127.0.0.1:46218)
0806 01:07:48.388766 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:48.388820 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260806 01:07:48.389024 2392 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44389: connect: Connection refused (error 111)
I20260806 01:07:48.389521 2444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.389433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44389 (local address 127.0.0.1:46220)
0806 01:07:48.389480 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:48.389505 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260806 01:07:48.389654 2442 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.88.124:44389: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44389: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.88.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.124.keytab.
Entry for principal kudu/127.11.88.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.124.keytab.
I20260806 01:07:48.402086 11617 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7A9gSt/build/release/bin/kudu
/tmp/dist-test-task7A9gSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.124:44389
--webserver_interface=127.11.88.124
--webserver_port=0
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.124.keytab
--principal=kudu/127.11.88.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.88.84:35881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.88.126:42481,127.11.88.125:33267,127.11.88.124:44389
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 01:07:48.438956 2442 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44389 } attempt: 1
I20260806 01:07:48.439659 2444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.439477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44389 (local address 127.0.0.1:46222)
0806 01:07:48.439560 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:48.439614 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260806 01:07:48.440120 2444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.440015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44389 (local address 127.0.0.1:46226)
0806 01:07:48.440064 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:48.440096 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260806 01:07:48.440263 2442 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.88.124:44389: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44389: connect: Connection refused (error 111)
I20260806 01:07:48.440796 2367 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.88.125" port: 33267 } attempt: 3
Aug 06 01:07:48 dist-test-slave-69rg krb5kdc[2283](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978468, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for kudu/127.11.88.125@KRBTEST.COM
I20260806 01:07:48.448757 2370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.441065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:33267 (local address 127.0.0.1:50400)
0806 01:07:48.441131 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:48.441142 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:48.441196 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:48.441421 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:48.441422 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:48.441575 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:48.441651 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:48.441653 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.442746 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.442747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:48.443331 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:48.443333 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.443944 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.443945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:48.444010 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:48.444528 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:07:48.444533 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:48.445780 (+ 1247us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:48.447757 (+ 1977us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:48.447758 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:48.447758 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:48.447937 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:48.448156 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:48.448157 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:48.448157 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:48.448212 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:48.448493 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:48.448494 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:48.448534 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 01:07:48.448585 (+ 51us) client_negotiation.cc:240] Negotiation successful
0806 01:07:48.448665 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260806 01:07:48.448833 2447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.441213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50400 (local address 127.11.88.125:33267)
0806 01:07:48.441271 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:48.441274 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:48.441285 (+ 11us) server_negotiation.cc:407] Connection header received
0806 01:07:48.441314 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:48.441315 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:48.441328 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:48.441407 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:48.441725 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.442612 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.443429 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.443848 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.443946 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:48.445943 (+ 1997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:48.445945 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:48.445945 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:48.445954 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:48.447653 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.448015 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.448016 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.448017 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.448087 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.448275 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.448276 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.448276 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.448426 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:48.448499 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:48.448633 (+ 134us) server_negotiation.cc:299] Negotiation successful
0806 01:07:48.448726 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 01:07:48.450011 2367 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44389 } has no permanent_uuid. Determining permanent_uuid...
I20260806 01:07:48.450402 2370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.450301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44389 (local address 127.0.0.1:46242)
0806 01:07:48.450347 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:48.450379 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260806 01:07:48.450774 2370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.450678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44389 (local address 127.0.0.1:46258)
0806 01:07:48.450727 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:48.450752 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260806 01:07:48.450953 2367 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.88.124:44389: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44389: connect: Connection refused (error 111)
I20260806 01:07:48.482111 2367 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44389 } attempt: 1
I20260806 01:07:48.482669 2370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.482490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44389 (local address 127.0.0.1:46270)
0806 01:07:48.482574 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:48.482627 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260806 01:07:48.483106 2370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.482975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44389 (local address 127.0.0.1:46286)
0806 01:07:48.483036 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:48.483070 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260806 01:07:48.483289 2367 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.88.124:44389: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44389: connect: Connection refused (error 111)
W20260806 01:07:48.497637 2450 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 01:07:48.497954 2450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 01:07:48.497999 2450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 01:07:48.498064 2450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 01:07:48.499400 2450 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 01:07:48.499449 2450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 01:07:48.499464 2450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 01:07:48.499480 2450 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 01:07:48.499531 2450 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 01:07:48.501219 2450 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.88.84:35881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.88.126:42481,127.11.88.125:33267,127.11.88.124:44389
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/krb5kdc/kudu_127.11.88.124.keytab
--principal=kudu/127.11.88.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.88.124:44389
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.88.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 01:07:48.501503 2450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 01:07:48.501760 2450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 01:07:48.506685 2455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:48.506676 2458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 01:07:48.506654 2456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 01:07:48.506908 2450 server_base.cc:1034] running on GCE node
I20260806 01:07:48.507213 2450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 01:07:48.507560 2450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 01:07:48.508451 2442 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44389 } attempt: 2
I20260806 01:07:48.508749 2450 hybrid_clock.cc:648] HybridClock initialized: now 1785978468508731 us; error 36 us; skew 500 ppm
I20260806 01:07:48.508891 2444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.508740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44389 (local address 127.0.0.1:46296)
0806 01:07:48.508812 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:48.508855 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260806 01:07:48.509291 2444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.509169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44389 (local address 127.0.0.1:46302)
0806 01:07:48.509223 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:48.509257 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44389: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260806 01:07:48.509406 2442 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.88.124:44389: Network error: Client connection negotiation failed: client connection to 127.11.88.124:44389: connect: Connection refused (error 111)
Aug 06 01:07:48 dist-test-slave-69rg krb5kdc[2283](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978468, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 01:07:48.511471 2450 init.cc:377] Logged in from keytab as kudu/127.11.88.124@KRBTEST.COM (short username kudu)
I20260806 01:07:48.511921 2450 webserver.cc:460] Webserver started at http://127.11.88.124:33363/ using document root <none> and password file <none>
I20260806 01:07:48.512181 2450 fs_manager.cc:359] Metadata directory not provided
I20260806 01:07:48.512253 2450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 01:07:48.512403 2450 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 01:07:48.513484 2450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-2/data/instance:
uuid: "1d14f93f0d974bb5b76b0a1d08a68304"
format_stamp: "Formatted at 2026-08-06 01:07:48 on dist-test-slave-69rg"
server_key: "5d6e8240a1868df822473f9adc9c0f3a"
server_key_iv: "c56e421495acaee94d3562e4ad1be6a4"
server_key_version: "encryptionkey@0"
I20260806 01:07:48.513936 2450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-2/wal/instance:
uuid: "1d14f93f0d974bb5b76b0a1d08a68304"
format_stamp: "Formatted at 2026-08-06 01:07:48 on dist-test-slave-69rg"
server_key: "5d6e8240a1868df822473f9adc9c0f3a"
server_key_iv: "c56e421495acaee94d3562e4ad1be6a4"
server_key_version: "encryptionkey@0"
I20260806 01:07:48.515301 2450 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 01:07:48.516040 2465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 01:07:48.516239 2450 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 01:07:48.516338 2450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-2/data,/tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-2/wal
uuid: "1d14f93f0d974bb5b76b0a1d08a68304"
format_stamp: "Formatted at 2026-08-06 01:07:48 on dist-test-slave-69rg"
server_key: "5d6e8240a1868df822473f9adc9c0f3a"
server_key_iv: "c56e421495acaee94d3562e4ad1be6a4"
server_key_version: "encryptionkey@0"
I20260806 01:07:48.516418 2450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 01:07:48.523296 2450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 01:07:48.525077 2450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 01:07:48.525238 2450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 01:07:48.529455 2450 rpc_server.cc:307] RPC server started. Bound to: 127.11.88.124:44389
I20260806 01:07:48.529490 2518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.88.124:44389 every 8 connection(s)
I20260806 01:07:48.529902 2450 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-2/data/info.pb
I20260806 01:07:48.530892 2519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 01:07:48.532467 2519 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42481 } has no permanent_uuid. Determining permanent_uuid...
I20260806 01:07:48.538058 11617 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7A9gSt/build/release/bin/kudu as pid 2450
I20260806 01:07:48.538197 11617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7A9gSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785978186227899-11617-0/minicluster-data/master-2/wal/instance
Aug 06 01:07:48 dist-test-slave-69rg krb5kdc[2283](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978468, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.124@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
I20260806 01:07:48.538431 11617 external_mini_cluster.cc:1428] Setting key 7744a86a8baca7d2086d15b0f6b62510
I20260806 01:07:48.541889 2371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.533227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59162 (local address 127.11.88.126:42481)
0806 01:07:48.533314 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:48.533318 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:48.533492 (+ 174us) server_negotiation.cc:407] Connection header received
0806 01:07:48.534020 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:48.534021 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:48.534031 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:48.534098 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:48.534705 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.535175 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.536184 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.536386 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.536473 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:48.538870 (+ 2397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:48.538872 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:48.538872 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:48.538879 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:48.540432 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.540850 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.540852 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.540852 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.540919 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.541193 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.541194 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.541194 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.541327 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:48.541400 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:48.541681 (+ 281us) server_negotiation.cc:299] Negotiation successful
0806 01:07:48.541768 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 01:07:48.542097 2521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.533185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.126:42481 (local address 127.0.0.1:59162)
0806 01:07:48.533360 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:48.533401 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:48.533922 (+ 521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:48.534160 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:48.534163 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:48.534410 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:48.534597 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:48.534601 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.535274 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.535275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:48.536088 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:48.536090 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.536492 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.536493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:48.536618 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:48.537191 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:07:48.537200 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:48.538779 (+ 1579us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:48.540517 (+ 1738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:48.540525 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:48.540540 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:48.540769 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:48.540988 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:48.540989 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:48.540989 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:48.541122 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:48.541402 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:48.541409 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:48.541546 (+ 137us) client_negotiation.cc:769] Sending connection context
0806 01:07:48.541647 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 01:07:48.541810 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":96,"threads_started":1}
I20260806 01:07:48.542788 2519 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.125" port: 33267 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 01:07:48 dist-test-slave-69rg krb5kdc[2283](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978468, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.124@KRBTEST.COM
Aug 06 01:07:48 dist-test-slave-69rg krb5kdc[2283](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978468, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.124@KRBTEST.COM for kudu/127.11.88.125@KRBTEST.COM
I20260806 01:07:48.548023 2523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.538871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46314 (local address 127.11.88.124:44389)
0806 01:07:48.539057 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:48.539066 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:48.539082 (+ 16us) server_negotiation.cc:407] Connection header received
0806 01:07:48.539165 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:48.539170 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:48.539184 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:48.539273 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:48.540118 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.540788 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.541607 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.542032 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.542104 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:48.544730 (+ 2626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:48.544739 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:48.544739 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:48.544746 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:48.546711 (+ 1965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.547110 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.547113 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.547113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.547177 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.547406 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.547408 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.547408 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.547569 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:48.547727 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:48.547819 (+ 92us) server_negotiation.cc:299] Negotiation successful
0806 01:07:48.547902 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":79,"threads_started":1}
I20260806 01:07:48.550176 2447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.543147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50414 (local address 127.11.88.125:33267)
0806 01:07:48.543203 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:48.543206 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:48.543219 (+ 13us) server_negotiation.cc:407] Connection header received
0806 01:07:48.543248 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:48.543250 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:48.543262 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:48.543336 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:48.543564 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.544143 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.544917 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.545126 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.545209 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:48.547083 (+ 1874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:48.547084 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:48.547085 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:48.547093 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:48.548702 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.549284 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.549286 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.549286 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.549351 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.549581 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.549582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.549583 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.549728 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:48.549809 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:48.550048 (+ 239us) server_negotiation.cc:299] Negotiation successful
0806 01:07:48.550114 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 01:07:48.550331 2521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.543057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.125:33267 (local address 127.0.0.1:50414)
0806 01:07:48.543120 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:48.543132 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:48.543171 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:48.543336 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:48.543337 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:48.543446 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:48.543492 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:48.543493 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.544232 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.544233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:48.544831 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:48.544833 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.545239 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.545240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:48.545322 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:48.545682 (+ 360us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:07:48.545686 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:48.547001 (+ 1315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:48.548796 (+ 1795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:48.548797 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:48.548797 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:48.549009 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:48.549437 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:48.549438 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:48.549439 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:48.549502 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:48.549874 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:48.549875 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:48.549926 (+ 51us) client_negotiation.cc:769] Sending connection context
0806 01:07:48.550027 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 01:07:48.550222 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260806 01:07:48.550781 2519 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44389 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 01:07:48 dist-test-slave-69rg krb5kdc[2283](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978468, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.126@KRBTEST.COM
Aug 06 01:07:48 dist-test-slave-69rg krb5kdc[2283](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978468, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.124@KRBTEST.COM for kudu/127.11.88.124@KRBTEST.COM
I20260806 01:07:48.557809 2371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.549025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59164 (local address 127.11.88.126:42481)
0806 01:07:48.549102 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:48.549105 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:48.549113 (+ 8us) server_negotiation.cc:407] Connection header received
0806 01:07:48.549136 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:48.549137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:48.549153 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:48.549232 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:48.549874 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.550716 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.551774 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.552037 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.552091 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:48.555024 (+ 2933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:48.555026 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:48.555026 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:48.555033 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:48.556592 (+ 1559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.556978 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.556979 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.556980 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.557052 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.557278 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.557279 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.557279 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.557392 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:48.557553 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:48.557626 (+ 73us) server_negotiation.cc:299] Negotiation successful
0806 01:07:48.557720 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 01:07:48.558342 2521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.551046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44389 (local address 127.0.0.1:46328)
0806 01:07:48.551096 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:48.551106 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:48.551140 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:48.551323 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:48.551323 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:48.551432 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:48.551463 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:48.551464 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.552267 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.552267 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:48.552768 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:48.552769 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.553322 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.553323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:48.553359 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:48.553771 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:07:48.553775 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:48.555487 (+ 1712us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:48.557213 (+ 1726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:48.557214 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:48.557214 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:48.557434 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:48.557678 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:48.557679 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:48.557679 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:48.557751 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:48.558094 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:48.558095 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:48.558131 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 01:07:48.558188 (+ 57us) client_negotiation.cc:240] Negotiation successful
0806 01:07:48.558273 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260806 01:07:48.558447 2367 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44389 } attempt: 2
I20260806 01:07:48.558678 2523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.551147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46328 (local address 127.11.88.124:44389)
0806 01:07:48.551198 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:48.551200 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:48.551208 (+ 8us) server_negotiation.cc:407] Connection header received
0806 01:07:48.551228 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:48.551229 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:48.551239 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:48.551311 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:48.551532 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.552184 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.552852 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.553238 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.553329 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:48.555597 (+ 2268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:48.555598 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:48.555598 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:48.555612 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:48.557140 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.557521 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.557522 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.557522 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.557599 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.557850 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.557851 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.557851 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.557992 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:48.558070 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:48.558485 (+ 415us) server_negotiation.cc:299] Negotiation successful
0806 01:07:48.558563 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260806 01:07:48.560336 2519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d14f93f0d974bb5b76b0a1d08a68304: Bootstrap starting.
I20260806 01:07:48.561265 2519 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d14f93f0d974bb5b76b0a1d08a68304: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:48.561597 2519 log.cc:824] T 00000000000000000000000000000000 P 1d14f93f0d974bb5b76b0a1d08a68304: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:48.562904 2519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d14f93f0d974bb5b76b0a1d08a68304: No bootstrap required, opened a new log
Aug 06 01:07:48 dist-test-slave-69rg krb5kdc[2283](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978468, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.126@KRBTEST.COM for kudu/127.11.88.124@KRBTEST.COM
Aug 06 01:07:48 dist-test-slave-69rg krb5kdc[2283](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978468, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.88.125@KRBTEST.COM
I20260806 01:07:48.564855 2519 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d14f93f0d974bb5b76b0a1d08a68304 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26a019ee29864465b9225b4eddc1daba" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42481 } } peers { permanent_uuid: "f9253185f9dc4bd996020389699b43b4" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 33267 } } peers { permanent_uuid: "1d14f93f0d974bb5b76b0a1d08a68304" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44389 } }
I20260806 01:07:48.565002 2519 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d14f93f0d974bb5b76b0a1d08a68304 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d14f93f0d974bb5b76b0a1d08a68304, State: Initialized, Role: FOLLOWER
I20260806 01:07:48.565093 2519 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d14f93f0d974bb5b76b0a1d08a68304 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26a019ee29864465b9225b4eddc1daba" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42481 } } peers { permanent_uuid: "f9253185f9dc4bd996020389699b43b4" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 33267 } } peers { permanent_uuid: "1d14f93f0d974bb5b76b0a1d08a68304" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44389 } }
I20260806 01:07:48.565434 2519 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d14f93f0d974bb5b76b0a1d08a68304 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:48.565483 2525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d14f93f0d974bb5b76b0a1d08a68304 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26a019ee29864465b9225b4eddc1daba" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42481 } } peers { permanent_uuid: "f9253185f9dc4bd996020389699b43b4" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 33267 } } peers { permanent_uuid: "1d14f93f0d974bb5b76b0a1d08a68304" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44389 } } }
I20260806 01:07:48.565589 2525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d14f93f0d974bb5b76b0a1d08a68304 [sys.catalog]: This master's current role is: FOLLOWER
W20260806 01:07:48.567404 2536 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1d14f93f0d974bb5b76b0a1d08a68304: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 01:07:48.567554 2536 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 01:07:48.567826 2523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.559199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46344 (local address 127.11.88.124:44389)
0806 01:07:48.559249 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:48.559251 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:48.559261 (+ 10us) server_negotiation.cc:407] Connection header received
0806 01:07:48.559282 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:48.559283 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:48.559293 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:48.559679 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:48.559704 (+ 25us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.560131 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.561068 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.561358 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.561451 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:48.563757 (+ 2306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:48.563759 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:48.563759 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:48.563767 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:48.566591 (+ 2824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.566991 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.566991 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.566992 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.567048 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.567272 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.567272 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.567273 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.567418 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:48.567485 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:48.567669 (+ 184us) server_negotiation.cc:299] Negotiation successful
0806 01:07:48.567739 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260806 01:07:48.567831 2370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.558747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44389 (local address 127.0.0.1:46344)
0806 01:07:48.558789 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:48.558800 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:48.558837 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:48.559392 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:48.559393 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:48.559545 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:48.559590 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:48.559591 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.560210 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.560211 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:48.560980 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:48.560982 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.561451 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.561453 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:48.561511 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:48.562184 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:07:48.562190 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:48.563661 (+ 1471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:48.566679 (+ 3018us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:48.566680 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:48.566681 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:48.566906 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:48.567115 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:48.567116 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:48.567117 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:48.567200 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:48.567515 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:48.567516 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:48.567564 (+ 48us) client_negotiation.cc:769] Sending connection context
0806 01:07:48.567639 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 01:07:48.567738 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260806 01:07:48.567974 2447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.558695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50418 (local address 127.11.88.125:33267)
0806 01:07:48.558737 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:48.558739 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:48.558788 (+ 49us) server_negotiation.cc:407] Connection header received
0806 01:07:48.558892 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:48.558893 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:48.558903 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:48.558930 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:48.559611 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.560304 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.561238 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.561566 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.561652 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:48.564301 (+ 2649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:48.564302 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:48.564303 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:48.564310 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:48.565954 (+ 1644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.566399 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.566400 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.566401 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.566466 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.566697 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.566698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.566698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.566864 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:48.567027 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:48.567800 (+ 773us) server_negotiation.cc:299] Negotiation successful
0806 01:07:48.567882 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 01:07:48.569239 11617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 01:07:48.570482 2339 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "26a019ee29864465b9225b4eddc1daba"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59164
I20260806 01:07:48.568408 2450 master_runner.cc:186] Error getting master registration for 127.11.88.126:42481: OK, instance_id { permanent_uuid: "26a019ee29864465b9225b4eddc1daba" instance_seqno: 1785978468207596 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 01:07:48.571583 2450 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 01:07:48.572893 2367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba: Bootstrap starting.
I20260806 01:07:48.573621 2367 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:48.573941 2367 log.cc:824] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:48.574746 2367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba: No bootstrap required, opened a new log
I20260806 01:07:48.576086 2367 raft_consensus.cc:348] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26a019ee29864465b9225b4eddc1daba" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42481 } } peers { permanent_uuid: "f9253185f9dc4bd996020389699b43b4" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 33267 } } peers { permanent_uuid: "1d14f93f0d974bb5b76b0a1d08a68304" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44389 } }
I20260806 01:07:48.576233 2367 raft_consensus.cc:729] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26a019ee29864465b9225b4eddc1daba, State: Initialized, Role: FOLLOWER
I20260806 01:07:48.576331 2367 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26a019ee29864465b9225b4eddc1daba" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42481 } } peers { permanent_uuid: "f9253185f9dc4bd996020389699b43b4" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 33267 } } peers { permanent_uuid: "1d14f93f0d974bb5b76b0a1d08a68304" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44389 } }
I20260806 01:07:48.576654 2367 sys_catalog.cc:564] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:48.576684 2339 raft_consensus.cc:482] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 01:07:48.576730 2339 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:48.577593 2339 raft_consensus.cc:504] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26a019ee29864465b9225b4eddc1daba" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42481 } } peers { permanent_uuid: "f9253185f9dc4bd996020389699b43b4" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 33267 } } peers { permanent_uuid: "1d14f93f0d974bb5b76b0a1d08a68304" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44389 } }
I20260806 01:07:48.577907 2339 leader_election.cc:288] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba [CANDIDATE]: Term 1 election: Requested vote from peers f9253185f9dc4bd996020389699b43b4 (127.11.88.125:33267), 1d14f93f0d974bb5b76b0a1d08a68304 (127.11.88.124:44389)
I20260806 01:07:48.578598 2493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "26a019ee29864465b9225b4eddc1daba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "1d14f93f0d974bb5b76b0a1d08a68304"
I20260806 01:07:48.578727 2493 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d14f93f0d974bb5b76b0a1d08a68304 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:48.576624 2539 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26a019ee29864465b9225b4eddc1daba" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42481 } } peers { permanent_uuid: "f9253185f9dc4bd996020389699b43b4" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 33267 } } peers { permanent_uuid: "1d14f93f0d974bb5b76b0a1d08a68304" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44389 } } }
I20260806 01:07:48.579303 2539 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba [sys.catalog]: This master's current role is: FOLLOWER
I20260806 01:07:48.579655 2493 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1d14f93f0d974bb5b76b0a1d08a68304 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26a019ee29864465b9225b4eddc1daba in term 1.
W20260806 01:07:48.579852 2550 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 01:07:48.579907 2550 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 01:07:48.580468 2314 leader_election.cc:302] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d14f93f0d974bb5b76b0a1d08a68304, 26a019ee29864465b9225b4eddc1daba; no voters:
I20260806 01:07:48.581871 2539 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba [term 1 FOLLOWER]: Leader election won for term 1
I20260806 01:07:48.582038 2539 raft_consensus.cc:686] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba [term 1 LEADER]: Becoming Leader. State: Replica: 26a019ee29864465b9225b4eddc1daba, State: Running, Role: LEADER
I20260806 01:07:48.582145 2539 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26a019ee29864465b9225b4eddc1daba" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42481 } } peers { permanent_uuid: "f9253185f9dc4bd996020389699b43b4" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 33267 } } peers { permanent_uuid: "1d14f93f0d974bb5b76b0a1d08a68304" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44389 } }
I20260806 01:07:48.582557 2539 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26a019ee29864465b9225b4eddc1daba. Latest consensus state: current_term: 1 leader_uuid: "26a019ee29864465b9225b4eddc1daba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26a019ee29864465b9225b4eddc1daba" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42481 } } peers { permanent_uuid: "f9253185f9dc4bd996020389699b43b4" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 33267 } } peers { permanent_uuid: "1d14f93f0d974bb5b76b0a1d08a68304" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44389 } } }
I20260806 01:07:48.582651 2539 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:48.580643 2296 master_runner.cc:186] Error getting master registration for 127.11.88.125:33267: OK, instance_id { permanent_uuid: "f9253185f9dc4bd996020389699b43b4" instance_seqno: 1785978468360558 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 01:07:48.584251 2296 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 01:07:48.584560 2561 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 01:07:48.585469 2561 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 01:07:48.588222 2493 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1d14f93f0d974bb5b76b0a1d08a68304 [term 1 FOLLOWER]: Refusing update from remote peer 26a019ee29864465b9225b4eddc1daba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:07:48.588675 2559 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d14f93f0d974bb5b76b0a1d08a68304" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 01:07:48.590160 2525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d14f93f0d974bb5b76b0a1d08a68304 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26a019ee29864465b9225b4eddc1daba. Latest consensus state: current_term: 1 leader_uuid: "26a019ee29864465b9225b4eddc1daba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26a019ee29864465b9225b4eddc1daba" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42481 } } peers { permanent_uuid: "f9253185f9dc4bd996020389699b43b4" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 33267 } } peers { permanent_uuid: "1d14f93f0d974bb5b76b0a1d08a68304" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44389 } } }
I20260806 01:07:48.590269 2525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d14f93f0d974bb5b76b0a1d08a68304 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 01:07:48.592537 2559 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "26a019ee29864465b9225b4eddc1daba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26a019ee29864465b9225b4eddc1daba" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42481 } } peers { permanent_uuid: "f9253185f9dc4bd996020389699b43b4" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 33267 } } peers { permanent_uuid: "1d14f93f0d974bb5b76b0a1d08a68304" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44389 } } }
I20260806 01:07:48.592629 2559 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:48.593124 2525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d14f93f0d974bb5b76b0a1d08a68304 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "26a019ee29864465b9225b4eddc1daba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26a019ee29864465b9225b4eddc1daba" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42481 } } peers { permanent_uuid: "f9253185f9dc4bd996020389699b43b4" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 33267 } } peers { permanent_uuid: "1d14f93f0d974bb5b76b0a1d08a68304" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44389 } } }
I20260806 01:07:48.593221 2525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d14f93f0d974bb5b76b0a1d08a68304 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 01:07:48.593575 2562 mvcc.cc:205] Tried to move back new op lower bound from 7315367807334141952 to 7315367807313235968. Current Snapshot: MvccSnapshot[applied={T|T < 7315367807334141952}]
I20260806 01:07:48.594473 2563 mvcc.cc:205] Tried to move back new op lower bound from 7315367807334141952 to 7315367807313235968. Current Snapshot: MvccSnapshot[applied={T|T < 7315367807334141952}]
I20260806 01:07:48.595393 2561 catalog_manager.cc:1347] Generated new cluster ID: 19a850c0696c438c8a2f09073779c9e4
I20260806 01:07:48.595440 2561 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 01:07:48.600324 2371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.580420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59176 (local address 127.11.88.126:42481)
0806 01:07:48.580454 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:48.580456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:48.581153 (+ 697us) server_negotiation.cc:407] Connection header received
0806 01:07:48.581348 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:48.581349 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:48.581361 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:48.581390 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:48.583962 (+ 2572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.584670 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.588689 (+ 4019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.588983 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.589026 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:48.593011 (+ 3985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:48.593013 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:48.593013 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:48.593021 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:48.596553 (+ 3532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.598289 (+ 1736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.598290 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.598290 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.598355 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.598575 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.598576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.598576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.598721 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:48.598817 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:48.600142 (+ 1325us) server_negotiation.cc:299] Negotiation successful
0806 01:07:48.600226 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260806 01:07:48.600543 2442 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44389 } attempt: 3
I20260806 01:07:48.602035 2447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.580187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50432 (local address 127.11.88.125:33267)
0806 01:07:48.580234 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:48.580236 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:48.581299 (+ 1063us) server_negotiation.cc:407] Connection header received
0806 01:07:48.582297 (+ 998us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:48.582298 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:48.582310 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:48.582340 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:48.583089 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.583852 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.587935 (+ 4083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.588232 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.588280 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:48.593343 (+ 5063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:48.593344 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:48.593345 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:48.593353 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:48.597290 (+ 3937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.599001 (+ 1711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.599002 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.599002 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.599066 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.601362 (+ 2296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.601363 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.601363 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.601512 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:48.601593 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:48.601855 (+ 262us) server_negotiation.cc:299] Negotiation successful
0806 01:07:48.601941 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 01:07:48.605985 2523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.580813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46358 (local address 127.11.88.124:44389)
0806 01:07:48.580849 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:48.580851 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:48.586665 (+ 5814us) server_negotiation.cc:407] Connection header received
0806 01:07:48.586773 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:48.586774 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:48.586786 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:48.586817 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:48.591273 (+ 4456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.591996 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.595480 (+ 3484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.595802 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.595852 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:48.602779 (+ 6927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:48.602781 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:48.602782 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:48.602790 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:48.604744 (+ 1954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.605132 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.605133 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.605133 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.605187 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.605375 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.605375 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.605376 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.605495 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:48.605585 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:48.605783 (+ 198us) server_negotiation.cc:299] Negotiation successful
0806 01:07:48.605889 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
Aug 06 01:07:48 dist-test-slave-69rg krb5kdc[2283](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785978468, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.88.125@KRBTEST.COM for kudu/127.11.88.124@KRBTEST.COM
I20260806 01:07:48.618146 2444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.600799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.88.124:44389 (local address 127.0.0.1:46360)
0806 01:07:48.600966 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0806 01:07:48.600977 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 01:07:48.601021 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 01:07:48.603281 (+ 2260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 01:07:48.603283 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 01:07:48.603445 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0806 01:07:48.603494 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:48.603496 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.607507 (+ 4011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.607509 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:48.608325 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 01:07:48.608327 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.608868 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.608869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 01:07:48.608932 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:48.609360 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 01:07:48.609381 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 01:07:48.610940 (+ 1559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 01:07:48.615206 (+ 4266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:48.615220 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:48.615221 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:48.615440 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:48.615803 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 01:07:48.615804 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 01:07:48.615804 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 01:07:48.615882 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 01:07:48.617673 (+ 1791us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 01:07:48.617674 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 01:07:48.617726 (+ 52us) client_negotiation.cc:769] Sending connection context
0806 01:07:48.617786 (+ 60us) client_negotiation.cc:240] Negotiation successful
0806 01:07:48.618012 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146}
I20260806 01:07:48.619324 2567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:48.601097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46360 (local address 127.11.88.124:44389)
0806 01:07:48.603116 (+ 2019us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:48.603118 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:48.603125 (+ 7us) server_negotiation.cc:407] Connection header received
0806 01:07:48.603146 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:48.603147 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:48.603158 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:48.603909 (+ 751us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:48.603950 (+ 41us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.607403 (+ 3453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.608428 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:48.608777 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:48.609098 (+ 321us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:48.611033 (+ 1935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 01:07:48.611035 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 01:07:48.611035 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 01:07:48.611076 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 01:07:48.615087 (+ 4011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.615571 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.615572 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.615572 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.615704 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 01:07:48.615964 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 01:07:48.615964 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 01:07:48.615965 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 01:07:48.617543 (+ 1578us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 01:07:48.618705 (+ 1162us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:48.618785 (+ 80us) server_negotiation.cc:299] Negotiation successful
0806 01:07:48.618981 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1995,"thread_start_us":93,"threads_started":1}
I20260806 01:07:48.621389 2442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9253185f9dc4bd996020389699b43b4: Bootstrap starting.
I20260806 01:07:48.622249 2442 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f9253185f9dc4bd996020389699b43b4: Neither blocks nor log segments found. Creating new log.
I20260806 01:07:48.622565 2442 log.cc:824] T 00000000000000000000000000000000 P f9253185f9dc4bd996020389699b43b4: Log is configured to *not* fsync() on all Append() calls
I20260806 01:07:48.626544 2442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9253185f9dc4bd996020389699b43b4: No bootstrap required, opened a new log
I20260806 01:07:48.631175 2442 raft_consensus.cc:348] T 00000000000000000000000000000000 P f9253185f9dc4bd996020389699b43b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26a019ee29864465b9225b4eddc1daba" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42481 } } peers { permanent_uuid: "f9253185f9dc4bd996020389699b43b4" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 33267 } } peers { permanent_uuid: "1d14f93f0d974bb5b76b0a1d08a68304" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44389 } }
I20260806 01:07:48.631572 2442 raft_consensus.cc:729] T 00000000000000000000000000000000 P f9253185f9dc4bd996020389699b43b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9253185f9dc4bd996020389699b43b4, State: Initialized, Role: FOLLOWER
I20260806 01:07:48.631800 2442 consensus_queue.cc:260] T 00000000000000000000000000000000 P f9253185f9dc4bd996020389699b43b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26a019ee29864465b9225b4eddc1daba" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42481 } } peers { permanent_uuid: "f9253185f9dc4bd996020389699b43b4" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 33267 } } peers { permanent_uuid: "1d14f93f0d974bb5b76b0a1d08a68304" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44389 } }
I20260806 01:07:48.632524 2416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "26a019ee29864465b9225b4eddc1daba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f9253185f9dc4bd996020389699b43b4"
I20260806 01:07:48.632635 2416 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f9253185f9dc4bd996020389699b43b4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 01:07:48.633596 2416 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f9253185f9dc4bd996020389699b43b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26a019ee29864465b9225b4eddc1daba in term 1.
I20260806 01:07:48.634122 2415 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f9253185f9dc4bd996020389699b43b4 [term 1 FOLLOWER]: Refusing update from remote peer 26a019ee29864465b9225b4eddc1daba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 01:07:48.634464 2442 sys_catalog.cc:564] T 00000000000000000000000000000000 P f9253185f9dc4bd996020389699b43b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 01:07:48.634416 2539 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9253185f9dc4bd996020389699b43b4" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 33267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 01:07:48.636852 2584 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f9253185f9dc4bd996020389699b43b4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 01:07:48.637013 2584 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 01:07:48.639025 2569 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9253185f9dc4bd996020389699b43b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "26a019ee29864465b9225b4eddc1daba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26a019ee29864465b9225b4eddc1daba" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42481 } } peers { permanent_uuid: "f9253185f9dc4bd996020389699b43b4" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 33267 } } peers { permanent_uuid: "1d14f93f0d974bb5b76b0a1d08a68304" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44389 } } }
I20260806 01:07:48.642699 2569 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9253185f9dc4bd996020389699b43b4 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 01:07:48.642846 2569 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9253185f9dc4bd996020389699b43b4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "26a019ee29864465b9225b4eddc1daba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26a019ee29864465b9225b4eddc1daba" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42481 } } peers { permanent_uuid: "f9253185f9dc4bd996020389699b43b4" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 33267 } } peers { permanent_uuid: "1d14f93f0d974bb5b76b0a1d08a68304" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44389 } } }
I20260806 01:07:48.643085 2569 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9253185f9dc4bd996020389699b43b4 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 01:07:48.641906 2583 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9253185f9dc4bd996020389699b43b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26a019ee29864465b9225b4eddc1daba. Latest consensus state: current_term: 1 leader_uuid: "26a019ee29864465b9225b4eddc1daba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26a019ee29864465b9225b4eddc1daba" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42481 } } peers { permanent_uuid: "f9253185f9dc4bd996020389699b43b4" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 33267 } } peers { permanent_uuid: "1d14f93f0d974bb5b76b0a1d08a68304" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44389 } } }
I20260806 01:07:48.643231 2583 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9253185f9dc4bd996020389699b43b4 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 01:07:48.643278 2577 mvcc.cc:205] Tried to move back new op lower bound from 7315367807334141952 to 7315367807313235968. Current Snapshot: MvccSnapshot[applied={T|T < 7315367807334141952}]
I20260806 01:07:48.648440 2539 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "26a019ee29864465b9225b4eddc1daba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26a019ee29864465b9225b4eddc1daba" member_type: VOTER last_known_addr { host: "127.11.88.126" port: 42481 } } peers { permanent_uuid: "f9253185f9dc4bd996020389699b43b4" member_type: VOTER last_known_addr { host: "127.11.88.125" port: 33267 } } peers { permanent_uuid: "1d14f93f0d974bb5b76b0a1d08a68304" member_type: VOTER last_known_addr { host: "127.11.88.124" port: 44389 } } }
I20260806 01:07:48.648576 2539 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba [sys.catalog]: This master's current role is: LEADER
I20260806 01:07:48.651160 2561 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 01:07:48.652040 2561 catalog_manager.cc:1504] Loading token signing keys...
I20260806 01:07:48.662029 2561 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 26a019ee29864465b9225b4eddc1daba: Generated new TSK 0
I20260806 01:07:48.662245 2561 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 01:07:48.694895 2371 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:07:48.693472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59192 (local address 127.11.88.126:42481)
0806 01:07:48.693517 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:48.693519 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:48.694195 (+ 676us) server_negotiation.cc:407] Connection header received
0806 01:07:48.694305 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:48.694307 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:48.694320 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:48.694350 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:48.694822 (+ 472us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59192: BlockingRecv error: recv got EOF from 127.0.0.1:59192 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260806 01:07:48.696321 2567 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:07:48.693878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46374 (local address 127.11.88.124:44389)
0806 01:07:48.693922 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:48.693924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:48.695771 (+ 1847us) server_negotiation.cc:407] Connection header received
0806 01:07:48.695876 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:48.695877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:48.695889 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:48.695919 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:48.696250 (+ 331us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46374: BlockingRecv error: recv got EOF from 127.0.0.1:46374 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260806 01:07:48.697364 2447 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:07:48.695427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50442 (local address 127.11.88.125:33267)
0806 01:07:48.695472 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:48.695474 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:48.696693 (+ 1219us) server_negotiation.cc:407] Connection header received
0806 01:07:48.696862 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:48.696864 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:48.696876 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:48.696907 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:48.697298 (+ 391us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50442: BlockingRecv error: recv got EOF from 127.0.0.1:50442 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260806 01:07:48.700063 2447 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:07:48.699251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50454 (local address 127.11.88.125:33267)
0806 01:07:48.699300 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:48.699302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:48.699510 (+ 208us) server_negotiation.cc:407] Connection header received
0806 01:07:48.699622 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:48.699623 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:48.699654 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:48.699688 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:48.700015 (+ 327us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50454: BlockingRecv error: recv got EOF from 127.0.0.1:50454 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260806 01:07:48.703202 2447 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:07:48.702461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50462 (local address 127.11.88.125:33267)
0806 01:07:48.702494 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:48.702495 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:48.702719 (+ 224us) server_negotiation.cc:407] Connection header received
0806 01:07:48.702810 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:48.702811 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:48.702821 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:48.702850 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:48.703145 (+ 295us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50462: BlockingRecv error: recv got EOF from 127.0.0.1:50462 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260806 01:07:48.707407 2447 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:07:48.706613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50474 (local address 127.11.88.125:33267)
0806 01:07:48.706661 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:48.706663 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:48.706882 (+ 219us) server_negotiation.cc:407] Connection header received
0806 01:07:48.706982 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:48.706983 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:48.706994 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:48.707024 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:48.707360 (+ 336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50474: BlockingRecv error: recv got EOF from 127.0.0.1:50474 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260806 01:07:48.713588 2447 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:07:48.712755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50484 (local address 127.11.88.125:33267)
0806 01:07:48.712792 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:48.712794 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:48.713028 (+ 234us) server_negotiation.cc:407] Connection header received
0806 01:07:48.713131 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:48.713132 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:48.713143 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:48.713176 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:48.713530 (+ 354us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50484: BlockingRecv error: recv got EOF from 127.0.0.1:50484 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260806 01:07:48.724156 2447 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:07:48.723190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50494 (local address 127.11.88.125:33267)
0806 01:07:48.723235 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:48.723237 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:48.723509 (+ 272us) server_negotiation.cc:407] Connection header received
0806 01:07:48.723634 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:48.723635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:48.723657 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:48.723690 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:48.724091 (+ 401us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50494: BlockingRecv error: recv got EOF from 127.0.0.1:50494 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260806 01:07:48.742965 2447 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:07:48.741785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50498 (local address 127.11.88.125:33267)
0806 01:07:48.741866 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:48.741869 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:48.742154 (+ 285us) server_negotiation.cc:407] Connection header received
0806 01:07:48.742267 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:48.742269 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:48.742283 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:48.742315 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:48.742898 (+ 583us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50498: BlockingRecv error: recv got EOF from 127.0.0.1:50498 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260806 01:07:48.777485 2447 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:07:48.776643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50510 (local address 127.11.88.125:33267)
0806 01:07:48.776693 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:48.776696 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:48.776875 (+ 179us) server_negotiation.cc:407] Connection header received
0806 01:07:48.776924 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:48.776926 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:48.776944 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:48.777013 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:48.777416 (+ 403us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50510: BlockingRecv error: recv got EOF from 127.0.0.1:50510 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260806 01:07:48.843751 2447 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:07:48.842823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50516 (local address 127.11.88.125:33267)
0806 01:07:48.842934 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:48.842937 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:48.843004 (+ 67us) server_negotiation.cc:407] Connection header received
0806 01:07:48.843116 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:48.843117 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:48.843128 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:48.843210 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:48.843677 (+ 467us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50516: BlockingRecv error: recv got EOF from 127.0.0.1:50516 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260806 01:07:48.974023 2447 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:07:48.973032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50532 (local address 127.11.88.125:33267)
0806 01:07:48.973148 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:48.973151 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:48.973297 (+ 146us) server_negotiation.cc:407] Connection header received
0806 01:07:48.973412 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:48.973413 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:48.973427 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:48.973506 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:48.973930 (+ 424us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50532: BlockingRecv error: recv got EOF from 127.0.0.1:50532 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260806 01:07:49.232185 2447 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 01:07:49.231512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56672 (local address 127.11.88.125:33267)
0806 01:07:49.231608 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:49.231610 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:49.231623 (+ 13us) server_negotiation.cc:407] Connection header received
0806 01:07:49.231654 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:49.231655 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:49.231673 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:49.231742 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 01:07:49.232104 (+ 362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56672: BlockingRecv error: recv got EOF from 127.0.0.1:56672 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 01:07:49.568029 2536 catalog_manager.cc:1259] Loaded cluster ID: 19a850c0696c438c8a2f09073779c9e4
I20260806 01:07:49.568109 2536 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1d14f93f0d974bb5b76b0a1d08a68304: loading cluster ID for follower catalog manager: success
I20260806 01:07:49.568907 2536 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1d14f93f0d974bb5b76b0a1d08a68304: acquiring CA information for follower catalog manager: success
I20260806 01:07:49.569180 2536 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1d14f93f0d974bb5b76b0a1d08a68304: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 01:07:49.637581 2584 catalog_manager.cc:1259] Loaded cluster ID: 19a850c0696c438c8a2f09073779c9e4
I20260806 01:07:49.637666 2584 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f9253185f9dc4bd996020389699b43b4: loading cluster ID for follower catalog manager: success
I20260806 01:07:49.638536 2584 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f9253185f9dc4bd996020389699b43b4: acquiring CA information for follower catalog manager: success
I20260806 01:07:49.638816 2584 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f9253185f9dc4bd996020389699b43b4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 01:07:49.748481 2654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:49.745749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56676 (local address 127.11.88.125:33267)
0806 01:07:49.745943 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:49.745945 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:49.745957 (+ 12us) server_negotiation.cc:407] Connection header received
0806 01:07:49.746007 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:49.746007 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:49.746071 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:49.746136 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:07:49.746288 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:49.746801 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:49.747602 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:49.747827 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:49.747899 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:49.748083 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:07:49.748247 (+ 164us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:07:49.748336 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:49.748376 (+ 40us) server_negotiation.cc:299] Negotiation successful
0806 01:07:49.748400 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":114,"threads_started":1}
I20260806 01:07:49.753070 2660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:49.750454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59358 (local address 127.11.88.124:44389)
0806 01:07:49.750576 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:49.750578 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:49.750631 (+ 53us) server_negotiation.cc:407] Connection header received
0806 01:07:49.750687 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:49.750688 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:49.750734 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:49.750802 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:07:49.750888 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:49.751498 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:49.752272 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:49.752491 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:49.752549 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:49.752718 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:07:49.752826 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:07:49.752887 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:49.752923 (+ 36us) server_negotiation.cc:299] Negotiation successful
0806 01:07:49.752942 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":63,"threads_started":1}
I20260806 01:07:49.758106 2654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:49.754959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56682 (local address 127.11.88.125:33267)
0806 01:07:49.755008 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:49.755010 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:49.755203 (+ 193us) server_negotiation.cc:407] Connection header received
0806 01:07:49.755333 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:49.755334 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:49.755346 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:49.755381 (+ 35us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:07:49.755595 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:49.756377 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:49.757185 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:49.757474 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:49.757540 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:49.757743 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:07:49.757794 (+ 51us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:07:49.757887 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:49.757958 (+ 71us) server_negotiation.cc:299] Negotiation successful
0806 01:07:49.757983 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 01:07:49.758244 2660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:49.755224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59364 (local address 127.11.88.124:44389)
0806 01:07:49.755264 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:49.755266 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:49.755321 (+ 55us) server_negotiation.cc:407] Connection header received
0806 01:07:49.755445 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:49.755446 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:49.755458 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:49.755508 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:07:49.755685 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:49.756218 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:49.757369 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:49.757652 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:49.757708 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:49.757922 (+ 214us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:07:49.757954 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:07:49.757985 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:49.758119 (+ 134us) server_negotiation.cc:299] Negotiation successful
0806 01:07:49.758144 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 01:07:49.758903 2667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 01:07:49.755003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40194 (local address 127.11.88.126:42481)
0806 01:07:49.755150 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0806 01:07:49.755153 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 01:07:49.755242 (+ 89us) server_negotiation.cc:407] Connection header received
0806 01:07:49.755362 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 01:07:49.755364 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 01:07:49.755428 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 01:07:49.755520 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 01:07:49.755759 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:49.756503 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:49.757606 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 01:07:49.757955 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 01:07:49.758016 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 01:07:49.758387 (+ 371us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 01:07:49.758528 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 01:07:49.758594 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 01:07:49.758761 (+ 167us) server_negotiation.cc:299] Negotiation successful
0806 01:07:49.758790 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":65,"threads_started":1}
I20260806 01:07:49.760526 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 2296
I20260806 01:07:49.768975 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 2374
I20260806 01:07:49.774969 11617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7A9gSt/build/release/bin/kudu with pid 2450
2026-08-06T01:07:49Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2964 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5941 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (283548 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST